2023-08-25T04:29:47.590 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-25T04:29:47.592 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} --owner scheduled_rishabh@teuthology --name rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081 -- /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081/orig.config.yaml 2023-08-25T04:29:47.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T04:29:47.743 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081 branch: wip-rishabh-2023aug3-b5 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} email: null first_in_suite: false job_id: '7379081' kernel: client: sha1: distro flavor: default kdb: true sha1: a6a69670761025e039dc5ae86619b0cf04c46dc2 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-2023aug3-b5 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023aug3-b5 sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023aug3-b5 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - workunit: clients: all: - fs/quota teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 449a1bc2027504e7b3c3d7b30fa4178906581da7 timestamp: 2023-08-25_01:50:32 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-25T04:29:47.744 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa; will attempt to use it 2023-08-25T04:29:47.745 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa/tasks 2023-08-25T04:29:47.745 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-25T04:29:47.747 INFO:teuthology.task.internal:Checking packages... 2023-08-25T04:29:47.782 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'ba6b39e4f4f77fb95c747099b53db0467d435f56' 2023-08-25T04:29:47.783 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-25T04:29:47.784 INFO:teuthology.packaging:ref: None 2023-08-25T04:29:47.784 INFO:teuthology.packaging:tag: None 2023-08-25T04:29:47.784 INFO:teuthology.packaging:branch: wip-rishabh-2023aug3-b5 2023-08-25T04:29:47.784 INFO:teuthology.packaging:sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:29:47.785 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023aug3-b5 2023-08-25T04:29:48.013 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5703.gba6b39e4 2023-08-25T04:29:48.013 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-25T04:29:48.022 INFO:teuthology.task.internal:no buildpackages task found 2023-08-25T04:29:48.022 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-25T04:29:48.027 INFO:teuthology.task.internal:Saving configuration 2023-08-25T04:29:48.048 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-25T04:29:48.055 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T04:29:48.083 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 04:24:40.249494', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-25T04:29:48.108 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 04:24:40.248130', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-25T04:29:48.115 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-25T04:29:48.122 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-25T04:29:48.123 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-25T04:29:48.123 INFO:teuthology.run_tasks:Running task console_log... 2023-08-25T04:29:48.225 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd1ed5c3f70>, signals=[15]) 2023-08-25T04:29:48.226 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-25T04:29:48.233 INFO:teuthology.task.internal:Opening connections... 2023-08-25T04:29:48.233 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2023-08-25T04:29:48.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:29:48.309 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2023-08-25T04:29:48.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:29:48.420 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-25T04:29:48.426 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2023-08-25T04:29:48.449 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2023-08-25T04:29:48.449 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-08-25T04:29:48.513 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux" 2023-08-25T04:29:48.513 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.6 (Ootpa)" 2023-08-25T04:29:48.513 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2023-08-25T04:29:48.514 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2023-08-25T04:29:48.514 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.6" 2023-08-25T04:29:48.514 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2023-08-25T04:29:48.514 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-25T04:29:48.514 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-08-25T04:29:48.514 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-25T04:29:48.514 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2023-08-25T04:29:48.515 INFO:teuthology.orchestra.run.smithi016.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-25T04:29:48.515 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T04:29:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:29:48.515 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T04:29:48.515 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-25T04:29:48.515 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-25T04:29:48.515 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-25T04:29:48.516 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-08-25T04:29:48.548 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2023-08-25T04:29:48.569 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2023-08-25T04:29:48.570 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-08-25T04:29:48.628 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Red Hat Enterprise Linux" 2023-08-25T04:29:48.629 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8.6 (Ootpa)" 2023-08-25T04:29:48.629 INFO:teuthology.orchestra.run.smithi117.stdout:ID="rhel" 2023-08-25T04:29:48.629 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="fedora" 2023-08-25T04:29:48.629 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8.6" 2023-08-25T04:29:48.629 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8" 2023-08-25T04:29:48.629 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-25T04:29:48.630 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2023-08-25T04:29:48.630 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-25T04:29:48.630 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.redhat.com/" 2023-08-25T04:29:48.630 INFO:teuthology.orchestra.run.smithi117.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-25T04:29:48.630 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T04:29:48.630 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:29:48.630 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T04:29:48.631 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-25T04:29:48.631 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-25T04:29:48.631 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-25T04:29:48.631 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-08-25T04:29:48.655 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-25T04:29:48.668 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-25T04:29:48.685 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-25T04:29:48.686 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2023-08-25T04:29:48.690 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2023-08-25T04:29:48.709 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-25T04:29:48.719 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-25T04:29:48.720 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2023-08-25T04:29:48.749 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2023-08-25T04:29:48.779 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-25T04:29:48.839 INFO:teuthology.run_tasks:Running task kernel... 2023-08-25T04:29:48.860 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'} 2023-08-25T04:29:48.862 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-08-25T04:29:48.862 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-08-25T04:29:48.863 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-25T04:29:48.864 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-25T04:29:48.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:29:48.883 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2023-08-25T04:29:48.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:29:48.885 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2023-08-25T04:29:48.942 INFO:teuthology.orchestra.run.smithi117.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-25T04:29:48.943 INFO:teuthology.task.kernel:Running kernel on smithi117: 4.18.0-372.9.1.el8.x86_64 2023-08-25T04:29:48.943 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum install -y kernel 2023-08-25T04:29:48.946 INFO:teuthology.orchestra.run.smithi016.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-25T04:29:48.946 INFO:teuthology.task.kernel:Running kernel on smithi016: 4.18.0-372.9.1.el8.x86_64 2023-08-25T04:29:48.946 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum install -y kernel 2023-08-25T04:29:50.139 INFO:teuthology.orchestra.run.smithi016.stdout:Updating Subscription Management repositories. 2023-08-25T04:29:50.140 INFO:teuthology.orchestra.run.smithi016.stdout:Unable to read consumer identity 2023-08-25T04:29:50.182 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2023-08-25T04:29:50.184 INFO:teuthology.orchestra.run.smithi117.stdout:Unable to read consumer identity 2023-08-25T04:29:51.550 INFO:teuthology.orchestra.run.smithi016.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-08-25T04:29:51.647 INFO:teuthology.orchestra.run.smithi117.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-08-25T04:29:52.502 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-08-25T04:29:52.664 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-08-25T04:29:56.098 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 531 kB/s | 24 kB 00:00 2023-08-25T04:29:56.126 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 413 kB/s | 24 kB 00:00 2023-08-25T04:29:56.775 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-25T04:29:56.829 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2023-08-25T04:29:56.830 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2023-08-25T04:29:56.830 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2023-08-25T04:29:56.862 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-25T04:29:56.919 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2023-08-25T04:29:56.920 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2023-08-25T04:29:56.920 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2023-08-25T04:29:56.938 DEBUG:teuthology.orchestra.run.smithi117:> echo no | sudo yum reinstall kernel || true 2023-08-25T04:29:57.053 DEBUG:teuthology.orchestra.run.smithi016:> echo no | sudo yum reinstall kernel || true 2023-08-25T04:29:57.266 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2023-08-25T04:29:57.267 INFO:teuthology.orchestra.run.smithi117.stdout:Unable to read consumer identity 2023-08-25T04:29:57.449 INFO:teuthology.orchestra.run.smithi016.stdout:Updating Subscription Management repositories. 2023-08-25T04:29:57.449 INFO:teuthology.orchestra.run.smithi016.stdout:Unable to read consumer identity 2023-08-25T04:29:57.531 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:01 ago on Fri 25 Aug 2023 04:29:56 AM UTC. 2023-08-25T04:29:57.572 INFO:teuthology.orchestra.run.smithi117.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-25T04:29:57.611 INFO:teuthology.orchestra.run.smithi117.stderr:Error: No packages marked for reinstall. 2023-08-25T04:29:57.657 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum reinstall -y kernel || true 2023-08-25T04:29:57.730 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:00:01 ago on Fri 25 Aug 2023 04:29:56 AM UTC. 2023-08-25T04:29:57.775 INFO:teuthology.orchestra.run.smithi016.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-25T04:29:57.807 INFO:teuthology.orchestra.run.smithi016.stderr:Error: No packages marked for reinstall. 2023-08-25T04:29:57.855 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum reinstall -y kernel || true 2023-08-25T04:29:57.985 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2023-08-25T04:29:57.986 INFO:teuthology.orchestra.run.smithi117.stdout:Unable to read consumer identity 2023-08-25T04:29:58.204 INFO:teuthology.orchestra.run.smithi016.stdout:Updating Subscription Management repositories. 2023-08-25T04:29:58.205 INFO:teuthology.orchestra.run.smithi016.stdout:Unable to read consumer identity 2023-08-25T04:29:58.244 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:02 ago on Fri 25 Aug 2023 04:29:56 AM UTC. 2023-08-25T04:29:58.283 INFO:teuthology.orchestra.run.smithi117.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-25T04:29:58.305 INFO:teuthology.orchestra.run.smithi117.stderr:Error: No packages marked for reinstall. 2023-08-25T04:29:58.356 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2023-08-25T04:29:58.436 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-25T04:29:58.436 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-25T04:29:58.436 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-25T04:29:58.437 DEBUG:teuthology.parallel:result is None 2023-08-25T04:29:58.478 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:00:02 ago on Fri 25 Aug 2023 04:29:56 AM UTC. 2023-08-25T04:29:58.521 INFO:teuthology.orchestra.run.smithi016.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-25T04:29:58.551 INFO:teuthology.orchestra.run.smithi016.stderr:Error: No packages marked for reinstall. 2023-08-25T04:29:58.601 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q kernel | sort -rV | head -n 1 2023-08-25T04:29:58.684 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-25T04:29:58.684 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-25T04:29:58.684 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-25T04:29:58.685 DEBUG:teuthology.parallel:result is None 2023-08-25T04:29:58.685 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-25T04:29:58.692 INFO:teuthology.task.internal:Creating test directory... 2023-08-25T04:29:58.693 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-25T04:29:58.695 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-25T04:29:58.712 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-25T04:29:58.727 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-25T04:29:58.742 INFO:teuthology.task.internal:Creating archive directory... 2023-08-25T04:29:58.743 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-25T04:29:58.752 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-25T04:29:58.776 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-25T04:29:58.789 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-25T04:29:58.790 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-25T04:29:58.809 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-25T04:29:58.834 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T04:29:58.852 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T04:29:58.854 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T04:29:58.872 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T04:29:58.874 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-25T04:29:58.885 INFO:teuthology.task.internal:Configuring sudo... 2023-08-25T04:29:58.885 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-25T04:29:58.897 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-25T04:29:58.941 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-25T04:29:58.950 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-25T04:29:58.951 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-25T04:29:58.965 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-25T04:29:58.997 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T04:29:59.062 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T04:29:59.120 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T04:29:59.203 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T04:29:59.246 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:29:59.247 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-25T04:29:59.315 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T04:29:59.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T04:29:59.407 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T04:29:59.489 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T04:29:59.533 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:29:59.533 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-25T04:29:59.600 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2023-08-25T04:29:59.602 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2023-08-25T04:29:59.651 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-25T04:29:59.707 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-25T04:30:00.015 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-25T04:30:00.027 INFO:teuthology.task.internal:Starting timer... 2023-08-25T04:30:00.028 INFO:teuthology.run_tasks:Running task pcp... 2023-08-25T04:30:00.039 INFO:teuthology.run_tasks:Running task selinux... 2023-08-25T04:30:00.048 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-08-25T04:30:00.049 DEBUG:teuthology.orchestra.run.smithi016:> sudo service auditd rotate 2023-08-25T04:30:00.109 INFO:teuthology.orchestra.run.smithi016.stdout:Rotating logs: 2023-08-25T04:30:00.111 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2023-08-25T04:30:00.170 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2023-08-25T04:30:00.172 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-25T04:30:00.172 DEBUG:teuthology.orchestra.run.smithi016:> /usr/sbin/getenforce 2023-08-25T04:30:00.202 INFO:teuthology.orchestra.run.smithi016.stdout:Permissive 2023-08-25T04:30:00.203 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2023-08-25T04:30:00.227 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2023-08-25T04:30:00.227 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi016.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive'} 2023-08-25T04:30:00.228 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-25T04:30:00.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:30:00.272 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-25T04:30:00.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:30:00.300 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-25T04:30:00.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo /usr/sbin/setenforce permissive 2023-08-25T04:30:00.344 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2023-08-25T04:30:00.370 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-25T04:30:00.379 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-08-25T04:30:00.380 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-25T04:30:01.377 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-25T04:30:01.407 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-25T04:40:23.942 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2023-08-25T04:40:23.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-08-25T04:40:23.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:40:24.086 DEBUG:teuthology.orchestra.run.smithi016:> true 2023-08-25T04:40:24.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-08-25T04:40:24.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-08-25T04:40:24.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:40:24.227 DEBUG:teuthology.orchestra.run.smithi117:> true 2023-08-25T04:40:24.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-08-25T04:40:24.299 INFO:teuthology.run_tasks:Running task clock... 2023-08-25T04:40:24.323 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-25T04:40:24.324 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-25T04:40:24.325 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-25T04:40:24.328 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-25T04:40:24.328 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-25T04:40:24.364 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-25T04:40:24.372 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-25T04:40:24.381 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-25T04:40:24.387 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-25T04:40:24.468 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: ntpd: command not found 2023-08-25T04:40:24.473 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2023-08-25T04:40:24.482 INFO:teuthology.orchestra.run.smithi016.stdout:506 Cannot talk to daemon 2023-08-25T04:40:24.487 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2023-08-25T04:40:24.498 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-25T04:40:24.500 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-25T04:40:24.513 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-25T04:40:24.514 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-25T04:40:24.577 INFO:teuthology.orchestra.run.smithi117.stderr:bash: ntpq: command not found 2023-08-25T04:40:24.581 INFO:teuthology.orchestra.run.smithi016.stderr:bash: ntpq: command not found 2023-08-25T04:40:24.582 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-25T04:40:24.582 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2023-08-25T04:40:24.582 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:40:24.583 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:40:24.583 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:40:24.583 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:40:24.585 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-25T04:40:24.586 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2023-08-25T04:40:24.586 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:40:24.586 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:40:24.587 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:40:24.587 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:40:24.588 INFO:teuthology.run_tasks:Running task install... 2023-08-25T04:40:24.598 DEBUG:teuthology.task.install:project ceph 2023-08-25T04:40:24.599 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}} 2023-08-25T04:40:24.599 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'} 2023-08-25T04:40:24.600 INFO:teuthology.task.install:Using flavor: default 2023-08-25T04:40:24.609 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-25T04:40:24.610 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-25T04:40:24.610 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56', 'tag': None, 'wait_for_package': False} 2023-08-25T04:40:24.611 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:40:24.613 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56', 'tag': None, 'wait_for_package': False} 2023-08-25T04:40:24.614 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:40:24.842 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/ 2023-08-25T04:40:24.842 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5703.gba6b39e4 2023-08-25T04:40:24.847 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/ 2023-08-25T04:40:24.848 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5703.gba6b39e4 2023-08-25T04:40:25.019 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-25T04:40:25.022 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:40:25.023 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-25T04:40:25.026 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-25T04:40:25.027 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:40:25.028 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-25T04:40:25.057 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-25T04:40:25.057 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ba6b39e4f4f77fb95c747099b53db0467d435f56/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-25T04:40:25.062 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-25T04:40:25.062 DEBUG:teuthology.orchestra.run.smithi016:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ba6b39e4f4f77fb95c747099b53db0467d435f56/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-25T04:40:25.126 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-25T04:40:25.135 DEBUG:teuthology.orchestra.run.smithi016:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-25T04:40:25.210 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-25T04:40:25.217 DEBUG:teuthology.orchestra.run.smithi016:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-25T04:40:25.277 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2023-08-25T04:40:25.279 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2023-08-25T04:40:25.286 INFO:teuthology.orchestra.run.smithi016.stdout:check_obsoletes = 1 2023-08-25T04:40:25.288 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum clean all 2023-08-25T04:40:25.647 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2023-08-25T04:40:25.683 INFO:teuthology.orchestra.run.smithi016.stdout:Updating Subscription Management repositories. 2023-08-25T04:40:25.914 INFO:teuthology.orchestra.run.smithi117.stdout:44 files removed 2023-08-25T04:40:25.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-25T04:40:25.977 INFO:teuthology.orchestra.run.smithi016.stdout:44 files removed 2023-08-25T04:40:26.023 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-25T04:40:26.289 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2023-08-25T04:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout:Updating Subscription Management repositories. 2023-08-25T04:40:26.935 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 332 kB/s | 81 kB 00:00 2023-08-25T04:40:27.126 INFO:teuthology.orchestra.run.smithi016.stdout:ceph packages for x86_64 227 kB/s | 81 kB 00:00 2023-08-25T04:40:27.193 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 41 kB/s | 9.4 kB 00:00 2023-08-25T04:40:27.485 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2023-08-25T04:40:27.520 INFO:teuthology.orchestra.run.smithi016.stdout:ceph noarch packages 26 kB/s | 9.4 kB 00:00 2023-08-25T04:40:27.636 INFO:teuthology.orchestra.run.smithi117.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-08-25T04:40:27.769 INFO:teuthology.orchestra.run.smithi016.stdout:ceph source packages 6.6 kB/s | 1.5 kB 00:00 2023-08-25T04:40:27.911 INFO:teuthology.orchestra.run.smithi016.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-08-25T04:40:28.622 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-08-25T04:40:29.778 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 8.5 MB/s | 16 MB 00:01 2023-08-25T04:40:32.063 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 394 kB/s | 24 kB 00:00 2023-08-25T04:40:32.923 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 MB/s | 47 MB 00:00 2023-08-25T04:40:33.512 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 442 kB/s | 24 kB 00:00 2023-08-25T04:40:34.473 INFO:teuthology.orchestra.run.smithi016.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-08-25T04:40:40.847 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-08-25T04:40:43.315 INFO:teuthology.orchestra.run.smithi016.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-08-25T04:40:52.103 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-25T04:40:52.104 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-25T04:40:52.118 INFO:teuthology.orchestra.run.smithi117.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-25T04:40:52.119 INFO:teuthology.orchestra.run.smithi117.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-25T04:40:52.120 INFO:teuthology.orchestra.run.smithi117.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-25T04:40:52.121 INFO:teuthology.orchestra.run.smithi117.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-25T04:40:52.123 INFO:teuthology.orchestra.run.smithi117.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-25T04:40:52.127 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-25T04:40:52.128 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-25T04:40:52.256 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2023-08-25T04:40:52.268 INFO:teuthology.orchestra.run.smithi117.stdout:=========================================================================================================================== 2023-08-25T04:40:52.269 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2023-08-25T04:40:52.269 INFO:teuthology.orchestra.run.smithi117.stdout:=========================================================================================================================== 2023-08-25T04:40:52.269 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2023-08-25T04:40:52.269 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-25T04:40:52.269 INFO:teuthology.orchestra.run.smithi117.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-25T04:40:52.269 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 6.4 k 2023-08-25T04:40:52.269 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 5.4 M 2023-08-25T04:40:52.270 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 862 k 2023-08-25T04:40:52.270 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 167 k 2023-08-25T04:40:52.270 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 1.6 M 2023-08-25T04:40:52.270 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 132 k 2023-08-25T04:40:52.270 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 1.7 M 2023-08-25T04:40:52.270 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 7.4 M 2023-08-25T04:40:52.270 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 47 k 2023-08-25T04:40:52.271 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 14 M 2023-08-25T04:40:52.271 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 48 M 2023-08-25T04:40:52.271 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 261 k 2023-08-25T04:40:52.271 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 171 k 2023-08-25T04:40:52.272 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 260 k 2023-08-25T04:40:52.272 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 18 k 2023-08-25T04:40:52.272 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-25T04:40:52.272 INFO:teuthology.orchestra.run.smithi117.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-25T04:40:52.273 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-25T04:40:52.273 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 31 k 2023-08-25T04:40:52.273 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 784 k 2023-08-25T04:40:52.273 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 139 k 2023-08-25T04:40:52.273 INFO:teuthology.orchestra.run.smithi117.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-25T04:40:52.273 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-25T04:40:52.274 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-25T04:40:52.274 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-25T04:40:52.274 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-25T04:40:52.274 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-25T04:40:52.274 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 197 k 2023-08-25T04:40:52.274 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 371 k 2023-08-25T04:40:52.274 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 364 k 2023-08-25T04:40:52.275 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 107 k 2023-08-25T04:40:52.275 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 94 k 2023-08-25T04:40:52.275 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 3.5 M 2023-08-25T04:40:52.275 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 179 k 2023-08-25T04:40:52.275 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-25T04:40:52.276 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2023-08-25T04:40:52.276 INFO:teuthology.orchestra.run.smithi117.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-25T04:40:52.276 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 3.7 M 2023-08-25T04:40:52.276 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 3.6 M 2023-08-25T04:40:52.276 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2023-08-25T04:40:52.277 INFO:teuthology.orchestra.run.smithi117.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-25T04:40:52.277 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 22 M 2023-08-25T04:40:52.277 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 23 k 2023-08-25T04:40:52.277 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 2.3 M 2023-08-25T04:40:52.277 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 242 k 2023-08-25T04:40:52.277 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 4.6 M 2023-08-25T04:40:52.277 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 18 M 2023-08-25T04:40:52.278 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 15 k 2023-08-25T04:40:52.278 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 24 k 2023-08-25T04:40:52.278 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-25T04:40:52.278 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-25T04:40:52.278 INFO:teuthology.orchestra.run.smithi117.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-25T04:40:52.278 INFO:teuthology.orchestra.run.smithi117.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-25T04:40:52.278 INFO:teuthology.orchestra.run.smithi117.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-25T04:40:52.279 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 139 k 2023-08-25T04:40:52.279 INFO:teuthology.orchestra.run.smithi117.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-25T04:40:52.279 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-25T04:40:52.279 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-25T04:40:52.279 INFO:teuthology.orchestra.run.smithi117.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-25T04:40:52.279 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-25T04:40:52.279 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-25T04:40:52.279 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 473 k 2023-08-25T04:40:52.280 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-25T04:40:52.280 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 6.8 M 2023-08-25T04:40:52.280 INFO:teuthology.orchestra.run.smithi117.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-25T04:40:52.280 INFO:teuthology.orchestra.run.smithi117.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-25T04:40:52.281 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-25T04:40:52.281 INFO:teuthology.orchestra.run.smithi117.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-25T04:40:52.281 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-25T04:40:52.281 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-25T04:40:52.281 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-25T04:40:52.281 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-25T04:40:52.281 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-25T04:40:52.282 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-25T04:40:52.282 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-25T04:40:52.282 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-25T04:40:52.282 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-25T04:40:52.282 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-25T04:40:52.283 INFO:teuthology.orchestra.run.smithi117.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-25T04:40:52.283 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-25T04:40:52.283 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 45 k 2023-08-25T04:40:52.283 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 126 k 2023-08-25T04:40:52.283 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-25T04:40:52.283 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-25T04:40:52.284 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-25T04:40:52.284 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-25T04:40:52.284 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-25T04:40:52.284 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-25T04:40:52.285 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-25T04:40:52.285 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-25T04:40:52.285 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-25T04:40:52.285 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-25T04:40:52.285 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-25T04:40:52.286 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-25T04:40:52.286 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-25T04:40:52.286 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-25T04:40:52.286 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-25T04:40:52.286 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-25T04:40:52.286 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-25T04:40:52.287 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-25T04:40:52.287 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-25T04:40:52.287 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-25T04:40:52.287 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-25T04:40:52.287 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-25T04:40:52.287 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-25T04:40:52.287 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-25T04:40:52.288 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-25T04:40:52.288 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-25T04:40:52.288 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-25T04:40:52.288 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-25T04:40:52.288 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-25T04:40:52.288 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-25T04:40:52.289 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-25T04:40:52.289 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-25T04:40:52.289 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-25T04:40:52.289 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-25T04:40:52.289 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-25T04:40:52.289 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-25T04:40:52.289 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-25T04:40:52.290 INFO:teuthology.orchestra.run.smithi117.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-25T04:40:52.290 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-25T04:40:52.290 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-25T04:40:52.290 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-25T04:40:52.290 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-25T04:40:52.290 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-25T04:40:52.291 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-25T04:40:52.291 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-25T04:40:52.291 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-25T04:40:52.291 INFO:teuthology.orchestra.run.smithi117.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-25T04:40:52.291 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-25T04:40:52.291 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-25T04:40:52.291 INFO:teuthology.orchestra.run.smithi117.stdout:Enabling module streams: 2023-08-25T04:40:52.292 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql 10 2023-08-25T04:40:52.292 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:40:52.292 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2023-08-25T04:40:52.292 INFO:teuthology.orchestra.run.smithi117.stdout:=========================================================================================================================== 2023-08-25T04:40:52.292 INFO:teuthology.orchestra.run.smithi117.stdout:Install 128 Packages 2023-08-25T04:40:52.292 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 3 Packages 2023-08-25T04:40:52.292 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:40:52.293 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 206 M 2023-08-25T04:40:52.294 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2023-08-25T04:40:52.555 INFO:teuthology.orchestra.run.smithi117.stdout:(1/131): ceph-18.0.0-5703.gba6b39e4.el8.x86_64. 48 kB/s | 6.4 kB 00:00 2023-08-25T04:40:52.764 INFO:teuthology.orchestra.run.smithi117.stdout:(2/131): ceph-fuse-18.0.0-5703.gba6b39e4.el8.x8 4.0 MB/s | 862 kB 00:00 2023-08-25T04:40:52.822 INFO:teuthology.orchestra.run.smithi117.stdout:(3/131): ceph-immutable-object-cache-18.0.0-570 2.8 MB/s | 167 kB 00:00 2023-08-25T04:40:53.197 INFO:teuthology.orchestra.run.smithi117.stdout:(4/131): ceph-mds-18.0.0-5703.gba6b39e4.el8.x86 6.1 MB/s | 2.3 MB 00:00 2023-08-25T04:40:53.506 INFO:teuthology.orchestra.run.smithi117.stdout:(5/131): ceph-mgr-18.0.0-5703.gba6b39e4.el8.x86 5.1 MB/s | 1.6 MB 00:00 2023-08-25T04:40:53.873 INFO:teuthology.orchestra.run.smithi117.stdout:(6/131): ceph-common-18.0.0-5703.gba6b39e4.el8. 15 MB/s | 22 MB 00:01 2023-08-25T04:40:54.157 INFO:teuthology.orchestra.run.smithi117.stdout:(7/131): ceph-mon-18.0.0-5703.gba6b39e4.el8.x86 7.1 MB/s | 4.6 MB 00:00 2023-08-25T04:40:54.423 INFO:teuthology.orchestra.run.smithi117.stdout:(8/131): ceph-base-18.0.0-5703.gba6b39e4.el8.x8 2.7 MB/s | 5.4 MB 00:02 2023-08-25T04:40:54.516 INFO:teuthology.orchestra.run.smithi117.stdout:(9/131): ceph-selinux-18.0.0-5703.gba6b39e4.el8 265 kB/s | 24 kB 00:00 2023-08-25T04:40:54.869 INFO:teuthology.orchestra.run.smithi016.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-25T04:40:54.869 INFO:teuthology.orchestra.run.smithi016.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-25T04:40:54.884 INFO:teuthology.orchestra.run.smithi016.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-25T04:40:54.885 INFO:teuthology.orchestra.run.smithi016.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-25T04:40:54.887 INFO:teuthology.orchestra.run.smithi016.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-25T04:40:54.887 INFO:teuthology.orchestra.run.smithi016.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-25T04:40:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-25T04:40:54.893 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-25T04:40:54.894 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-25T04:40:54.982 INFO:teuthology.orchestra.run.smithi117.stdout:(10/131): ceph-osd-18.0.0-5703.gba6b39e4.el8.x8 16 MB/s | 18 MB 00:01 2023-08-25T04:40:55.033 INFO:teuthology.orchestra.run.smithi117.stdout:(11/131): cephfs-mirror-18.0.0-5703.gba6b39e4.e 5.1 MB/s | 260 kB 00:00 2023-08-25T04:40:55.037 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2023-08-25T04:40:55.050 INFO:teuthology.orchestra.run.smithi016.stdout:=========================================================================================================================== 2023-08-25T04:40:55.050 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2023-08-25T04:40:55.050 INFO:teuthology.orchestra.run.smithi016.stdout:=========================================================================================================================== 2023-08-25T04:40:55.051 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2023-08-25T04:40:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-25T04:40:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-25T04:40:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: ceph x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 6.4 k 2023-08-25T04:40:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 5.4 M 2023-08-25T04:40:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 862 k 2023-08-25T04:40:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 167 k 2023-08-25T04:40:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 1.6 M 2023-08-25T04:40:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 132 k 2023-08-25T04:40:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 1.7 M 2023-08-25T04:40:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 7.4 M 2023-08-25T04:40:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 47 k 2023-08-25T04:40:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 14 M 2023-08-25T04:40:55.053 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 48 M 2023-08-25T04:40:55.053 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 261 k 2023-08-25T04:40:55.053 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 171 k 2023-08-25T04:40:55.053 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 260 k 2023-08-25T04:40:55.054 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-top noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 18 k 2023-08-25T04:40:55.054 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-25T04:40:55.054 INFO:teuthology.orchestra.run.smithi016.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-25T04:40:55.054 INFO:teuthology.orchestra.run.smithi016.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-25T04:40:55.055 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 31 k 2023-08-25T04:40:55.055 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 784 k 2023-08-25T04:40:55.055 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 139 k 2023-08-25T04:40:55.055 INFO:teuthology.orchestra.run.smithi016.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-25T04:40:55.055 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-25T04:40:55.055 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-25T04:40:55.055 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-25T04:40:55.056 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-25T04:40:55.056 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-25T04:40:55.056 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 197 k 2023-08-25T04:40:55.056 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 371 k 2023-08-25T04:40:55.056 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 364 k 2023-08-25T04:40:55.056 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 107 k 2023-08-25T04:40:55.056 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 94 k 2023-08-25T04:40:55.057 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 3.5 M 2023-08-25T04:40:55.057 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 179 k 2023-08-25T04:40:55.057 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-25T04:40:55.057 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrading: 2023-08-25T04:40:55.057 INFO:teuthology.orchestra.run.smithi016.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-25T04:40:55.057 INFO:teuthology.orchestra.run.smithi016.stdout: librados2 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 3.7 M 2023-08-25T04:40:55.057 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 3.6 M 2023-08-25T04:40:55.058 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2023-08-25T04:40:55.058 INFO:teuthology.orchestra.run.smithi016.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-25T04:40:55.058 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 22 M 2023-08-25T04:40:55.058 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 23 k 2023-08-25T04:40:55.058 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 2.3 M 2023-08-25T04:40:55.058 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 242 k 2023-08-25T04:40:55.058 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 4.6 M 2023-08-25T04:40:55.059 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 18 M 2023-08-25T04:40:55.059 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 15 k 2023-08-25T04:40:55.059 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 24 k 2023-08-25T04:40:55.059 INFO:teuthology.orchestra.run.smithi016.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-25T04:40:55.059 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-25T04:40:55.059 INFO:teuthology.orchestra.run.smithi016.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-25T04:40:55.059 INFO:teuthology.orchestra.run.smithi016.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-25T04:40:55.060 INFO:teuthology.orchestra.run.smithi016.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-25T04:40:55.060 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 139 k 2023-08-25T04:40:55.060 INFO:teuthology.orchestra.run.smithi016.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-25T04:40:55.060 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-25T04:40:55.060 INFO:teuthology.orchestra.run.smithi016.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-25T04:40:55.060 INFO:teuthology.orchestra.run.smithi016.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-25T04:40:55.061 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-25T04:40:55.061 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-25T04:40:55.061 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 473 k 2023-08-25T04:40:55.061 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-25T04:40:55.061 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 6.8 M 2023-08-25T04:40:55.061 INFO:teuthology.orchestra.run.smithi016.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-25T04:40:55.061 INFO:teuthology.orchestra.run.smithi016.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-25T04:40:55.061 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-25T04:40:55.062 INFO:teuthology.orchestra.run.smithi016.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-25T04:40:55.062 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-25T04:40:55.062 INFO:teuthology.orchestra.run.smithi016.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-25T04:40:55.062 INFO:teuthology.orchestra.run.smithi016.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-25T04:40:55.062 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-25T04:40:55.062 INFO:teuthology.orchestra.run.smithi016.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-25T04:40:55.062 INFO:teuthology.orchestra.run.smithi016.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-25T04:40:55.063 INFO:teuthology.orchestra.run.smithi016.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-25T04:40:55.063 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-25T04:40:55.063 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-25T04:40:55.063 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-25T04:40:55.063 INFO:teuthology.orchestra.run.smithi016.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-25T04:40:55.063 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-25T04:40:55.063 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 45 k 2023-08-25T04:40:55.063 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 126 k 2023-08-25T04:40:55.064 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-25T04:40:55.064 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-25T04:40:55.064 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-25T04:40:55.065 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-25T04:40:55.065 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-25T04:40:55.065 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-25T04:40:55.065 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-25T04:40:55.065 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-25T04:40:55.065 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-25T04:40:55.065 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-25T04:40:55.066 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-25T04:40:55.066 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-25T04:40:55.066 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-25T04:40:55.066 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-25T04:40:55.066 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-25T04:40:55.066 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-25T04:40:55.067 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-25T04:40:55.067 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-25T04:40:55.067 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-25T04:40:55.067 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-25T04:40:55.067 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-25T04:40:55.067 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-25T04:40:55.067 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-25T04:40:55.067 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-25T04:40:55.068 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-25T04:40:55.068 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-25T04:40:55.068 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-25T04:40:55.068 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-25T04:40:55.068 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-25T04:40:55.068 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-25T04:40:55.068 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-25T04:40:55.069 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-25T04:40:55.069 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-25T04:40:55.069 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-25T04:40:55.069 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-25T04:40:55.069 INFO:teuthology.orchestra.run.smithi016.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-25T04:40:55.069 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-25T04:40:55.070 INFO:teuthology.orchestra.run.smithi016.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-25T04:40:55.070 INFO:teuthology.orchestra.run.smithi016.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-25T04:40:55.070 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-25T04:40:55.070 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-25T04:40:55.070 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-25T04:40:55.070 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-25T04:40:55.070 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-25T04:40:55.071 INFO:teuthology.orchestra.run.smithi016.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-25T04:40:55.071 INFO:teuthology.orchestra.run.smithi016.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-25T04:40:55.071 INFO:teuthology.orchestra.run.smithi016.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-25T04:40:55.071 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-25T04:40:55.071 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-25T04:40:55.071 INFO:teuthology.orchestra.run.smithi016.stdout:Enabling module streams: 2023-08-25T04:40:55.071 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql 10 2023-08-25T04:40:55.072 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:40:55.072 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2023-08-25T04:40:55.072 INFO:teuthology.orchestra.run.smithi016.stdout:=========================================================================================================================== 2023-08-25T04:40:55.072 INFO:teuthology.orchestra.run.smithi016.stdout:Install 128 Packages 2023-08-25T04:40:55.072 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrade 3 Packages 2023-08-25T04:40:55.072 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:40:55.073 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 206 M 2023-08-25T04:40:55.073 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2023-08-25T04:40:55.099 INFO:teuthology.orchestra.run.smithi117.stdout:(12/131): libcephfs-devel-18.0.0-5703.gba6b39e4 467 kB/s | 31 kB 00:00 2023-08-25T04:40:55.216 INFO:teuthology.orchestra.run.smithi117.stdout:(13/131): libcephfs2-18.0.0-5703.gba6b39e4.el8. 6.6 MB/s | 784 kB 00:00 2023-08-25T04:40:55.266 INFO:teuthology.orchestra.run.smithi117.stdout:(14/131): libcephsqlite-18.0.0-5703.gba6b39e4.e 2.7 MB/s | 139 kB 00:00 2023-08-25T04:40:55.334 INFO:teuthology.orchestra.run.smithi117.stdout:(15/131): librados-devel-18.0.0-5703.gba6b39e4. 2.0 MB/s | 139 kB 00:00 2023-08-25T04:40:55.409 INFO:teuthology.orchestra.run.smithi117.stdout:(16/131): libradosstriper1-18.0.0-5703.gba6b39e 6.2 MB/s | 473 kB 00:00 2023-08-25T04:40:55.424 INFO:teuthology.orchestra.run.smithi016.stdout:(1/131): ceph-18.0.0-5703.gba6b39e4.el8.x86_64. 29 kB/s | 6.4 kB 00:00 2023-08-25T04:40:55.715 INFO:teuthology.orchestra.run.smithi117.stdout:(17/131): ceph-radosgw-18.0.0-5703.gba6b39e4.el 8.8 MB/s | 14 MB 00:01 2023-08-25T04:40:55.801 INFO:teuthology.orchestra.run.smithi117.stdout:(18/131): python3-ceph-argparse-18.0.0-5703.gba 488 kB/s | 45 kB 00:00 2023-08-25T04:40:55.885 INFO:teuthology.orchestra.run.smithi117.stdout:(19/131): librgw2-18.0.0-5703.gba6b39e4.el8.x86 14 MB/s | 6.8 MB 00:00 2023-08-25T04:40:55.910 INFO:teuthology.orchestra.run.smithi117.stdout:(20/131): python3-ceph-common-18.0.0-5703.gba6b 1.1 MB/s | 126 kB 00:00 2023-08-25T04:40:55.935 INFO:teuthology.orchestra.run.smithi117.stdout:(21/131): python3-cephfs-18.0.0-5703.gba6b39e4. 3.8 MB/s | 197 kB 00:00 2023-08-25T04:40:55.960 INFO:teuthology.orchestra.run.smithi117.stdout:(22/131): python3-rados-18.0.0-5703.gba6b39e4.e 7.2 MB/s | 371 kB 00:00 2023-08-25T04:40:55.994 INFO:teuthology.orchestra.run.smithi117.stdout:(23/131): python3-rbd-18.0.0-5703.gba6b39e4.el8 6.1 MB/s | 364 kB 00:00 2023-08-25T04:40:56.019 INFO:teuthology.orchestra.run.smithi117.stdout:(24/131): python3-rgw-18.0.0-5703.gba6b39e4.el8 1.8 MB/s | 107 kB 00:00 2023-08-25T04:40:56.024 INFO:teuthology.orchestra.run.smithi016.stdout:(2/131): ceph-fuse-18.0.0-5703.gba6b39e4.el8.x8 1.4 MB/s | 862 kB 00:00 2023-08-25T04:40:56.044 INFO:teuthology.orchestra.run.smithi117.stdout:(25/131): rbd-fuse-18.0.0-5703.gba6b39e4.el8.x8 1.8 MB/s | 94 kB 00:00 2023-08-25T04:40:56.149 INFO:teuthology.orchestra.run.smithi016.stdout:(3/131): ceph-immutable-object-cache-18.0.0-570 1.3 MB/s | 167 kB 00:00 2023-08-25T04:40:56.153 INFO:teuthology.orchestra.run.smithi117.stdout:(26/131): rbd-nbd-18.0.0-5703.gba6b39e4.el8.x86 1.6 MB/s | 179 kB 00:00 2023-08-25T04:40:56.212 INFO:teuthology.orchestra.run.smithi117.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5703.g 397 kB/s | 23 kB 00:00 2023-08-25T04:40:56.279 INFO:teuthology.orchestra.run.smithi117.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5703.gba6b39e 1.9 MB/s | 132 kB 00:00 2023-08-25T04:40:56.371 INFO:teuthology.orchestra.run.smithi117.stdout:(29/131): rbd-mirror-18.0.0-5703.gba6b39e4.el8. 10 MB/s | 3.5 MB 00:00 2023-08-25T04:40:56.413 INFO:teuthology.orchestra.run.smithi117.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5703.gba6b3 13 MB/s | 1.7 MB 00:00 2023-08-25T04:40:56.480 INFO:teuthology.orchestra.run.smithi117.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5703.gba 3.6 MB/s | 242 kB 00:00 2023-08-25T04:40:56.547 INFO:teuthology.orchestra.run.smithi117.stdout:(32/131): ceph-mgr-rook-18.0.0-5703.gba6b39e4.e 712 kB/s | 47 kB 00:00 2023-08-25T04:40:56.622 INFO:teuthology.orchestra.run.smithi117.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5703.gb 193 kB/s | 15 kB 00:00 2023-08-25T04:40:56.706 INFO:teuthology.orchestra.run.smithi117.stdout:(34/131): ceph-volume-18.0.0-5703.gba6b39e4.el8 3.1 MB/s | 261 kB 00:00 2023-08-25T04:40:56.781 INFO:teuthology.orchestra.run.smithi117.stdout:(35/131): cephadm-18.0.0-5703.gba6b39e4.el8.noa 2.2 MB/s | 171 kB 00:00 2023-08-25T04:40:56.848 INFO:teuthology.orchestra.run.smithi117.stdout:(36/131): cephfs-top-18.0.0-5703.gba6b39e4.el8. 270 kB/s | 18 kB 00:00 2023-08-25T04:40:56.967 INFO:teuthology.orchestra.run.smithi016.stdout:(4/131): ceph-mds-18.0.0-5703.gba6b39e4.el8.x86 2.8 MB/s | 2.3 MB 00:00 2023-08-25T04:40:57.115 INFO:teuthology.orchestra.run.smithi117.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 9.9 MB/s | 7.4 MB 00:00 2023-08-25T04:40:57.291 INFO:teuthology.orchestra.run.smithi016.stdout:(5/131): ceph-base-18.0.0-5703.gba6b39e4.el8.x8 2.6 MB/s | 5.4 MB 00:02 2023-08-25T04:40:57.324 INFO:teuthology.orchestra.run.smithi117.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 644 kB/s | 306 kB 00:00 2023-08-25T04:40:57.333 INFO:teuthology.orchestra.run.smithi016.stdout:(6/131): ceph-mgr-18.0.0-5703.gba6b39e4.el8.x86 4.3 MB/s | 1.6 MB 00:00 2023-08-25T04:40:57.449 INFO:teuthology.orchestra.run.smithi117.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 601 kB/s | 75 kB 00:00 2023-08-25T04:40:57.524 INFO:teuthology.orchestra.run.smithi117.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 144 kB/s | 59 kB 00:00 2023-08-25T04:40:57.641 INFO:teuthology.orchestra.run.smithi117.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-08-25T04:40:57.667 INFO:teuthology.orchestra.run.smithi117.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-08-25T04:40:57.783 INFO:teuthology.orchestra.run.smithi117.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 283 kB/s | 33 kB 00:00 2023-08-25T04:40:57.892 INFO:teuthology.orchestra.run.smithi117.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-08-25T04:40:57.992 INFO:teuthology.orchestra.run.smithi117.stdout:(45/131): python3-beautifulsoup4-4.6.3-2.el8.1. 528 kB/s | 185 kB 00:00 2023-08-25T04:40:58.018 INFO:teuthology.orchestra.run.smithi117.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-08-25T04:40:58.118 INFO:teuthology.orchestra.run.smithi117.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 813 kB/s | 81 kB 00:00 2023-08-25T04:40:58.218 INFO:teuthology.orchestra.run.smithi117.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-08-25T04:40:58.299 INFO:teuthology.orchestra.run.smithi016.stdout:(7/131): ceph-mon-18.0.0-5703.gba6b39e4.el8.x86 4.6 MB/s | 4.6 MB 00:01 2023-08-25T04:40:58.318 INFO:teuthology.orchestra.run.smithi117.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 176 kB/s | 18 kB 00:00 2023-08-25T04:40:58.477 INFO:teuthology.orchestra.run.smithi117.stdout:(50/131): python3-cherrypy-18.4.0-1.el8.noarch. 794 kB/s | 384 kB 00:00 2023-08-25T04:40:58.585 INFO:teuthology.orchestra.run.smithi117.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 451 kB/s | 49 kB 00:00 2023-08-25T04:40:58.678 INFO:teuthology.orchestra.run.smithi117.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 3.2 MB/s | 1.2 MB 00:00 2023-08-25T04:40:58.703 INFO:teuthology.orchestra.run.smithi117.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 502 kB/s | 59 kB 00:00 2023-08-25T04:40:58.778 INFO:teuthology.orchestra.run.smithi117.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 601 kB/s | 60 kB 00:00 2023-08-25T04:40:58.817 INFO:teuthology.orchestra.run.smithi016.stdout:(8/131): ceph-common-18.0.0-5703.gba6b39e4.el8. 6.2 MB/s | 22 MB 00:03 2023-08-25T04:40:58.867 INFO:teuthology.orchestra.run.smithi016.stdout:(9/131): ceph-selinux-18.0.0-5703.gba6b39e4.el8 489 kB/s | 24 kB 00:00 2023-08-25T04:40:58.878 INFO:teuthology.orchestra.run.smithi117.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2023-08-25T04:40:58.979 INFO:teuthology.orchestra.run.smithi117.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 336 kB/s | 34 kB 00:00 2023-08-25T04:40:59.054 INFO:teuthology.orchestra.run.smithi117.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 806 kB/s | 283 kB 00:00 2023-08-25T04:40:59.088 INFO:teuthology.orchestra.run.smithi117.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-08-25T04:40:59.163 INFO:teuthology.orchestra.run.smithi117.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 593 kB/s | 64 kB 00:00 2023-08-25T04:40:59.180 INFO:teuthology.orchestra.run.smithi117.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 203 kB/s | 19 kB 00:00 2023-08-25T04:40:59.255 INFO:teuthology.orchestra.run.smithi117.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 259 kB/s | 24 kB 00:00 2023-08-25T04:40:59.272 INFO:teuthology.orchestra.run.smithi117.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 318 kB/s | 29 kB 00:00 2023-08-25T04:40:59.348 INFO:teuthology.orchestra.run.smithi117.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 300 kB/s | 27 kB 00:00 2023-08-25T04:40:59.373 INFO:teuthology.orchestra.run.smithi117.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-08-25T04:40:59.473 INFO:teuthology.orchestra.run.smithi117.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 612 kB/s | 61 kB 00:00 2023-08-25T04:40:59.582 INFO:teuthology.orchestra.run.smithi117.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 789 kB/s | 85 kB 00:00 2023-08-25T04:40:59.607 INFO:teuthology.orchestra.run.smithi117.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 970 kB/s | 251 kB 00:00 2023-08-25T04:40:59.682 INFO:teuthology.orchestra.run.smithi117.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2023-08-25T04:40:59.708 INFO:teuthology.orchestra.run.smithi117.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-08-25T04:41:00.091 INFO:teuthology.orchestra.run.smithi117.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 36 MB/s | 14 MB 00:00 2023-08-25T04:41:00.216 INFO:teuthology.orchestra.run.smithi117.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 884 kB/s | 110 kB 00:00 2023-08-25T04:41:00.383 INFO:teuthology.orchestra.run.smithi117.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 325 kB/s | 54 kB 00:00 2023-08-25T04:41:00.483 INFO:teuthology.orchestra.run.smithi117.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2023-08-25T04:41:00.634 INFO:teuthology.orchestra.run.smithi117.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.1 MB/s | 323 kB 00:00 2023-08-25T04:41:00.676 INFO:teuthology.orchestra.run.smithi117.stdout:(75/131): thrift-0.13.0-2.el8.x86_64.rpm 1.6 MB/s | 1.7 MB 00:01 2023-08-25T04:41:00.734 INFO:teuthology.orchestra.run.smithi117.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 388 kB/s | 39 kB 00:00 2023-08-25T04:41:00.835 INFO:teuthology.orchestra.run.smithi117.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 5.2 MB/s | 538 kB 00:00 2023-08-25T04:41:00.869 INFO:teuthology.orchestra.run.smithi117.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 3.5 MB/s | 688 kB 00:00 2023-08-25T04:41:00.962 INFO:teuthology.orchestra.run.smithi117.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2023-08-25T04:41:00.994 INFO:teuthology.orchestra.run.smithi117.stdout:(80/131): python3-mako-1.0.6-13.el8.noarch.rpm 988 kB/s | 157 kB 00:00 2023-08-25T04:41:01.028 INFO:teuthology.orchestra.run.smithi117.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 11 MB/s | 713 kB 00:00 2023-08-25T04:41:01.078 INFO:teuthology.orchestra.run.smithi117.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 534 kB/s | 27 kB 00:00 2023-08-25T04:41:01.128 INFO:teuthology.orchestra.run.smithi117.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-08-25T04:41:01.209 INFO:teuthology.orchestra.run.smithi117.stdout:(84/131): python3-babel-2.5.1-7.el8.noarch.rpm 22 MB/s | 4.8 MB 00:00 2023-08-25T04:41:01.393 INFO:teuthology.orchestra.run.smithi117.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 166 kB/s | 44 kB 00:00 2023-08-25T04:41:01.504 INFO:teuthology.orchestra.run.smithi117.stdout:(86/131): python3-numpy-1.14.3-10.el8.x86_64.rp 13 MB/s | 3.7 MB 00:00 2023-08-25T04:41:01.555 INFO:teuthology.orchestra.run.smithi117.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 2.8 MB/s | 457 kB 00:00 2023-08-25T04:41:01.647 INFO:teuthology.orchestra.run.smithi117.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2023-08-25T04:41:01.672 INFO:teuthology.orchestra.run.smithi117.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 547 kB/s | 64 kB 00:00 2023-08-25T04:41:01.722 INFO:teuthology.orchestra.run.smithi117.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.6 MB/s | 126 kB 00:00 2023-08-25T04:41:01.773 INFO:teuthology.orchestra.run.smithi117.stdout:(91/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-08-25T04:41:01.798 INFO:teuthology.orchestra.run.smithi117.stdout:(92/131): python3-jsonpointer-1.10-11.el8.noarc 159 kB/s | 20 kB 00:00 2023-08-25T04:41:01.907 INFO:teuthology.orchestra.run.smithi117.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 5.2 MB/s | 709 kB 00:00 2023-08-25T04:41:02.059 INFO:teuthology.orchestra.run.smithi016.stdout:(10/131): ceph-test-18.0.0-5703.gba6b39e4.el8.x 15 MB/s | 48 MB 00:03 2023-08-25T04:41:02.117 INFO:teuthology.orchestra.run.smithi117.stdout:(94/131): openblas-threads-0.3.15-3.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2023-08-25T04:41:02.149 INFO:teuthology.orchestra.run.smithi117.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 818 kB/s | 198 kB 00:00 2023-08-25T04:41:02.209 INFO:teuthology.orchestra.run.smithi016.stdout:(11/131): ceph-radosgw-18.0.0-5703.gba6b39e4.el 3.5 MB/s | 14 MB 00:03 2023-08-25T04:41:02.235 INFO:teuthology.orchestra.run.smithi016.stdout:(12/131): cephfs-mirror-18.0.0-5703.gba6b39e4.e 1.5 MB/s | 260 kB 00:00 2023-08-25T04:41:02.349 INFO:teuthology.orchestra.run.smithi117.stdout:(96/131): openblas-0.3.15-3.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-08-25T04:41:02.374 INFO:teuthology.orchestra.run.smithi117.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 897 kB/s | 202 kB 00:00 2023-08-25T04:41:02.418 INFO:teuthology.orchestra.run.smithi016.stdout:(13/131): ceph-osd-18.0.0-5703.gba6b39e4.el8.x8 3.5 MB/s | 18 MB 00:05 2023-08-25T04:41:02.469 INFO:teuthology.orchestra.run.smithi016.stdout:(14/131): libcephfs-devel-18.0.0-5703.gba6b39e4 120 kB/s | 31 kB 00:00 2023-08-25T04:41:02.483 INFO:teuthology.orchestra.run.smithi117.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.6 MB/s | 354 kB 00:00 2023-08-25T04:41:02.502 INFO:teuthology.orchestra.run.smithi016.stdout:(15/131): libcephfs2-18.0.0-5703.gba6b39e4.el8. 2.9 MB/s | 784 kB 00:00 2023-08-25T04:41:02.527 INFO:teuthology.orchestra.run.smithi016.stdout:(16/131): libcephsqlite-18.0.0-5703.gba6b39e4.e 1.3 MB/s | 139 kB 00:00 2023-08-25T04:41:02.613 INFO:teuthology.orchestra.run.smithi016.stdout:(17/131): libradosstriper1-18.0.0-5703.gba6b39e 4.3 MB/s | 473 kB 00:00 2023-08-25T04:41:02.616 INFO:teuthology.orchestra.run.smithi117.stdout:(99/131): postgresql-server-10.21-2.module+el8. 21 MB/s | 5.1 MB 00:00 2023-08-25T04:41:02.636 INFO:teuthology.orchestra.run.smithi016.stdout:(18/131): librados-devel-18.0.0-5703.gba6b39e4. 830 kB/s | 139 kB 00:00 2023-08-25T04:41:02.659 INFO:teuthology.orchestra.run.smithi117.stdout:(100/131): postgresql-contrib-10.21-2.module+el 4.5 MB/s | 808 kB 00:00 2023-08-25T04:41:02.695 INFO:teuthology.orchestra.run.smithi016.stdout:(19/131): python3-ceph-argparse-18.0.0-5703.gba 535 kB/s | 45 kB 00:00 2023-08-25T04:41:02.729 INFO:teuthology.orchestra.run.smithi016.stdout:(20/131): python3-ceph-common-18.0.0-5703.gba6b 1.3 MB/s | 126 kB 00:00 2023-08-25T04:41:02.759 INFO:teuthology.orchestra.run.smithi117.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-08-25T04:41:02.784 INFO:teuthology.orchestra.run.smithi117.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 374 kB/s | 47 kB 00:00 2023-08-25T04:41:02.804 INFO:teuthology.orchestra.run.smithi016.stdout:(21/131): python3-cephfs-18.0.0-5703.gba6b39e4. 1.8 MB/s | 197 kB 00:00 2023-08-25T04:41:02.876 INFO:teuthology.orchestra.run.smithi117.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.7 MB/s | 200 kB 00:00 2023-08-25T04:41:02.943 INFO:teuthology.orchestra.run.smithi117.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 268 kB/s | 43 kB 00:00 2023-08-25T04:41:02.962 INFO:teuthology.orchestra.run.smithi016.stdout:(22/131): librgw2-18.0.0-5703.gba6b39e4.el8.x86 16 MB/s | 6.8 MB 00:00 2023-08-25T04:41:02.988 INFO:teuthology.orchestra.run.smithi016.stdout:(23/131): python3-rados-18.0.0-5703.gba6b39e4.e 1.4 MB/s | 371 kB 00:00 2023-08-25T04:41:03.013 INFO:teuthology.orchestra.run.smithi016.stdout:(24/131): python3-rbd-18.0.0-5703.gba6b39e4.el8 1.7 MB/s | 364 kB 00:00 2023-08-25T04:41:03.018 INFO:teuthology.orchestra.run.smithi117.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-08-25T04:41:03.038 INFO:teuthology.orchestra.run.smithi016.stdout:(25/131): python3-rgw-18.0.0-5703.gba6b39e4.el8 1.4 MB/s | 107 kB 00:00 2023-08-25T04:41:03.065 INFO:teuthology.orchestra.run.smithi016.stdout:(26/131): rbd-fuse-18.0.0-5703.gba6b39e4.el8.x8 1.2 MB/s | 94 kB 00:00 2023-08-25T04:41:03.097 INFO:teuthology.orchestra.run.smithi016.stdout:(27/131): rbd-nbd-18.0.0-5703.gba6b39e4.el8.x86 3.0 MB/s | 179 kB 00:00 2023-08-25T04:41:03.124 INFO:teuthology.orchestra.run.smithi016.stdout:(28/131): ceph-grafana-dashboards-18.0.0-5703.g 395 kB/s | 23 kB 00:00 2023-08-25T04:41:03.144 INFO:teuthology.orchestra.run.smithi117.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 240 kB/s | 48 kB 00:00 2023-08-25T04:41:03.164 INFO:teuthology.orchestra.run.smithi016.stdout:(29/131): ceph-mgr-cephadm-18.0.0-5703.gba6b39e 1.9 MB/s | 132 kB 00:00 2023-08-25T04:41:03.177 INFO:teuthology.orchestra.run.smithi117.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 549 kB/s | 87 kB 00:00 2023-08-25T04:41:03.586 INFO:teuthology.orchestra.run.smithi117.stdout:(108/131): ceph-test-18.0.0-5703.gba6b39e4.el8. 5.3 MB/s | 48 MB 00:09 2023-08-25T04:41:03.611 INFO:teuthology.orchestra.run.smithi117.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 91 kB/s | 43 kB 00:00 2023-08-25T04:41:03.623 INFO:teuthology.orchestra.run.smithi016.stdout:(30/131): ceph-mgr-diskprediction-local-18.0.0- 16 MB/s | 7.4 MB 00:00 2023-08-25T04:41:03.645 INFO:teuthology.orchestra.run.smithi117.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 234 kB/s | 109 kB 00:00 2023-08-25T04:41:03.657 INFO:teuthology.orchestra.run.smithi016.stdout:(31/131): ceph-mgr-dashboard-18.0.0-5703.gba6b3 3.3 MB/s | 1.7 MB 00:00 2023-08-25T04:41:03.690 INFO:teuthology.orchestra.run.smithi016.stdout:(32/131): ceph-mgr-modules-core-18.0.0-5703.gba 3.5 MB/s | 242 kB 00:00 2023-08-25T04:41:03.716 INFO:teuthology.orchestra.run.smithi016.stdout:(33/131): ceph-mgr-rook-18.0.0-5703.gba6b39e4.e 808 kB/s | 47 kB 00:00 2023-08-25T04:41:03.745 INFO:teuthology.orchestra.run.smithi117.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.4 MB/s | 229 kB 00:00 2023-08-25T04:41:03.749 INFO:teuthology.orchestra.run.smithi016.stdout:(34/131): ceph-prometheus-alerts-18.0.0-5703.gb 248 kB/s | 15 kB 00:00 2023-08-25T04:41:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 149 kB/s | 19 kB 00:00 2023-08-25T04:41:03.783 INFO:teuthology.orchestra.run.smithi016.stdout:(35/131): ceph-volume-18.0.0-5703.gba6b39e4.el8 3.8 MB/s | 261 kB 00:00 2023-08-25T04:41:03.800 INFO:teuthology.orchestra.run.smithi016.stdout:(36/131): cephadm-18.0.0-5703.gba6b39e4.el8.noa 3.3 MB/s | 171 kB 00:00 2023-08-25T04:41:03.804 INFO:teuthology.orchestra.run.smithi117.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.9 MB/s | 560 kB 00:00 2023-08-25T04:41:03.842 INFO:teuthology.orchestra.run.smithi016.stdout:(37/131): cephfs-top-18.0.0-5703.gba6b39e4.el8. 307 kB/s | 18 kB 00:00 2023-08-25T04:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout:(38/131): rbd-mirror-18.0.0-5703.gba6b39e4.el8. 4.0 MB/s | 3.5 MB 00:00 2023-08-25T04:41:03.921 INFO:teuthology.orchestra.run.smithi117.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 3.6 MB/s | 559 kB 00:00 2023-08-25T04:41:03.946 INFO:teuthology.orchestra.run.smithi117.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 126 kB/s | 18 kB 00:00 2023-08-25T04:41:03.971 INFO:teuthology.orchestra.run.smithi117.stdout:(116/131): python3-oauthlib-2.1.0-1.el8.noarch. 685 kB/s | 155 kB 00:00 2023-08-25T04:41:04.071 INFO:teuthology.orchestra.run.smithi117.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.9 MB/s | 238 kB 00:00 2023-08-25T04:41:04.105 INFO:teuthology.orchestra.run.smithi117.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.2 MB/s | 605 kB 00:00 2023-08-25T04:41:04.172 INFO:teuthology.orchestra.run.smithi117.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 12 MB/s | 2.3 MB 00:00 2023-08-25T04:41:04.206 INFO:teuthology.orchestra.run.smithi117.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 825 kB/s | 83 kB 00:00 2023-08-25T04:41:04.231 INFO:teuthology.orchestra.run.smithi117.stdout:(121/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 454 kB/s | 72 kB 00:00 2023-08-25T04:41:04.306 INFO:teuthology.orchestra.run.smithi117.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 447 kB/s | 60 kB 00:00 2023-08-25T04:41:04.356 INFO:teuthology.orchestra.run.smithi117.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 653 kB/s | 98 kB 00:00 2023-08-25T04:41:04.382 INFO:teuthology.orchestra.run.smithi117.stdout:(124/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 383 kB/s | 58 kB 00:00 2023-08-25T04:41:04.384 INFO:teuthology.orchestra.run.smithi016.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 108 kB/s | 59 kB 00:00 2023-08-25T04:41:04.443 INFO:teuthology.orchestra.run.smithi016.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 138 kB/s | 75 kB 00:00 2023-08-25T04:41:04.499 INFO:teuthology.orchestra.run.smithi117.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.4 MB/s | 644 kB 00:00 2023-08-25T04:41:04.524 INFO:teuthology.orchestra.run.smithi117.stdout:(126/131): libcom_err-devel-1.45.6-4.el8.x86_64 177 kB/s | 39 kB 00:00 2023-08-25T04:41:04.558 INFO:teuthology.orchestra.run.smithi117.stdout:(127/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 976 kB/s | 171 kB 00:00 2023-08-25T04:41:04.559 INFO:teuthology.orchestra.run.smithi016.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 403 kB/s | 306 kB 00:00 2023-08-25T04:41:04.601 INFO:teuthology.orchestra.run.smithi016.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 275 kB/s | 44 kB 00:00 2023-08-25T04:41:04.608 INFO:teuthology.orchestra.run.smithi117.stdout:(128/131): NetworkManager-initscripts-updown-1. 1.2 MB/s | 138 kB 00:00 2023-08-25T04:41:04.727 INFO:teuthology.orchestra.run.smithi016.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2023-08-25T04:41:04.752 INFO:teuthology.orchestra.run.smithi016.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 219 kB/s | 33 kB 00:00 2023-08-25T04:41:04.800 INFO:teuthology.orchestra.run.smithi117.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 4.1 MB/s | 798 kB 00:00 2023-08-25T04:41:04.802 INFO:teuthology.orchestra.run.smithi016.stdout:(45/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.1 MB/s | 476 kB 00:00 2023-08-25T04:41:04.853 INFO:teuthology.orchestra.run.smithi016.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2023-08-25T04:41:04.875 INFO:teuthology.orchestra.run.smithi117.stdout:(130/131): librados2-18.0.0-5703.gba6b39e4.el8. 11 MB/s | 3.7 MB 00:00 2023-08-25T04:41:04.978 INFO:teuthology.orchestra.run.smithi016.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.1 MB/s | 384 kB 00:00 2023-08-25T04:41:05.003 INFO:teuthology.orchestra.run.smithi016.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 540 kB/s | 81 kB 00:00 2023-08-25T04:41:05.029 INFO:teuthology.orchestra.run.smithi016.stdout:(49/131): python3-cheroot-8.5.2-1.el8.noarch.rp 625 kB/s | 173 kB 00:00 2023-08-25T04:41:05.087 INFO:teuthology.orchestra.run.smithi016.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-08-25T04:41:05.121 INFO:teuthology.orchestra.run.smithi016.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 150 kB/s | 18 kB 00:00 2023-08-25T04:41:05.167 INFO:teuthology.orchestra.run.smithi117.stdout:(131/131): librbd1-18.0.0-5703.gba6b39e4.el8.x8 6.0 MB/s | 3.6 MB 00:00 2023-08-25T04:41:05.170 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2023-08-25T04:41:05.170 INFO:teuthology.orchestra.run.smithi117.stdout:Total 16 MB/s | 206 MB 00:12 2023-08-25T04:41:05.205 INFO:teuthology.orchestra.run.smithi016.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 416 kB/s | 49 kB 00:00 2023-08-25T04:41:05.246 INFO:teuthology.orchestra.run.smithi016.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 469 kB/s | 59 kB 00:00 2023-08-25T04:41:05.322 INFO:teuthology.orchestra.run.smithi016.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 516 kB/s | 60 kB 00:00 2023-08-25T04:41:05.430 INFO:teuthology.orchestra.run.smithi016.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 2.9 MB/s | 1.2 MB 00:00 2023-08-25T04:41:05.447 INFO:teuthology.orchestra.run.smithi016.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 124 kB/s | 16 kB 00:00 2023-08-25T04:41:05.473 INFO:teuthology.orchestra.run.smithi016.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.2 MB/s | 283 kB 00:00 2023-08-25T04:41:05.548 INFO:teuthology.orchestra.run.smithi016.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 287 kB/s | 34 kB 00:00 2023-08-25T04:41:05.573 INFO:teuthology.orchestra.run.smithi016.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-08-25T04:41:05.607 INFO:teuthology.orchestra.run.smithi016.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 480 kB/s | 64 kB 00:00 2023-08-25T04:41:05.665 INFO:teuthology.orchestra.run.smithi016.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 160 kB/s | 19 kB 00:00 2023-08-25T04:41:05.682 INFO:teuthology.orchestra.run.smithi016.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 220 kB/s | 24 kB 00:00 2023-08-25T04:41:05.733 INFO:teuthology.orchestra.run.smithi016.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 233 kB/s | 29 kB 00:00 2023-08-25T04:41:05.800 INFO:teuthology.orchestra.run.smithi016.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 206 kB/s | 27 kB 00:00 2023-08-25T04:41:05.833 INFO:teuthology.orchestra.run.smithi016.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.7 MB/s | 255 kB 00:00 2023-08-25T04:41:05.908 INFO:teuthology.orchestra.run.smithi016.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.4 MB/s | 251 kB 00:00 2023-08-25T04:41:05.934 INFO:teuthology.orchestra.run.smithi016.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 457 kB/s | 61 kB 00:00 2023-08-25T04:41:05.959 INFO:teuthology.orchestra.run.smithi016.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 681 kB/s | 85 kB 00:00 2023-08-25T04:41:05.984 INFO:teuthology.orchestra.run.smithi016.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-08-25T04:41:06.005 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2023-08-25T04:41:06.034 INFO:teuthology.orchestra.run.smithi016.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 182 kB/s | 23 kB 00:00 2023-08-25T04:41:06.126 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2023-08-25T04:41:06.126 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2023-08-25T04:41:06.160 INFO:teuthology.orchestra.run.smithi016.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 267 kB/s | 47 kB 00:00 2023-08-25T04:41:06.218 INFO:teuthology.orchestra.run.smithi016.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 733 kB/s | 43 kB 00:00 2023-08-25T04:41:06.252 INFO:teuthology.orchestra.run.smithi016.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 921 kB/s | 200 kB 00:00 2023-08-25T04:41:06.294 INFO:teuthology.orchestra.run.smithi016.stdout:(74/131): thrift-0.13.0-2.el8.x86_64.rpm 4.8 MB/s | 1.7 MB 00:00 2023-08-25T04:41:06.319 INFO:teuthology.orchestra.run.smithi016.stdout:(75/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.1 MB/s | 220 kB 00:00 2023-08-25T04:41:06.344 INFO:teuthology.orchestra.run.smithi016.stdout:(76/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 522 kB/s | 48 kB 00:00 2023-08-25T04:41:06.428 INFO:teuthology.orchestra.run.smithi016.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 393 kB/s | 43 kB 00:00 2023-08-25T04:41:06.487 INFO:teuthology.orchestra.run.smithi016.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 817 kB/s | 109 kB 00:00 2023-08-25T04:41:06.512 INFO:teuthology.orchestra.run.smithi016.stdout:(79/131): libsepol-devel-2.9-3.el8.x86_64.rpm 400 kB/s | 87 kB 00:00 2023-08-25T04:41:06.554 INFO:teuthology.orchestra.run.smithi016.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2023-08-25T04:41:06.611 INFO:teuthology.orchestra.run.smithi016.stdout:(81/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.4 MB/s | 560 kB 00:00 2023-08-25T04:41:06.638 INFO:teuthology.orchestra.run.smithi016.stdout:(82/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 149 kB/s | 19 kB 00:00 2023-08-25T04:41:06.655 INFO:teuthology.orchestra.run.smithi016.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2023-08-25T04:41:06.688 INFO:teuthology.orchestra.run.smithi016.stdout:(84/131): python3-cryptography-3.2.1-5.el8.x86_ 7.1 MB/s | 559 kB 00:00 2023-08-25T04:41:06.772 INFO:teuthology.orchestra.run.smithi016.stdout:(85/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 134 kB/s | 18 kB 00:00 2023-08-25T04:41:06.797 INFO:teuthology.orchestra.run.smithi016.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.1 MB/s | 238 kB 00:00 2023-08-25T04:41:06.831 INFO:teuthology.orchestra.run.smithi016.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.4 MB/s | 605 kB 00:00 2023-08-25T04:41:06.931 INFO:teuthology.orchestra.run.smithi016.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 540 kB/s | 72 kB 00:00 2023-08-25T04:41:06.990 INFO:teuthology.orchestra.run.smithi016.stdout:(89/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 11 MB/s | 2.3 MB 00:00 2023-08-25T04:41:07.015 INFO:teuthology.orchestra.run.smithi016.stdout:(90/131): fuse-2.9.7-15.el8.x86_64.rpm 450 kB/s | 83 kB 00:00 2023-08-25T04:41:07.041 INFO:teuthology.orchestra.run.smithi016.stdout:(91/131): elfutils-libelf-devel-0.186-1.el8.x86 550 kB/s | 60 kB 00:00 2023-08-25T04:41:07.099 INFO:teuthology.orchestra.run.smithi016.stdout:(92/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 901 kB/s | 98 kB 00:00 2023-08-25T04:41:07.124 INFO:teuthology.orchestra.run.smithi016.stdout:(93/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 531 kB/s | 58 kB 00:00 2023-08-25T04:41:07.217 INFO:teuthology.orchestra.run.smithi016.stdout:(94/131): libcom_err-devel-1.45.6-4.el8.x86_64. 220 kB/s | 39 kB 00:00 2023-08-25T04:41:07.225 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2023-08-25T04:41:07.229 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2023-08-25T04:41:07.350 INFO:teuthology.orchestra.run.smithi016.stdout:(95/131): NetworkManager-initscripts-updown-1.3 1.0 MB/s | 138 kB 00:00 2023-08-25T04:41:07.384 INFO:teuthology.orchestra.run.smithi016.stdout:(96/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 2.2 MB/s | 644 kB 00:00 2023-08-25T04:41:07.448 INFO:teuthology.orchestra.run.smithi016.stdout:(97/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 530 kB/s | 171 kB 00:00 2023-08-25T04:41:07.501 INFO:teuthology.orchestra.run.smithi016.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 942 kB/s | 110 kB 00:00 2023-08-25T04:41:07.568 INFO:teuthology.orchestra.run.smithi016.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 452 kB/s | 54 kB 00:00 2023-08-25T04:41:07.618 INFO:teuthology.orchestra.run.smithi016.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.2 MB/s | 259 kB 00:00 2023-08-25T04:41:07.685 INFO:teuthology.orchestra.run.smithi016.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2023-08-25T04:41:07.844 INFO:teuthology.orchestra.run.smithi016.stdout:(102/131): python3-scipy-1.0.0-21.module+el8.5. 28 MB/s | 14 MB 00:00 2023-08-25T04:41:07.869 INFO:teuthology.orchestra.run.smithi016.stdout:(103/131): python3-markupsafe-0.23-19.el8.x86_6 155 kB/s | 39 kB 00:00 2023-08-25T04:41:07.902 INFO:teuthology.orchestra.run.smithi016.stdout:(104/131): bison-3.0.4-10.el8.x86_64.rpm 3.1 MB/s | 688 kB 00:00 2023-08-25T04:41:08.003 INFO:teuthology.orchestra.run.smithi016.stdout:(105/131): python3-jinja2-2.10.1-3.el8.noarch.r 3.3 MB/s | 538 kB 00:00 2023-08-25T04:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout:(106/131): python3-mako-1.0.6-13.el8.noarch.rpm 988 kB/s | 157 kB 00:00 2023-08-25T04:41:08.103 INFO:teuthology.orchestra.run.smithi016.stdout:(107/131): oniguruma-6.8.2-2.el8.x86_64.rpm 934 kB/s | 187 kB 00:00 2023-08-25T04:41:08.145 INFO:teuthology.orchestra.run.smithi016.stdout:(108/131): automake-1.16.1-7.el8.noarch.rpm 4.9 MB/s | 713 kB 00:00 2023-08-25T04:41:08.204 INFO:teuthology.orchestra.run.smithi016.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 5.3 MB/s | 320 kB 00:00 2023-08-25T04:41:08.246 INFO:teuthology.orchestra.run.smithi016.stdout:(110/131): python3-jsonpatch-1.21-2.el8.noarch. 187 kB/s | 27 kB 00:00 2023-08-25T04:41:08.346 INFO:teuthology.orchestra.run.smithi016.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-08-25T04:41:08.371 INFO:teuthology.orchestra.run.smithi016.stdout:(112/131): python3-prettytable-0.7.2-14.el8.noa 263 kB/s | 44 kB 00:00 2023-08-25T04:41:08.496 INFO:teuthology.orchestra.run.smithi016.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-08-25T04:41:08.522 INFO:teuthology.orchestra.run.smithi016.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.5 MB/s | 225 kB 00:00 2023-08-25T04:41:08.547 INFO:teuthology.orchestra.run.smithi016.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2023-08-25T04:41:08.572 INFO:teuthology.orchestra.run.smithi016.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.6 MB/s | 126 kB 00:00 2023-08-25T04:41:08.598 INFO:teuthology.orchestra.run.smithi016.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 395 kB/s | 20 kB 00:00 2023-08-25T04:41:08.623 INFO:teuthology.orchestra.run.smithi016.stdout:(118/131): python3-werkzeug-0.12.2-4.el8.noarch 1.6 MB/s | 457 kB 00:00 2023-08-25T04:41:08.648 INFO:teuthology.orchestra.run.smithi016.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.3 MB/s | 103 kB 00:00 2023-08-25T04:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2023-08-25T04:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-08-25T04:41:08.758 INFO:teuthology.orchestra.run.smithi016.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 3.9 MB/s | 202 kB 00:00 2023-08-25T04:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-08-25T04:41:08.891 INFO:teuthology.orchestra.run.smithi016.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 18 MB/s | 4.9 MB 00:00 2023-08-25T04:41:08.967 INFO:teuthology.orchestra.run.smithi016.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-08-25T04:41:09.009 INFO:teuthology.orchestra.run.smithi016.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-08-25T04:41:09.067 INFO:teuthology.orchestra.run.smithi016.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-08-25T04:41:09.159 INFO:teuthology.orchestra.run.smithi016.stdout:(128/131): postgresql-server-10.21-2.module+el8 14 MB/s | 5.1 MB 00:00 2023-08-25T04:41:09.226 INFO:teuthology.orchestra.run.smithi016.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 12 MB/s | 798 kB 00:00 2023-08-25T04:41:09.726 INFO:teuthology.orchestra.run.smithi016.stdout:(130/131): librados2-18.0.0-5703.gba6b39e4.el8. 5.1 MB/s | 3.7 MB 00:00 2023-08-25T04:41:09.868 INFO:teuthology.orchestra.run.smithi016.stdout:(131/131): librbd1-18.0.0-5703.gba6b39e4.el8.x8 4.5 MB/s | 3.6 MB 00:00 2023-08-25T04:41:09.871 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2023-08-25T04:41:09.871 INFO:teuthology.orchestra.run.smithi016.stdout:Total 14 MB/s | 206 MB 00:14 2023-08-25T04:41:10.713 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2023-08-25T04:41:10.845 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2023-08-25T04:41:10.846 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2023-08-25T04:41:12.028 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2023-08-25T04:41:12.032 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2023-08-25T04:41:12.163 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2023-08-25T04:41:12.333 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-25T04:41:12.519 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-25T04:41:12.725 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-08-25T04:41:12.885 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-25T04:41:12.996 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-25T04:41:13.219 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-25T04:41:13.604 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-25T04:41:13.843 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 6/134 2023-08-25T04:41:14.237 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 6/134 2023-08-25T04:41:14.443 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 7/134 2023-08-25T04:41:14.576 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 7/134 2023-08-25T04:41:14.751 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 8/134 2023-08-25T04:41:14.863 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 8/134 2023-08-25T04:41:15.052 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:18.0.0-5703.gba6b39e4.el8.x86_64 9/134 2023-08-25T04:41:15.280 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-25T04:41:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-25T04:41:15.872 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-25T04:41:16.139 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-25T04:41:16.310 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 14/134 2023-08-25T04:41:16.411 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 14/134 2023-08-25T04:41:16.601 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86 15/134 2023-08-25T04:41:16.677 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86 15/134 2023-08-25T04:41:16.809 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-25T04:41:16.941 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-25T04:41:17.176 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-25T04:41:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2023-08-25T04:41:17.390 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-25T04:41:17.600 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-25T04:41:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-25T04:41:17.792 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-25T04:41:17.890 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-25T04:41:17.942 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-25T04:41:18.100 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-25T04:41:18.528 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-25T04:41:18.542 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-25T04:41:18.700 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-08-25T04:41:18.725 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 5/134 2023-08-25T04:41:19.145 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 5/134 2023-08-25T04:41:19.325 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 6/134 2023-08-25T04:41:19.410 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-08-25T04:41:19.440 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 6/134 2023-08-25T04:41:19.633 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 7/134 2023-08-25T04:41:19.663 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-08-25T04:41:19.725 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 7/134 2023-08-25T04:41:19.876 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-08-25T04:41:19.889 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rados-2:18.0.0-5703.gba6b39e4.el8.x86_64 8/134 2023-08-25T04:41:20.112 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-08-25T04:41:20.118 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-08-25T04:41:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-08-25T04:41:20.393 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-25T04:41:20.481 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-08-25T04:41:20.726 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-25T04:41:20.872 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-25T04:41:20.873 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:18.0.0-5703.gba6b39e4.el8. 26/134 2023-08-25T04:41:20.994 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el 27/134 2023-08-25T04:41:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-25T04:41:21.537 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-25T04:41:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 14/134 2023-08-25T04:41:21.866 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 14/134 2023-08-25T04:41:21.911 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:18.0.0-5703.gba6b39e4.el8.x86_6 28/134 2023-08-25T04:41:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86 15/134 2023-08-25T04:41:22.208 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86 15/134 2023-08-25T04:41:22.223 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-08-25T04:41:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-08-25T04:41:22.599 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-08-25T04:41:22.670 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-08-25T04:41:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-08-25T04:41:22.899 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-25T04:41:22.945 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-08-25T04:41:23.054 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-25T04:41:23.133 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-25T04:41:23.191 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-25T04:41:23.844 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-25T04:41:24.016 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-25T04:41:24.651 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-25T04:41:24.832 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-08-25T04:41:24.902 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-25T04:41:25.233 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-08-25T04:41:25.419 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-25T04:41:25.596 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-08-25T04:41:25.603 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-25T04:41:25.796 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 36/134 2023-08-25T04:41:25.852 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-08-25T04:41:25.953 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:18.0.0-5703.gba6b39e4.el8.x86_6 37/134 2023-08-25T04:41:26.062 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-08-25T04:41:26.126 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-08-25T04:41:26.326 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-08-25T04:41:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-25T04:41:26.493 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-08-25T04:41:26.515 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-common-2:18.0.0-5703.gba6b39e4.el8. 26/134 2023-08-25T04:41:26.635 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-08-25T04:41:26.678 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el 27/134 2023-08-25T04:41:26.831 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-08-25T04:41:26.933 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cephfs-2:18.0.0-5703.gba6b39e4.el8.x86_6 28/134 2023-08-25T04:41:27.036 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-08-25T04:41:27.124 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-25T04:41:27.366 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-08-25T04:41:27.652 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-08-25T04:41:27.841 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-08-25T04:41:28.036 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-08-25T04:41:28.253 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-08-25T04:41:28.555 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-08-25T04:41:28.823 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-08-25T04:41:29.008 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-08-25T04:41:29.011 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-25T04:41:29.262 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-08-25T04:41:29.421 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-08-25T04:41:29.593 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-08-25T04:41:29.905 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-08-25T04:41:30.095 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-08-25T04:41:30.161 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-08-25T04:41:30.403 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-08-25T04:41:30.432 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-08-25T04:41:30.604 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-08-25T04:41:30.689 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-08-25T04:41:30.764 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-08-25T04:41:30.897 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-08-25T04:41:30.941 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-08-25T04:41:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-25T04:41:31.106 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-08-25T04:41:31.165 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-08-25T04:41:31.286 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-25T04:41:31.394 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-08-25T04:41:31.463 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 36/134 2023-08-25T04:41:31.626 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-08-25T04:41:31.656 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librados-devel-2:18.0.0-5703.gba6b39e4.el8.x86_6 37/134 2023-08-25T04:41:31.797 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-25T04:41:31.798 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-08-25T04:41:31.876 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-25T04:41:31.976 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-08-25T04:41:32.085 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-08-25T04:41:32.165 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-08-25T04:41:32.242 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-08-25T04:41:32.265 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-08-25T04:41:32.431 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-25T04:41:32.469 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-08-25T04:41:32.583 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-25T04:41:32.687 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-08-25T04:41:32.815 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-25T04:41:32.872 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-25T04:41:32.895 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-25T04:41:33.090 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-08-25T04:41:33.112 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-25T04:41:33.253 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-08-25T04:41:33.293 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-25T04:41:33.429 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-08-25T04:41:33.432 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-25T04:41:33.601 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-08-25T04:41:33.621 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-25T04:41:33.776 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-08-25T04:41:33.850 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-25T04:41:33.920 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-08-25T04:41:34.023 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-25T04:41:34.126 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-08-25T04:41:34.166 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-25T04:41:34.303 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-25T04:41:34.316 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-08-25T04:41:34.534 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-25T04:41:34.659 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-08-25T04:41:34.725 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-25T04:41:34.894 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-25T04:41:34.909 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-08-25T04:41:35.161 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-08-25T04:41:35.168 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-25T04:41:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-08-25T04:41:35.413 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-25T04:41:35.612 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-25T04:41:35.630 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-08-25T04:41:35.826 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-25T04:41:35.984 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-08-25T04:41:36.198 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-08-25T04:41:36.377 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-08-25T04:41:36.876 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-08-25T04:41:36.920 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-25T04:41:37.042 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-08-25T04:41:37.176 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-25T04:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-08-25T04:41:37.421 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-25T04:41:37.522 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-08-25T04:41:37.746 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-25T04:41:37.778 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-08-25T04:41:38.006 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-08-25T04:41:38.028 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-25T04:41:38.206 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-25T04:41:38.249 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-08-25T04:41:38.422 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-25T04:41:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-25T04:41:38.872 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-25T04:41:39.016 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-25T04:41:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-25T04:41:39.187 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 92/134 2023-08-25T04:41:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 92/134 2023-08-25T04:41:39.327 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-25T04:41:39.421 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 93/134 2023-08-25T04:41:39.484 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-25T04:41:39.694 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-25T04:41:39.906 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-25T04:41:40.120 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-25T04:41:40.285 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-25T04:41:40.437 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-25T04:41:40.649 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-25T04:41:40.885 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-25T04:41:41.070 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-25T04:41:41.310 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-25T04:41:41.555 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-25T04:41:41.773 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-25T04:41:41.979 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-25T04:41:43.051 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 94/134 2023-08-25T04:41:43.183 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-25T04:41:43.321 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 94/134 2023-08-25T04:41:43.437 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-25T04:41:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-25T04:41:43.920 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 94/134 2023-08-25T04:41:43.934 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-25T04:41:44.212 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 95/134 2023-08-25T04:41:44.221 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-25T04:41:44.298 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 95/134 2023-08-25T04:41:44.403 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 96/134 2023-08-25T04:41:44.421 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-25T04:41:45.284 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-25T04:41:45.455 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 92/134 2023-08-25T04:41:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 92/134 2023-08-25T04:41:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 93/134 2023-08-25T04:41:49.634 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 94/134 2023-08-25T04:41:49.846 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 94/134 2023-08-25T04:41:50.466 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 94/134 2023-08-25T04:41:50.725 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 95/134 2023-08-25T04:41:50.797 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 95/134 2023-08-25T04:41:50.962 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 96/134 2023-08-25T04:42:03.296 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 96/134 2023-08-25T04:42:03.296 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2023-08-25T04:42:03.296 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2023-08-25T04:42:03.297 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /dev 2023-08-25T04:42:03.297 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /run 2023-08-25T04:42:03.297 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2023-08-25T04:42:03.297 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2023-08-25T04:42:03.297 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2023-08-25T04:42:03.297 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2023-08-25T04:42:03.297 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /dev 2023-08-25T04:42:03.298 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:03.616 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 97/134 2023-08-25T04:42:05.192 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 97/134 2023-08-25T04:42:05.357 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 98/134 2023-08-25T04:42:05.576 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 98/134 2023-08-25T04:42:05.715 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 99/134 2023-08-25T04:42:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 99/134 2023-08-25T04:42:06.365 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 100/134 2023-08-25T04:42:06.382 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 100/134 2023-08-25T04:42:08.039 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 101/134 2023-08-25T04:42:08.201 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 101/134 2023-08-25T04:42:08.329 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.e 102/134 2023-08-25T04:42:08.530 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4. 103/134 2023-08-25T04:42:08.706 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noa 104/134 2023-08-25T04:42:08.927 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noa 104/134 2023-08-25T04:42:09.260 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.n 105/134 2023-08-25T04:42:10.218 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.n 105/134 2023-08-25T04:42:10.406 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 106/134 2023-08-25T04:42:10.497 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 106/134 2023-08-25T04:42:10.674 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 96/134 2023-08-25T04:42:10.674 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /sys 2023-08-25T04:42:10.674 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /proc 2023-08-25T04:42:10.675 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /dev 2023-08-25T04:42:10.675 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /run 2023-08-25T04:42:10.675 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /mnt 2023-08-25T04:42:10.675 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /var/tmp 2023-08-25T04:42:10.675 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /home 2023-08-25T04:42:10.675 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /tmp 2023-08-25T04:42:10.676 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /dev 2023-08-25T04:42:10.676 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:10.843 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el 107/134 2023-08-25T04:42:10.993 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 97/134 2023-08-25T04:42:11.006 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 108/134 2023-08-25T04:42:11.041 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 108/134 2023-08-25T04:42:11.222 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 109/134 2023-08-25T04:42:11.233 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 109/134 2023-08-25T04:42:12.523 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:18.0.0-5703.gba6b39e4.el8.x86_64 110/134 2023-08-25T04:42:12.681 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 97/134 2023-08-25T04:42:12.754 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 111/134 2023-08-25T04:42:12.795 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 111/134 2023-08-25T04:42:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 98/134 2023-08-25T04:42:12.947 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 112/134 2023-08-25T04:42:12.989 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 112/134 2023-08-25T04:42:13.113 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 98/134 2023-08-25T04:42:13.156 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 113/134 2023-08-25T04:42:13.252 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 99/134 2023-08-25T04:42:13.509 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 113/134 2023-08-25T04:42:13.681 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 114/134 2023-08-25T04:42:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 99/134 2023-08-25T04:42:13.935 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 100/134 2023-08-25T04:42:13.953 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 100/134 2023-08-25T04:42:15.720 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 101/134 2023-08-25T04:42:15.916 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 101/134 2023-08-25T04:42:16.057 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.e 102/134 2023-08-25T04:42:16.270 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4. 103/134 2023-08-25T04:42:16.442 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noa 104/134 2023-08-25T04:42:16.670 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noa 104/134 2023-08-25T04:42:16.988 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.n 105/134 2023-08-25T04:42:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.n 105/134 2023-08-25T04:42:18.167 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 106/134 2023-08-25T04:42:18.218 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 114/134 2023-08-25T04:42:18.265 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 106/134 2023-08-25T04:42:18.527 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:18.0.0-5703.gba6b39e4.el8.x86_64 115/134 2023-08-25T04:42:18.627 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el 107/134 2023-08-25T04:42:18.662 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-08-25T04:42:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 108/134 2023-08-25T04:42:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 108/134 2023-08-25T04:42:18.851 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-08-25T04:42:19.034 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 109/134 2023-08-25T04:42:19.045 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 109/134 2023-08-25T04:42:19.767 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-08-25T04:42:20.086 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-08-25T04:42:20.293 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 119/134 2023-08-25T04:42:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-2:18.0.0-5703.gba6b39e4.el8.x86_64 110/134 2023-08-25T04:42:20.466 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-25T04:42:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:18.0.0-5703.gba6b39e4.el8.x86_ 121/134 2023-08-25T04:42:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 111/134 2023-08-25T04:42:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 111/134 2023-08-25T04:42:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-25T04:42:20.842 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 112/134 2023-08-25T04:42:20.885 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 112/134 2023-08-25T04:42:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 113/134 2023-08-25T04:42:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 113/134 2023-08-25T04:42:21.551 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 114/134 2023-08-25T04:42:22.943 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-25T04:42:23.212 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-25T04:42:23.229 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-25T04:42:23.370 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-top-2:18.0.0-5703.gba6b39e4.el8.noarch 124/134 2023-08-25T04:42:23.628 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 125/134 2023-08-25T04:42:23.937 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 126/134 2023-08-25T04:42:24.296 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-25T04:42:24.436 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-25T04:42:24.444 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-25T04:42:24.620 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-08-25T04:42:24.811 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-08-25T04:42:24.893 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-08-25T04:42:25.077 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-08-25T04:42:25.090 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-08-25T04:42:25.090 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-25T04:42:25.280 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-25T04:42:25.281 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-25T04:42:25.519 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-25T04:42:25.684 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-25T04:42:26.166 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-25T04:42:26.166 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:18.0.0-5703.gba6b39e4.el8.x86_64 1/134 2023-08-25T04:42:26.167 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 2/134 2023-08-25T04:42:26.167 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 3/134 2023-08-25T04:42:26.167 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 4/134 2023-08-25T04:42:26.167 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 5/134 2023-08-25T04:42:26.167 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 6/134 2023-08-25T04:42:26.167 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 7/134 2023-08-25T04:42:26.167 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 8/134 2023-08-25T04:42:26.168 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 9/134 2023-08-25T04:42:26.168 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 10/134 2023-08-25T04:42:26.168 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 11/134 2023-08-25T04:42:26.168 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:18.0.0-5703.gba6b39e4.el8.x86_64 12/134 2023-08-25T04:42:26.168 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 13/134 2023-08-25T04:42:26.168 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:18.0.0-5703.gba6b39e4.el8.x86_ 14/134 2023-08-25T04:42:26.168 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 15/134 2023-08-25T04:42:26.169 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 16/134 2023-08-25T04:42:26.169 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:18.0.0-5703.gba6b39e4.el8.x86_6 17/134 2023-08-25T04:42:26.169 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86 18/134 2023-08-25T04:42:26.169 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 19/134 2023-08-25T04:42:26.169 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el 20/134 2023-08-25T04:42:26.169 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:18.0.0-5703.gba6b39e4.el8. 21/134 2023-08-25T04:42:26.169 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:18.0.0-5703.gba6b39e4.el8.x86_6 22/134 2023-08-25T04:42:26.170 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:18.0.0-5703.gba6b39e4.el8.x86_64 23/134 2023-08-25T04:42:26.170 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 24/134 2023-08-25T04:42:26.170 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 25/134 2023-08-25T04:42:26.170 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 26/134 2023-08-25T04:42:26.170 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 27/134 2023-08-25T04:42:26.170 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 28/134 2023-08-25T04:42:26.170 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4. 29/134 2023-08-25T04:42:26.177 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noa 30/134 2023-08-25T04:42:26.177 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.n 31/134 2023-08-25T04:42:26.177 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 32/134 2023-08-25T04:42:26.177 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el 33/134 2023-08-25T04:42:26.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 34/134 2023-08-25T04:42:26.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.e 35/134 2023-08-25T04:42:26.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 36/134 2023-08-25T04:42:26.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 37/134 2023-08-25T04:42:26.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-top-2:18.0.0-5703.gba6b39e4.el8.noarch 38/134 2023-08-25T04:42:26.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-25T04:42:26.178 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-25T04:42:26.179 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-25T04:42:26.179 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-25T04:42:26.179 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-25T04:42:26.179 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-25T04:42:26.179 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-25T04:42:26.179 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-25T04:42:26.179 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-25T04:42:26.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-25T04:42:26.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-25T04:42:26.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-25T04:42:26.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-25T04:42:26.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-25T04:42:26.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-25T04:42:26.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-25T04:42:26.180 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-25T04:42:26.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-25T04:42:26.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-25T04:42:26.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-25T04:42:26.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-25T04:42:26.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-25T04:42:26.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-25T04:42:26.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-25T04:42:26.181 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-25T04:42:26.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-25T04:42:26.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-25T04:42:26.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-25T04:42:26.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-25T04:42:26.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-25T04:42:26.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-25T04:42:26.182 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-25T04:42:26.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-25T04:42:26.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-08-25T04:42:26.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-08-25T04:42:26.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-08-25T04:42:26.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-08-25T04:42:26.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-08-25T04:42:26.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-08-25T04:42:26.183 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-08-25T04:42:26.184 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-08-25T04:42:26.184 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-08-25T04:42:26.184 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-08-25T04:42:26.184 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-08-25T04:42:26.184 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-08-25T04:42:26.184 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-08-25T04:42:26.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-08-25T04:42:26.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-08-25T04:42:26.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-08-25T04:42:26.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-08-25T04:42:26.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-08-25T04:42:26.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-08-25T04:42:26.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-08-25T04:42:26.185 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-08-25T04:42:26.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-08-25T04:42:26.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-08-25T04:42:26.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-08-25T04:42:26.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-08-25T04:42:26.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-08-25T04:42:26.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-08-25T04:42:26.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-08-25T04:42:26.186 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-08-25T04:42:26.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-08-25T04:42:26.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-08-25T04:42:26.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-08-25T04:42:26.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-08-25T04:42:26.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-08-25T04:42:26.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-08-25T04:42:26.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-08-25T04:42:26.187 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-08-25T04:42:26.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-08-25T04:42:26.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-08-25T04:42:26.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-08-25T04:42:26.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-08-25T04:42:26.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-08-25T04:42:26.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-08-25T04:42:26.188 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-08-25T04:42:26.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-08-25T04:42:26.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-08-25T04:42:26.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-08-25T04:42:26.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-08-25T04:42:26.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-25T04:42:26.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-08-25T04:42:26.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-25T04:42:26.189 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-08-25T04:42:26.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-08-25T04:42:26.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-08-25T04:42:26.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-08-25T04:42:26.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-08-25T04:42:26.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-25T04:42:26.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 129/134 2023-08-25T04:42:26.190 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-25T04:42:26.191 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 131/134 2023-08-25T04:42:26.191 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-25T04:42:26.191 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-25T04:42:26.411 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 114/134 2023-08-25T04:42:27.358 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-test-2:18.0.0-5703.gba6b39e4.el8.x86_64 115/134 2023-08-25T04:42:27.670 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-08-25T04:42:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 117/134 2023-08-25T04:42:28.136 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-08-25T04:42:28.316 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-08-25T04:42:28.525 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-08-25T04:42:28.771 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-08-25T04:42:28.875 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-25T04:42:28.875 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:48 ago on Fri 25 Aug 2023 04:40:40 AM UTC. 2023-08-25T04:42:28.929 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs-devel-2:18.0.0-5703.gba6b39e4.el8.x86_ 121/134 2023-08-25T04:42:29.084 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-25T04:42:31.516 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-25T04:42:31.741 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-25T04:42:31.760 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-25T04:42:31.920 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2023-08-25T04:42:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-top-2:18.0.0-5703.gba6b39e4.el8.noarch 124/134 2023-08-25T04:42:32.158 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:32.158 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2023-08-25T04:42:32.159 INFO:teuthology.orchestra.run.smithi117.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-25T04:42:32.159 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.159 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.159 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2023-08-25T04:42:32.159 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-25T04:42:32.159 INFO:teuthology.orchestra.run.smithi117.stdout: automake-1.16.1-7.el8.noarch 2023-08-25T04:42:32.159 INFO:teuthology.orchestra.run.smithi117.stdout: bison-3.0.4-10.el8.x86_64 2023-08-25T04:42:32.160 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.160 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.160 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.160 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.160 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:32.160 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.161 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.161 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.161 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:32.161 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:32.161 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:32.161 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:32.162 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:32.162 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.162 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.162 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:32.162 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.162 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.163 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.163 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:32.163 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:32.163 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.164 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:32.164 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-25T04:42:32.164 INFO:teuthology.orchestra.run.smithi117.stdout: flex-2.6.1-9.el8.x86_64 2023-08-25T04:42:32.164 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-25T04:42:32.164 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-25T04:42:32.164 INFO:teuthology.orchestra.run.smithi117.stdout: jq-1.6-3.el8.x86_64 2023-08-25T04:42:32.165 INFO:teuthology.orchestra.run.smithi117.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-25T04:42:32.165 INFO:teuthology.orchestra.run.smithi117.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-25T04:42:32.165 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-25T04:42:32.165 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.165 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.165 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.165 INFO:teuthology.orchestra.run.smithi117.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-25T04:42:32.166 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-25T04:42:32.166 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-25T04:42:32.166 INFO:teuthology.orchestra.run.smithi117.stdout: libpq-13.5-1.el8.x86_64 2023-08-25T04:42:32.166 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-25T04:42:32.166 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-25T04:42:32.166 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.167 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.167 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-25T04:42:32.167 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.167 INFO:teuthology.orchestra.run.smithi117.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-25T04:42:32.167 INFO:teuthology.orchestra.run.smithi117.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-25T04:42:32.167 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-25T04:42:32.168 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-25T04:42:32.168 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-25T04:42:32.168 INFO:teuthology.orchestra.run.smithi117.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-25T04:42:32.168 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-25T04:42:32.168 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-25T04:42:32.168 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-25T04:42:32.169 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-25T04:42:32.169 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-25T04:42:32.169 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-25T04:42:32.169 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-25T04:42:32.169 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-25T04:42:32.169 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-25T04:42:32.169 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-25T04:42:32.170 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-25T04:42:32.170 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-25T04:42:32.170 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-25T04:42:32.170 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-25T04:42:32.170 INFO:teuthology.orchestra.run.smithi117.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-25T04:42:32.170 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-25T04:42:32.170 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.171 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.171 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.171 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-25T04:42:32.171 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-25T04:42:32.171 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-25T04:42:32.171 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-25T04:42:32.171 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-25T04:42:32.172 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-25T04:42:32.172 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-25T04:42:32.172 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-25T04:42:32.172 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-25T04:42:32.172 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-25T04:42:32.172 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-25T04:42:32.173 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-25T04:42:32.173 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-25T04:42:32.173 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-25T04:42:32.173 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-25T04:42:32.174 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-25T04:42:32.174 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-25T04:42:32.174 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-25T04:42:32.175 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-25T04:42:32.175 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-25T04:42:32.175 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-25T04:42:32.175 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-25T04:42:32.176 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-2.6-1.el8.noarch 2023-08-25T04:42:32.176 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-25T04:42:32.176 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-25T04:42:32.176 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-25T04:42:32.176 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-25T04:42:32.176 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-25T04:42:32.177 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-25T04:42:32.177 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.177 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.177 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-25T04:42:32.177 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-25T04:42:32.177 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.241 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-25T04:42:32.242 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-25T04:42:32.242 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-25T04:42:32.242 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-25T04:42:32.242 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-25T04:42:32.242 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-25T04:42:32.242 INFO:teuthology.orchestra.run.smithi117.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-25T04:42:32.243 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-25T04:42:32.243 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-25T04:42:32.243 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-25T04:42:32.243 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-25T04:42:32.243 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-25T04:42:32.243 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-25T04:42:32.243 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.244 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.244 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:32.244 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-25T04:42:32.244 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-25T04:42:32.244 INFO:teuthology.orchestra.run.smithi117.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-25T04:42:32.244 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-25T04:42:32.245 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-25T04:42:32.245 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-25T04:42:32.245 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:32.245 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2023-08-25T04:42:32.249 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 125/134 2023-08-25T04:42:32.372 DEBUG:teuthology.parallel:result is None 2023-08-25T04:42:32.532 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-nbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 126/134 2023-08-25T04:42:32.876 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-25T04:42:33.040 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-08-25T04:42:33.128 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-08-25T04:42:33.332 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-08-25T04:42:33.345 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-08-25T04:42:33.532 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-25T04:42:33.540 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-25T04:42:33.718 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-08-25T04:42:33.718 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-25T04:42:33.910 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-25T04:42:33.911 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-25T04:42:34.265 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-25T04:42:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-25T04:42:34.998 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-25T04:42:34.998 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-2:18.0.0-5703.gba6b39e4.el8.x86_64 1/134 2023-08-25T04:42:34.999 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 2/134 2023-08-25T04:42:34.999 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 3/134 2023-08-25T04:42:34.999 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 4/134 2023-08-25T04:42:34.999 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 5/134 2023-08-25T04:42:34.999 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 6/134 2023-08-25T04:42:34.999 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 7/134 2023-08-25T04:42:35.000 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 8/134 2023-08-25T04:42:35.000 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 9/134 2023-08-25T04:42:35.000 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 10/134 2023-08-25T04:42:35.000 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 11/134 2023-08-25T04:42:35.000 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-test-2:18.0.0-5703.gba6b39e4.el8.x86_64 12/134 2023-08-25T04:42:35.000 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 13/134 2023-08-25T04:42:35.000 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs-devel-2:18.0.0-5703.gba6b39e4.el8.x86_ 14/134 2023-08-25T04:42:35.000 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 15/134 2023-08-25T04:42:35.001 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 16/134 2023-08-25T04:42:35.001 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:18.0.0-5703.gba6b39e4.el8.x86_6 17/134 2023-08-25T04:42:35.001 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86 18/134 2023-08-25T04:42:35.001 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 19/134 2023-08-25T04:42:35.001 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el 20/134 2023-08-25T04:42:35.001 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-common-2:18.0.0-5703.gba6b39e4.el8. 21/134 2023-08-25T04:42:35.001 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cephfs-2:18.0.0-5703.gba6b39e4.el8.x86_6 22/134 2023-08-25T04:42:35.001 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rados-2:18.0.0-5703.gba6b39e4.el8.x86_64 23/134 2023-08-25T04:42:35.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 24/134 2023-08-25T04:42:35.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 25/134 2023-08-25T04:42:35.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 26/134 2023-08-25T04:42:35.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 27/134 2023-08-25T04:42:35.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-nbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 28/134 2023-08-25T04:42:35.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4. 29/134 2023-08-25T04:42:35.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noa 30/134 2023-08-25T04:42:35.009 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.n 31/134 2023-08-25T04:42:35.009 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 32/134 2023-08-25T04:42:35.009 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el 33/134 2023-08-25T04:42:35.010 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 34/134 2023-08-25T04:42:35.010 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.e 35/134 2023-08-25T04:42:35.010 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 36/134 2023-08-25T04:42:35.010 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 37/134 2023-08-25T04:42:35.010 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-top-2:18.0.0-5703.gba6b39e4.el8.noarch 38/134 2023-08-25T04:42:35.010 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-25T04:42:35.010 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-25T04:42:35.011 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-25T04:42:35.011 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-25T04:42:35.011 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-25T04:42:35.011 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-25T04:42:35.011 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-25T04:42:35.011 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-25T04:42:35.011 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-25T04:42:35.012 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-25T04:42:35.012 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-25T04:42:35.012 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-25T04:42:35.012 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-25T04:42:35.012 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-25T04:42:35.012 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-25T04:42:35.012 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-25T04:42:35.013 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-25T04:42:35.013 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-25T04:42:35.013 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-25T04:42:35.013 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-25T04:42:35.013 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-25T04:42:35.013 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-25T04:42:35.013 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-25T04:42:35.014 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-25T04:42:35.014 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-25T04:42:35.014 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-25T04:42:35.014 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-25T04:42:35.014 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-25T04:42:35.014 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-25T04:42:35.014 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-25T04:42:35.015 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-25T04:42:35.015 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-25T04:42:35.015 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-25T04:42:35.015 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-08-25T04:42:35.015 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-08-25T04:42:35.015 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-08-25T04:42:35.015 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-08-25T04:42:35.015 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-08-25T04:42:35.016 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-08-25T04:42:35.016 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-08-25T04:42:35.016 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-08-25T04:42:35.016 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-08-25T04:42:35.016 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-08-25T04:42:35.016 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-08-25T04:42:35.016 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-08-25T04:42:35.016 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-08-25T04:42:35.017 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-08-25T04:42:35.017 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-08-25T04:42:35.017 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-08-25T04:42:35.017 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-08-25T04:42:35.017 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-08-25T04:42:35.017 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-08-25T04:42:35.017 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-08-25T04:42:35.018 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-08-25T04:42:35.018 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-08-25T04:42:35.018 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-08-25T04:42:35.018 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-08-25T04:42:35.018 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-08-25T04:42:35.018 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-08-25T04:42:35.018 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-08-25T04:42:35.018 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-08-25T04:42:35.019 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-08-25T04:42:35.019 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-08-25T04:42:35.019 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-08-25T04:42:35.019 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-08-25T04:42:35.019 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-08-25T04:42:35.019 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-08-25T04:42:35.019 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-08-25T04:42:35.020 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-08-25T04:42:35.020 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-08-25T04:42:35.020 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-08-25T04:42:35.020 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-08-25T04:42:35.020 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-08-25T04:42:35.020 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-08-25T04:42:35.020 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-08-25T04:42:35.021 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-08-25T04:42:35.021 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-08-25T04:42:35.021 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-08-25T04:42:35.021 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-08-25T04:42:35.021 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-08-25T04:42:35.021 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-08-25T04:42:35.021 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-08-25T04:42:35.021 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-08-25T04:42:35.022 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-08-25T04:42:35.022 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-08-25T04:42:35.022 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-08-25T04:42:35.022 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-08-25T04:42:35.022 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-08-25T04:42:35.022 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-08-25T04:42:35.022 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-08-25T04:42:35.022 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 129/134 2023-08-25T04:42:35.023 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-25T04:42:35.023 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 131/134 2023-08-25T04:42:35.023 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-25T04:42:35.023 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-25T04:42:37.652 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-25T04:42:37.653 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:55 ago on Fri 25 Aug 2023 04:40:42 AM UTC. 2023-08-25T04:42:40.360 INFO:teuthology.orchestra.run.smithi016.stdout:Installed products updated. 2023-08-25T04:42:40.610 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:40.610 INFO:teuthology.orchestra.run.smithi016.stdout:Upgraded: 2023-08-25T04:42:40.610 INFO:teuthology.orchestra.run.smithi016.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-25T04:42:40.610 INFO:teuthology.orchestra.run.smithi016.stdout: librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.610 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2023-08-25T04:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-25T04:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout: automake-1.16.1-7.el8.noarch 2023-08-25T04:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout: bison-3.0.4-10.el8.x86_64 2023-08-25T04:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.612 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.612 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:40.612 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.612 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.612 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.612 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:40.612 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:40.612 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:40.613 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:40.613 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:40.613 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.613 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.613 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:40.613 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.613 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.613 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.614 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:40.614 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:40.614 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.614 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-top-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:42:40.614 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-25T04:42:40.614 INFO:teuthology.orchestra.run.smithi016.stdout: flex-2.6.1-9.el8.x86_64 2023-08-25T04:42:40.614 INFO:teuthology.orchestra.run.smithi016.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-25T04:42:40.615 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-25T04:42:40.615 INFO:teuthology.orchestra.run.smithi016.stdout: jq-1.6-3.el8.x86_64 2023-08-25T04:42:40.615 INFO:teuthology.orchestra.run.smithi016.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-25T04:42:40.615 INFO:teuthology.orchestra.run.smithi016.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-25T04:42:40.615 INFO:teuthology.orchestra.run.smithi016.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-25T04:42:40.615 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.615 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.615 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.616 INFO:teuthology.orchestra.run.smithi016.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-25T04:42:40.616 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-25T04:42:40.616 INFO:teuthology.orchestra.run.smithi016.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-25T04:42:40.616 INFO:teuthology.orchestra.run.smithi016.stdout: libpq-13.5-1.el8.x86_64 2023-08-25T04:42:40.616 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-25T04:42:40.616 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-25T04:42:40.616 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.617 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.617 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-25T04:42:40.617 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.617 INFO:teuthology.orchestra.run.smithi016.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-25T04:42:40.617 INFO:teuthology.orchestra.run.smithi016.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-25T04:42:40.617 INFO:teuthology.orchestra.run.smithi016.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-25T04:42:40.617 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-25T04:42:40.617 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-25T04:42:40.618 INFO:teuthology.orchestra.run.smithi016.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-25T04:42:40.618 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-25T04:42:40.618 INFO:teuthology.orchestra.run.smithi016.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-25T04:42:40.618 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-25T04:42:40.618 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-25T04:42:40.618 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-25T04:42:40.618 INFO:teuthology.orchestra.run.smithi016.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-25T04:42:40.618 INFO:teuthology.orchestra.run.smithi016.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-25T04:42:40.619 INFO:teuthology.orchestra.run.smithi016.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-25T04:42:40.619 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-25T04:42:40.619 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-25T04:42:40.619 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-25T04:42:40.619 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-25T04:42:40.619 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-25T04:42:40.619 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-25T04:42:40.619 INFO:teuthology.orchestra.run.smithi016.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-25T04:42:40.620 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-25T04:42:40.620 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.620 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.620 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.620 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-25T04:42:40.620 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-25T04:42:40.620 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-25T04:42:40.621 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-25T04:42:40.621 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-25T04:42:40.621 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-25T04:42:40.621 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-25T04:42:40.621 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-25T04:42:40.621 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-25T04:42:40.621 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-25T04:42:40.621 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-25T04:42:40.622 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-25T04:42:40.622 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-25T04:42:40.622 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-25T04:42:40.622 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-25T04:42:40.622 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-25T04:42:40.622 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-25T04:42:40.622 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-25T04:42:40.622 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-25T04:42:40.623 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-25T04:42:40.623 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-25T04:42:40.623 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-25T04:42:40.623 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend-2.6-1.el8.noarch 2023-08-25T04:42:40.623 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-25T04:42:40.623 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-25T04:42:40.623 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-25T04:42:40.624 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-25T04:42:40.624 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-25T04:42:40.624 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-25T04:42:40.624 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.624 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.624 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-25T04:42:40.624 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-25T04:42:40.624 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.625 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-25T04:42:40.625 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-25T04:42:40.625 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-25T04:42:40.625 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-25T04:42:40.625 INFO:teuthology.orchestra.run.smithi016.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-25T04:42:40.625 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-25T04:42:40.625 INFO:teuthology.orchestra.run.smithi016.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-25T04:42:40.625 INFO:teuthology.orchestra.run.smithi016.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-25T04:42:40.626 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-25T04:42:40.626 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-25T04:42:40.626 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-25T04:42:40.626 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-25T04:42:40.626 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-25T04:42:40.626 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.626 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.626 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:42:40.627 INFO:teuthology.orchestra.run.smithi016.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-25T04:42:40.627 INFO:teuthology.orchestra.run.smithi016.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-25T04:42:40.627 INFO:teuthology.orchestra.run.smithi016.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-25T04:42:40.627 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-25T04:42:40.627 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-25T04:42:40.628 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-25T04:42:40.628 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:40.628 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2023-08-25T04:42:41.835 DEBUG:teuthology.parallel:result is None 2023-08-25T04:42:41.836 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:42:41.985 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-25T04:42:42.011 INFO:teuthology.orchestra.run.smithi016.stdout:18.0.0-5703.gba6b39e4.el8 2023-08-25T04:42:42.011 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5703.gba6b39e4.el8 2023-08-25T04:42:42.012 INFO:teuthology.task.install:The correct ceph version 18.0.0-5703.gba6b39e4 is installed. 2023-08-25T04:42:42.012 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:42:42.149 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-25T04:42:42.177 INFO:teuthology.orchestra.run.smithi117.stdout:18.0.0-5703.gba6b39e4.el8 2023-08-25T04:42:42.178 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5703.gba6b39e4.el8 2023-08-25T04:42:42.178 INFO:teuthology.task.install:The correct ceph version 18.0.0-5703.gba6b39e4 is installed. 2023-08-25T04:42:42.179 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-25T04:42:42.179 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:42:42.180 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-25T04:42:42.225 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:42:42.225 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-25T04:42:42.277 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-25T04:42:42.277 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:42:42.278 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2023-08-25T04:42:42.309 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-25T04:42:42.376 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:42:42.377 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2023-08-25T04:42:42.407 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-25T04:42:42.475 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-25T04:42:42.475 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:42:42.476 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-25T04:42:42.504 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-25T04:42:42.573 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:42:42.573 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-25T04:42:42.603 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-25T04:42:42.672 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-25T04:42:42.672 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:42:42.673 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2023-08-25T04:42:42.701 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-25T04:42:42.768 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:42:42.769 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2023-08-25T04:42:42.797 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-25T04:42:42.865 INFO:teuthology.run_tasks:Running task ceph... 2023-08-25T04:42:42.947 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-25T04:42:42.948 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2023-08-25T04:42:42.952 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2023-08-25T04:42:42.980 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-25T04:42:42.981 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-25T04:42:43.020 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-25T04:42:43.047 INFO:tasks.ceph:Creating extra log directories... 2023-08-25T04:42:43.048 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-25T04:42:43.088 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-25T04:42:43.123 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-25T04:42:43.123 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-25T04:42:43.123 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-25T04:42:43.124 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:42:43.124 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-25T04:42:43.172 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-25T04:42:43.305 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-25T04:42:43.333 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:42:43.333 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-25T04:42:43.351 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-25T04:42:43.497 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-25T04:42:43.532 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-25T04:42:43.532 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-25T04:42:43.533 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081', 'branch': 'wip-rishabh-2023aug3-b5', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota}', 'email': None, 'first_in_suite': False, 'job_id': '7379081', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023aug3-b5'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023aug3-b5', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023aug3-b5', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi016.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi117.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}}, {'ceph': None}, {'kclient': None}, {'workunit': {'clients': {'all': ['fs/quota']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '449a1bc2027504e7b3c3d7b30fa4178906581da7', 'timestamp': '2023-08-25_01:50:32', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2224'} 2023-08-25T04:42:43.534 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-25T04:42:43.537 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-25T04:42:43.581 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2023-08-25T04:42:43.594 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2023-08-25T04:42:43.648 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:42:43.648 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2023-08-25T04:42:43.678 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-25T04:42:43.679 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2023-08-25T04:42:43.738 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-25T04:42:43.738 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:42:43.738 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 385810 Links: 1 2023-08-25T04:42:43.738 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:42:43.738 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:42:43.738 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2023-08-25 04:42:34.675508801 +0000 2023-08-25T04:42:43.739 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-08-25 04:39:28.820681844 +0000 2023-08-25T04:42:43.739 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-08-25 04:39:28.820681844 +0000 2023-08-25T04:42:43.739 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2023-08-25T04:42:43.739 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-25T04:42:43.804 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2023-08-25T04:42:43.804 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2023-08-25T04:42:43.805 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000122077 s, 4.2 MB/s 2023-08-25T04:42:43.806 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-25T04:42:43.864 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2023-08-25T04:42:43.923 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-25T04:42:43.924 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:42:43.924 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 382835 Links: 1 2023-08-25T04:42:43.925 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:42:43.925 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:42:43.926 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2023-08-25 04:42:34.675508801 +0000 2023-08-25T04:42:43.926 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-08-25 04:39:29.389672523 +0000 2023-08-25T04:42:43.926 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-08-25 04:39:29.389672523 +0000 2023-08-25T04:42:43.926 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2023-08-25T04:42:43.926 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-25T04:42:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2023-08-25T04:42:43.990 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2023-08-25T04:42:43.990 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000114099 s, 4.5 MB/s 2023-08-25T04:42:43.991 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-25T04:42:44.049 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2023-08-25T04:42:44.106 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-25T04:42:44.106 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:42:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 387844 Links: 1 2023-08-25T04:42:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:42:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:42:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2023-08-25 04:42:34.675508801 +0000 2023-08-25T04:42:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-08-25 04:39:29.950663334 +0000 2023-08-25T04:42:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-08-25 04:39:29.950663334 +0000 2023-08-25T04:42:44.107 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2023-08-25T04:42:44.107 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-25T04:42:44.171 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2023-08-25T04:42:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2023-08-25T04:42:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000112482 s, 4.6 MB/s 2023-08-25T04:42:44.173 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-25T04:42:44.232 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2023-08-25T04:42:44.289 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-25T04:42:44.290 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:42:44.290 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 390527 Links: 1 2023-08-25T04:42:44.290 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:42:44.290 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:42:44.290 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2023-08-25 04:42:34.675508801 +0000 2023-08-25T04:42:44.290 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-08-25 04:39:30.474654750 +0000 2023-08-25T04:42:44.290 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-08-25 04:39:30.474654750 +0000 2023-08-25T04:42:44.291 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2023-08-25T04:42:44.291 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-25T04:42:44.358 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2023-08-25T04:42:44.358 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2023-08-25T04:42:44.359 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000102036 s, 5.0 MB/s 2023-08-25T04:42:44.359 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-25T04:42:44.416 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:42:44.417 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:42:44.417 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2023-08-25T04:42:44.438 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-25T04:42:44.439 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2023-08-25T04:42:44.501 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-25T04:42:44.501 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:42:44.501 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 388827 Links: 1 2023-08-25T04:42:44.501 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:42:44.501 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:42:44.502 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-08-25 04:42:25.871446159 +0000 2023-08-25T04:42:44.502 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-08-25 04:39:11.245998057 +0000 2023-08-25T04:42:44.502 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-08-25 04:39:11.245998057 +0000 2023-08-25T04:42:44.502 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-08-25T04:42:44.503 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-25T04:42:44.569 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-08-25T04:42:44.569 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-08-25T04:42:44.569 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000246762 s, 2.1 MB/s 2023-08-25T04:42:44.570 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-25T04:42:44.630 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2023-08-25T04:42:44.690 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-25T04:42:44.691 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:42:44.691 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 390373 Links: 1 2023-08-25T04:42:44.691 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:42:44.692 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:42:44.692 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-08-25 04:42:25.871446159 +0000 2023-08-25T04:42:44.692 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-08-25 04:39:13.400956621 +0000 2023-08-25T04:42:44.693 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-08-25 04:39:13.400956621 +0000 2023-08-25T04:42:44.693 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-08-25T04:42:44.693 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-25T04:42:44.758 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-08-25T04:42:44.758 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-08-25T04:42:44.759 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000227092 s, 2.3 MB/s 2023-08-25T04:42:44.760 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-25T04:42:44.819 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2023-08-25T04:42:44.877 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-25T04:42:44.877 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:42:44.877 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 391835 Links: 1 2023-08-25T04:42:44.877 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:42:44.877 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:42:44.878 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-08-25 04:42:25.871446159 +0000 2023-08-25T04:42:44.878 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-08-25 04:39:13.943946180 +0000 2023-08-25T04:42:44.878 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-08-25 04:39:13.943946180 +0000 2023-08-25T04:42:44.878 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-08-25T04:42:44.878 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-25T04:42:44.944 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-08-25T04:42:44.944 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-08-25T04:42:44.945 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000206824 s, 2.5 MB/s 2023-08-25T04:42:44.946 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-25T04:42:45.004 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2023-08-25T04:42:45.062 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-25T04:42:45.062 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:42:45.062 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 391872 Links: 1 2023-08-25T04:42:45.062 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:42:45.063 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:42:45.063 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-08-25 04:42:25.871446159 +0000 2023-08-25T04:42:45.063 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-08-25 04:39:14.490935662 +0000 2023-08-25T04:42:45.063 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-08-25 04:39:14.490935662 +0000 2023-08-25T04:42:45.063 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-08-25T04:42:45.063 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-25T04:42:45.129 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-08-25T04:42:45.129 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-08-25T04:42:45.130 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000233595 s, 2.2 MB/s 2023-08-25T04:42:45.131 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-25T04:42:45.189 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:42:45.190 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-25T04:42:45.190 INFO:tasks.ceph:Generating config... 2023-08-25T04:42:45.191 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-25T04:42:45.191 INFO:tasks.ceph:[client] debug client = 20 2023-08-25T04:42:45.191 INFO:tasks.ceph:[client] debug ms = 1 2023-08-25T04:42:45.192 INFO:tasks.ceph:[client] pid file = 2023-08-25T04:42:45.192 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-25T04:42:45.193 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-25T04:42:45.193 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-08-25T04:42:45.194 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-25T04:42:45.194 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-08-25T04:42:45.194 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-25T04:42:45.194 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-25T04:42:45.194 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-25T04:42:45.195 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-25T04:42:45.195 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-25T04:42:45.195 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-25T04:42:45.195 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-25T04:42:45.196 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-25T04:42:45.196 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-25T04:42:45.196 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-25T04:42:45.196 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-25T04:42:45.197 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-25T04:42:45.197 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-25T04:42:45.198 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-25T04:42:45.198 INFO:tasks.ceph:[osd] bdev async discard = True 2023-08-25T04:42:45.198 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-08-25T04:42:45.198 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-08-25T04:42:45.198 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-25T04:42:45.199 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-25T04:42:45.199 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-08-25T04:42:45.199 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-08-25T04:42:45.199 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-25T04:42:45.199 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-25T04:42:45.200 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-08-25T04:42:45.200 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-25T04:42:45.200 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-25T04:42:45.200 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-25T04:42:45.200 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-25T04:42:45.201 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-25T04:42:45.201 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-25T04:42:45.201 INFO:tasks.ceph:Setting up mon.a... 2023-08-25T04:42:45.201 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-25T04:42:45.260 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.keyring 2023-08-25T04:42:45.263 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-25T04:42:45.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-25T04:42:45.342 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.16'), ('mon.b', '172.21.15.117'), ('mon.c', '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]')] 2023-08-25T04:42:45.343 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.16,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-25T04:42:45.344 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:42:45.344 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-25T04:42:45.399 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.16 --add b 172.21.15.117 --addv c '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:42:45.489 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:42:45.489 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: generated fsid 53372d9f-1238-45a2-a21f-2a854d90c0cf 2023-08-25T04:42:45.490 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = pacific 2023-08-25T04:42:45.490 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 0 2023-08-25T04:42:45.490 INFO:teuthology.orchestra.run.smithi016.stdout:fsid 53372d9f-1238-45a2-a21f-2a854d90c0cf 2023-08-25T04:42:45.490 INFO:teuthology.orchestra.run.smithi016.stdout:last_changed 2023-08-25T04:42:45.489378+0000 2023-08-25T04:42:45.491 INFO:teuthology.orchestra.run.smithi016.stdout:created 2023-08-25T04:42:45.489378+0000 2023-08-25T04:42:45.491 INFO:teuthology.orchestra.run.smithi016.stdout:min_mon_release 16 (pacific) 2023-08-25T04:42:45.491 INFO:teuthology.orchestra.run.smithi016.stdout:election_strategy: 1 2023-08-25T04:42:45.491 INFO:teuthology.orchestra.run.smithi016.stdout:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2023-08-25T04:42:45.491 INFO:teuthology.orchestra.run.smithi016.stdout:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2023-08-25T04:42:45.492 INFO:teuthology.orchestra.run.smithi016.stdout:2: [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] mon.c 2023-08-25T04:42:45.492 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-25T04:42:45.494 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-25T04:42:45.511 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 53372d9f-1238-45a2-a21f-2a854d90c0cf... 2023-08-25T04:42:45.512 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-25T04:42:45.553 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-25T04:42:45.597 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2023-08-25T04:42:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2023-08-25T04:42:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-25T04:42:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2023-08-25T04:42:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2023-08-25T04:42:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2023-08-25T04:42:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2023-08-25T04:42:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2023-08-25T04:42:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2023-08-25T04:42:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2023-08-25T04:42:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-25T04:42:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2023-08-25T04:42:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2023-08-25T04:42:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-25T04:42:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2023-08-25T04:42:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2023-08-25T04:42:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2023-08-25T04:42:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2023-08-25T04:42:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2023-08-25T04:42:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2023-08-25T04:42:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2023-08-25T04:42:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2023-08-25T04:42:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-25T04:42:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-25T04:42:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: mon_allow_pool_size_one = true 2023-08-25T04:42:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-25T04:42:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2023-08-25T04:42:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2023-08-25T04:42:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2023-08-25T04:42:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2023-08-25T04:42:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2023-08-25T04:42:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.16,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2023-08-25T04:42:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on skipped message = False 2023-08-25T04:42:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 53372d9f-1238-45a2-a21f-2a854d90c0cf 2023-08-25T04:42:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.605 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2023-08-25T04:42:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2023-08-25T04:42:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2023-08-25T04:42:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2023-08-25T04:42:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: osd mclock profile = high_recovery_ops 2023-08-25T04:42:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2023-08-25T04:42:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2023-08-25T04:42:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2023-08-25T04:42:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2023-08-25T04:42:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2023-08-25T04:42:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2023-08-25T04:42:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2023-08-25T04:42:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2023-08-25T04:42:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2023-08-25T04:42:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2023-08-25T04:42:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2023-08-25T04:42:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2023-08-25T04:42:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2023-08-25T04:42:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2023-08-25T04:42:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: bdev async discard = True 2023-08-25T04:42:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: bdev enable discard = True 2023-08-25T04:42:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore allocator = bitmap 2023-08-25T04:42:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2023-08-25T04:42:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2023-08-25T04:42:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 1/20 2023-08-25T04:42:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 1/20 2023-08-25T04:42:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-08-25T04:42:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 20 2023-08-25T04:42:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 4/10 2023-08-25T04:42:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2023-08-25T04:42:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2023-08-25T04:42:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2023-08-25T04:42:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2023-08-25T04:42:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2023-08-25T04:42:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2023-08-25T04:42:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.613 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2023-08-25T04:42:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-08-25T04:42:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2023-08-25T04:42:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2023-08-25T04:42:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2023-08-25T04:42:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2023-08-25T04:42:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2023-08-25T04:42:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2023-08-25T04:42:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.615 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2023-08-25T04:42:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-08-25T04:42:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2023-08-25T04:42:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2023-08-25T04:42:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2023-08-25T04:42:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2023-08-25T04:42:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2023-08-25T04:42:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2023-08-25T04:42:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2023-08-25T04:42:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2023-08-25T04:42:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2023-08-25T04:42:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-25T04:42:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: auth mon ticket ttl = 660 # 11m 2023-08-25T04:42:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: auth service ticket ttl = 240 # 4m 2023-08-25T04:42:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: # don't complain about insecure global_id in the test suite 2023-08-25T04:42:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-25T04:42:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-25T04:42:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: # 1m isn't quite enough 2023-08-25T04:42:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: mon_down_mkfs_grace = 2m 2023-08-25T04:42:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_filestore_osds = false 2023-08-25T04:42:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: mon op complaint time = 120 2023-08-25T04:42:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:42:45.619 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2023-08-25T04:42:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2023-08-25T04:42:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2023-08-25T04:42:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2023-08-25T04:42:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-25T04:42:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-25T04:42:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: client mount timeout = 600 2023-08-25T04:42:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2023-08-25T04:42:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-08-25T04:42:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = "" 2023-08-25T04:42:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2023-08-25T04:42:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2023-08-25T04:42:45.620 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2023-08-25T04:42:45.620 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2023-08-25T04:42:45.621 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2023-08-25T04:42:45.621 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2023-08-25T04:42:45.621 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2023-08-25T04:42:45.621 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2023-08-25T04:42:45.621 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d] 2023-08-25T04:42:45.621 INFO:teuthology.orchestra.run.smithi016.stdout:[mds] 2023-08-25T04:42:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds = 20 2023-08-25T04:42:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds balancer = 20 2023-08-25T04:42:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-08-25T04:42:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug frag = True 2023-08-25T04:42:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug scatterstat = True 2023-08-25T04:42:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: mds op complaint time = 180 2023-08-25T04:42:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: mds verify scatter = True 2023-08-25T04:42:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2023-08-25T04:42:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2023-08-25T04:42:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2023-08-25T04:42:45.667 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2023-08-25T04:42:45.668 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2023-08-25T04:42:45.668 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-25T04:42:45.668 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2023-08-25T04:42:45.668 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.668 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2023-08-25T04:42:45.668 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.668 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2023-08-25T04:42:45.669 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.669 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2023-08-25T04:42:45.669 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2023-08-25T04:42:45.669 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.669 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2023-08-25T04:42:45.669 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2023-08-25T04:42:45.670 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.670 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-25T04:42:45.670 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2023-08-25T04:42:45.670 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.670 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2023-08-25T04:42:45.670 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-25T04:42:45.670 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.671 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2023-08-25T04:42:45.671 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.671 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2023-08-25T04:42:45.671 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2023-08-25T04:42:45.671 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2023-08-25T04:42:45.671 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2023-08-25T04:42:45.672 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2023-08-25T04:42:45.672 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2023-08-25T04:42:45.672 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2023-08-25T04:42:45.672 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-25T04:42:45.672 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-25T04:42:45.672 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2023-08-25T04:42:45.672 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.672 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-25T04:42:45.673 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.673 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2023-08-25T04:42:45.673 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.673 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2023-08-25T04:42:45.673 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.673 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2023-08-25T04:42:45.673 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2023-08-25T04:42:45.674 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2023-08-25T04:42:45.674 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.16,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2023-08-25T04:42:45.674 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on skipped message = False 2023-08-25T04:42:45.674 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 53372d9f-1238-45a2-a21f-2a854d90c0cf 2023-08-25T04:42:45.674 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.674 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2023-08-25T04:42:45.674 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2023-08-25T04:42:45.674 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.675 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2023-08-25T04:42:45.675 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2023-08-25T04:42:45.675 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2023-08-25T04:42:45.675 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.675 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2023-08-25T04:42:45.675 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2023-08-25T04:42:45.675 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.676 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2023-08-25T04:42:45.676 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2023-08-25T04:42:45.676 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2023-08-25T04:42:45.676 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.676 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2023-08-25T04:42:45.676 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2023-08-25T04:42:45.676 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.676 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2023-08-25T04:42:45.677 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.677 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2023-08-25T04:42:45.677 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.677 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2023-08-25T04:42:45.677 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.677 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2023-08-25T04:42:45.677 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2023-08-25T04:42:45.678 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.678 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2023-08-25T04:42:45.678 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2023-08-25T04:42:45.678 INFO:teuthology.orchestra.run.smithi117.stdout: bdev async discard = True 2023-08-25T04:42:45.678 INFO:teuthology.orchestra.run.smithi117.stdout: bdev enable discard = True 2023-08-25T04:42:45.678 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore allocator = bitmap 2023-08-25T04:42:45.678 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2023-08-25T04:42:45.678 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2023-08-25T04:42:45.679 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 1/20 2023-08-25T04:42:45.679 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 1/20 2023-08-25T04:42:45.679 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-08-25T04:42:45.679 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2023-08-25T04:42:45.679 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 4/10 2023-08-25T04:42:45.679 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2023-08-25T04:42:45.679 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2023-08-25T04:42:45.680 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2023-08-25T04:42:45.680 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2023-08-25T04:42:45.680 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2023-08-25T04:42:45.681 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2023-08-25T04:42:45.681 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.681 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2023-08-25T04:42:45.681 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-08-25T04:42:45.681 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2023-08-25T04:42:45.681 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2023-08-25T04:42:45.681 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2023-08-25T04:42:45.682 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2023-08-25T04:42:45.682 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2023-08-25T04:42:45.682 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2023-08-25T04:42:45.682 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.682 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2023-08-25T04:42:45.682 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-08-25T04:42:45.683 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2023-08-25T04:42:45.683 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2023-08-25T04:42:45.683 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2023-08-25T04:42:45.683 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2023-08-25T04:42:45.683 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2023-08-25T04:42:45.683 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2023-08-25T04:42:45.683 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2023-08-25T04:42:45.683 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2023-08-25T04:42:45.684 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2023-08-25T04:42:45.684 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.684 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-25T04:42:45.684 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2023-08-25T04:42:45.684 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2023-08-25T04:42:45.685 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.685 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2023-08-25T04:42:45.685 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-25T04:42:45.685 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-25T04:42:45.685 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.685 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2023-08-25T04:42:45.685 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2023-08-25T04:42:45.686 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.686 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2023-08-25T04:42:45.686 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2023-08-25T04:42:45.686 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-25T04:42:45.686 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2023-08-25T04:42:45.686 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2023-08-25T04:42:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2023-08-25T04:42:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2023-08-25T04:42:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-25T04:42:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-25T04:42:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2023-08-25T04:42:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2023-08-25T04:42:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-08-25T04:42:45.688 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = "" 2023-08-25T04:42:45.688 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2023-08-25T04:42:45.688 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2023-08-25T04:42:45.688 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2023-08-25T04:42:45.688 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2023-08-25T04:42:45.688 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2023-08-25T04:42:45.688 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2023-08-25T04:42:45.689 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2023-08-25T04:42:45.689 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2023-08-25T04:42:45.689 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2023-08-25T04:42:45.689 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2023-08-25T04:42:45.689 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2023-08-25T04:42:45.689 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2023-08-25T04:42:45.689 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-08-25T04:42:45.689 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2023-08-25T04:42:45.690 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2023-08-25T04:42:45.690 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2023-08-25T04:42:45.690 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = True 2023-08-25T04:42:45.690 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2023-08-25T04:42:45.690 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2023-08-25T04:42:45.690 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2023-08-25T04:42:45.691 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-25T04:42:45.692 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-25T04:42:45.750 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-25T04:42:45.751 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:42:45.751 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-25T04:42:45.768 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:42:45.768 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-25T04:42:45.825 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2023-08-25T04:42:45.825 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:42:45.826 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-25T04:42:45.826 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-25T04:42:45.903 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:42:45.903 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:42:45.960 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2023-08-25T04:42:45.960 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:42:45.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-25T04:42:45.961 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-25T04:42:46.005 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:42:46.007 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:42:46.065 INFO:tasks.ceph:Setting up mon nodes... 2023-08-25T04:42:46.066 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-25T04:42:46.066 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-25T04:42:46.121 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-25T04:42:46.123 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-25T04:42:46.240 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-25T04:42:46.243 INFO:tasks.ceph:Setting up mds nodes... 2023-08-25T04:42:46.244 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-25T04:42:46.300 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-25T04:42:46.303 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-25T04:42:46.330 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-25T04:42:46.424 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-25T04:42:46.427 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-25T04:42:46.454 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-25T04:42:46.518 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-25T04:42:46.518 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-25T04:42:46.547 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-25T04:42:46.642 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-25T04:42:46.644 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-25T04:42:46.671 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-25T04:42:46.672 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-25T04:42:46.716 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-25T04:42:46.730 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-25T04:42:46.774 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-25T04:42:46.787 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-25T04:42:46.830 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-25T04:42:46.843 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-25T04:42:46.926 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-25T04:42:46.938 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-25T04:42:46.939 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-25T04:42:46.939 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-25T04:42:46.966 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:42:46.967 INFO:tasks.ceph:role: osd.0 2023-08-25T04:42:46.967 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com 2023-08-25T04:42:46.967 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-25T04:42:47.033 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:42:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:42:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:42:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:42:47.034 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:42:47.034 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:42:47.034 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:42:47.035 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:42:47.035 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:42:47.035 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:42:47.056 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2023-08-25T04:42:47.060 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2023-08-25T04:42:47.061 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-25T04:42:47.140 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-25T04:42:47.212 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-25T04:42:47.280 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:42:47.280 INFO:tasks.ceph:role: osd.1 2023-08-25T04:42:47.281 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com 2023-08-25T04:42:47.281 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-25T04:42:47.346 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:42:47.348 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:42:47.348 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:42:47.348 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:42:47.349 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:42:47.349 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:42:47.349 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:42:47.350 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:42:47.350 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:42:47.350 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:42:47.369 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2023-08-25T04:42:47.371 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2023-08-25T04:42:47.371 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-25T04:42:47.451 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-25T04:42:47.523 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-25T04:42:47.590 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:42:47.614 INFO:tasks.ceph:role: osd.2 2023-08-25T04:42:47.614 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com 2023-08-25T04:42:47.614 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-25T04:42:47.659 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:42:47.659 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:42:47.660 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:42:47.660 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:42:47.660 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:42:47.660 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:42:47.660 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:42:47.660 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:42:47.661 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:42:47.661 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:42:47.682 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2023-08-25T04:42:47.684 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2023-08-25T04:42:47.684 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-25T04:42:47.765 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-25T04:42:47.841 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-25T04:42:47.910 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:42:47.910 INFO:tasks.ceph:role: osd.3 2023-08-25T04:42:47.911 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com 2023-08-25T04:42:47.911 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-25T04:42:47.977 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:42:47.977 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:42:47.978 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:42:47.978 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:42:47.978 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:42:47.978 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:42:47.978 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:42:47.978 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:42:47.979 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:42:47.979 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:42:48.001 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2023-08-25T04:42:48.002 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2023-08-25T04:42:48.002 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-25T04:42:48.083 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-25T04:42:48.154 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:42:48.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:48.436+0000 7f80ccf46640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-25T04:42:48.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:48.437+0000 7f80ccf46640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-25T04:42:48.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:48.437+0000 7f80ccf46640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-25T04:42:48.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:48.437+0000 7f80ccf46640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-25T04:42:48.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:48.437+0000 7f80ccf46640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-25T04:42:48.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:48.437+0000 7f80ccf46640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-25T04:42:51.306 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-25T04:42:51.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:42:51.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:51.429+0000 7f0577d46640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-25T04:42:51.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:51.429+0000 7f0577d46640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-25T04:42:51.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:51.429+0000 7f0577d46640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-25T04:42:51.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:51.429+0000 7f0577d46640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-25T04:42:51.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:51.429+0000 7f0577d46640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-25T04:42:51.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:51.429+0000 7f0577d46640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-25T04:42:54.297 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-25T04:42:54.330 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:42:54.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:54.490+0000 7f990ed50640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-25T04:42:54.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:54.490+0000 7f990ed50640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-25T04:42:54.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:54.490+0000 7f990ed50640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-25T04:42:54.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:54.490+0000 7f990ed50640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-25T04:42:54.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:54.490+0000 7f990ed50640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-25T04:42:54.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:54.491+0000 7f990ed50640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-25T04:42:57.367 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-25T04:42:57.401 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:42:57.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:57.495+0000 7fea62272640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-25T04:42:57.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:57.495+0000 7fea62272640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-25T04:42:57.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:57.495+0000 7fea62272640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-25T04:42:57.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:57.495+0000 7fea62272640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-25T04:42:57.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:57.495+0000 7fea62272640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-25T04:42:57.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:42:57.495+0000 7fea62272640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-25T04:43:00.366 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-25T04:43:00.399 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-25T04:43:00.432 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:43:00.432 INFO:tasks.ceph:role: osd.4 2023-08-25T04:43:00.433 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-25T04:43:00.433 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-25T04:43:00.516 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:43:00.517 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:43:00.517 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:43:00.517 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:43:00.517 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:43:00.518 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:43:00.518 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:43:00.518 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:43:00.518 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:43:00.518 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:43:00.934 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-08-25T04:43:00.936 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-08-25T04:43:00.936 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-25T04:43:01.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-25T04:43:01.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-25T04:43:01.243 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:43:01.244 INFO:tasks.ceph:role: osd.5 2023-08-25T04:43:01.244 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-25T04:43:01.244 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-25T04:43:01.319 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:43:01.320 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:43:01.320 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:43:01.320 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:43:01.320 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:43:01.320 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:43:01.320 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:43:01.321 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:43:01.321 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:43:01.321 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:43:01.738 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-08-25T04:43:01.740 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-08-25T04:43:01.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-25T04:43:01.861 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-25T04:43:01.896 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-25T04:43:01.970 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:43:01.970 INFO:tasks.ceph:role: osd.6 2023-08-25T04:43:01.970 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-25T04:43:01.971 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-25T04:43:02.049 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:43:02.049 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:43:02.050 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:43:02.050 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:43:02.050 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:43:02.050 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:43:02.050 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:43:02.051 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:43:02.051 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:43:02.051 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:43:02.499 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-08-25T04:43:02.499 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-08-25T04:43:02.500 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-25T04:43:02.650 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-25T04:43:02.684 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-25T04:43:02.754 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:43:02.754 INFO:tasks.ceph:role: osd.7 2023-08-25T04:43:02.755 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-25T04:43:02.755 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-25T04:43:02.830 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:43:02.831 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:43:02.831 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:43:02.831 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:43:02.832 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:43:02.832 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:43:02.832 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:43:02.832 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:43:02.833 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:43:02.833 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:43:03.274 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-08-25T04:43:03.276 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-08-25T04:43:03.277 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-25T04:43:03.458 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-25T04:43:03.495 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:43:03.597 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:03.596+0000 7faffe71b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-25T04:43:03.597 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:03.596+0000 7faffe71b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-25T04:43:03.598 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:03.596+0000 7faffe71b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-25T04:43:03.598 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:03.597+0000 7faffe71b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-25T04:43:03.598 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:03.597+0000 7faffe71b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-25T04:43:03.598 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:03.597+0000 7faffe71b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-25T04:43:06.470 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-25T04:43:06.502 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:43:06.595 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:06.593+0000 7faf65472640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-25T04:43:06.595 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:06.593+0000 7faf65472640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-25T04:43:06.595 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:06.593+0000 7faf65472640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-25T04:43:06.596 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:06.593+0000 7faf65472640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-25T04:43:06.596 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:06.593+0000 7faf65472640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-25T04:43:06.596 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:06.594+0000 7faf65472640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-25T04:43:09.461 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-25T04:43:09.492 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:43:09.583 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:09.582+0000 7fbb7420b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-25T04:43:09.583 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:09.582+0000 7fbb7420b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-25T04:43:09.583 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:09.582+0000 7fbb7420b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-25T04:43:09.584 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:09.582+0000 7fbb7420b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-25T04:43:09.584 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:09.582+0000 7fbb7420b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-25T04:43:09.584 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:09.583+0000 7fbb7420b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-25T04:43:12.451 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-25T04:43:12.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:43:12.576 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:12.574+0000 7fd4c63fa640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-25T04:43:12.576 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:12.575+0000 7fd4c63fa640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-25T04:43:12.576 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:12.575+0000 7fd4c63fa640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-25T04:43:12.576 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:12.575+0000 7fd4c63fa640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-25T04:43:12.577 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:12.575+0000 7fd4c63fa640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-25T04:43:12.577 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:12.575+0000 7fd4c63fa640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-25T04:43:13.535 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:43:13.539 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:43:15.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-25T04:43:15.475 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-25T04:43:15.476 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:43:15.476 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-25T04:43:15.513 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:43:15.513 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-25T04:43:15.584 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:43:15.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-25T04:43:15.655 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:43:15.655 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-25T04:43:15.725 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:43:15.726 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-25T04:43:15.794 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:43:15.794 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-25T04:43:15.862 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:43:15.863 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-25T04:43:15.931 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:43:15.932 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-25T04:43:15.965 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:43:15.965 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-25T04:43:16.035 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:43:16.036 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-25T04:43:16.104 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:43:16.105 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-25T04:43:16.173 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:43:16.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-25T04:43:16.239 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:43:16.240 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-25T04:43:16.306 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:43:16.307 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-25T04:43:16.373 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:43:16.373 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-25T04:43:16.394 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:43:16.395 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-25T04:43:16.455 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:43:16.455 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-25T04:43:16.473 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:43:16.474 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-25T04:43:16.530 INFO:tasks.ceph:Adding keys to all mons... 2023-08-25T04:43:16.530 DEBUG:teuthology.orchestra.run.smithi016:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-25T04:43:16.533 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-25T04:43:16.573 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.y] 2023-08-25T04:43:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBGMehkWkM8BxAADCZnbyeT0EvcQRmYEC7F+A== 2023-08-25T04:43:16.574 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2023-08-25T04:43:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBGMehkxSD1ERAAZ8/HBO0YQ56FhUqmLJ6zxA== 2023-08-25T04:43:16.574 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2023-08-25T04:43:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBGMehk+dFYGRAA0K1Gr4H/p4Q45Uo5dNuNhg== 2023-08-25T04:43:16.575 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2023-08-25T04:43:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBIMehkEVAeGhAAJ4dbGlUPUsW5xIEchwRbmQ== 2023-08-25T04:43:16.575 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2023-08-25T04:43:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBLMehkrFesGRAA9UIrFR1s4ttS3XY+FLYNkg== 2023-08-25T04:43:16.576 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2023-08-25T04:43:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBOMehk80dDHRAAyaqoImpoq1EI2nJ8uxsyvg== 2023-08-25T04:43:16.577 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.3] 2023-08-25T04:43:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBRMehkK+CHHRAAytmSrUc6+dpz5v1ghoNkqA== 2023-08-25T04:43:16.577 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.x] 2023-08-25T04:43:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBGMehkkgNfDhAAjFd7yP6bu1ivBbNoXczYjQ== 2023-08-25T04:43:16.578 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2023-08-25T04:43:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBGMehk4H+pHhAA78+wYATZ4AZKPEti0ZZ43A== 2023-08-25T04:43:16.578 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d] 2023-08-25T04:43:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBGMehkbL9JJhAAsyTdLPkAYH/6bruh5z5oXw== 2023-08-25T04:43:16.579 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.4] 2023-08-25T04:43:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBXMehkwW+gIxAAvibMQ9CwkXRY+rIgs+4xgA== 2023-08-25T04:43:16.580 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.5] 2023-08-25T04:43:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBaMehkPVpwIxAAH47+sIvcUjIPir0tgD8t6g== 2023-08-25T04:43:16.580 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.6] 2023-08-25T04:43:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBdMehk9rDFIhAAGFcLSHcrFII5rPazk5505w== 2023-08-25T04:43:16.581 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.7] 2023-08-25T04:43:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBgMehkxCJUIhAAtRE0/3PYtCHjNevaoOWRkA== 2023-08-25T04:43:16.582 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2023-08-25T04:43:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBGMehkQ+6+KhAA1zJK/EGwt9ewW4UUs76HAQ== 2023-08-25T04:43:16.582 INFO:teuthology.orchestra.run.smithi016.stdout:[client.2] 2023-08-25T04:43:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBGMehkkCQqLhAA2fOKsQ5toObDtY5gJuVwXg== 2023-08-25T04:43:16.583 INFO:teuthology.orchestra.run.smithi016.stdout:[client.1] 2023-08-25T04:43:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBGMehkQWiEMRAA9Ckev4kBmJrk0Q81rR66gg== 2023-08-25T04:43:16.583 INFO:teuthology.orchestra.run.smithi016.stdout:[client.3] 2023-08-25T04:43:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBGMehk7Dc3NxAAHiaoAGuYF4PzBLWL26/PIQ== 2023-08-25T04:43:16.595 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2023-08-25T04:43:16.595 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBGMehkWkM8BxAADCZnbyeT0EvcQRmYEC7F+A== 2023-08-25T04:43:16.596 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2023-08-25T04:43:16.596 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBGMehkxSD1ERAAZ8/HBO0YQ56FhUqmLJ6zxA== 2023-08-25T04:43:16.596 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2023-08-25T04:43:16.596 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBGMehk+dFYGRAA0K1Gr4H/p4Q45Uo5dNuNhg== 2023-08-25T04:43:16.596 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2023-08-25T04:43:16.596 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBIMehkEVAeGhAAJ4dbGlUPUsW5xIEchwRbmQ== 2023-08-25T04:43:16.596 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2023-08-25T04:43:16.597 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBLMehkrFesGRAA9UIrFR1s4ttS3XY+FLYNkg== 2023-08-25T04:43:16.597 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2023-08-25T04:43:16.597 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBOMehk80dDHRAAyaqoImpoq1EI2nJ8uxsyvg== 2023-08-25T04:43:16.597 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2023-08-25T04:43:16.597 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBRMehkK+CHHRAAytmSrUc6+dpz5v1ghoNkqA== 2023-08-25T04:43:16.597 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2023-08-25T04:43:16.598 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBGMehkkgNfDhAAjFd7yP6bu1ivBbNoXczYjQ== 2023-08-25T04:43:16.598 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2023-08-25T04:43:16.598 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBGMehk4H+pHhAA78+wYATZ4AZKPEti0ZZ43A== 2023-08-25T04:43:16.598 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2023-08-25T04:43:16.598 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBGMehkbL9JJhAAsyTdLPkAYH/6bruh5z5oXw== 2023-08-25T04:43:16.599 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2023-08-25T04:43:16.599 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBXMehkwW+gIxAAvibMQ9CwkXRY+rIgs+4xgA== 2023-08-25T04:43:16.599 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2023-08-25T04:43:16.600 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBaMehkPVpwIxAAH47+sIvcUjIPir0tgD8t6g== 2023-08-25T04:43:16.600 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2023-08-25T04:43:16.600 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBdMehk9rDFIhAAGFcLSHcrFII5rPazk5505w== 2023-08-25T04:43:16.600 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2023-08-25T04:43:16.600 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBgMehkxCJUIhAAtRE0/3PYtCHjNevaoOWRkA== 2023-08-25T04:43:16.601 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2023-08-25T04:43:16.601 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBGMehkQ+6+KhAA1zJK/EGwt9ewW4UUs76HAQ== 2023-08-25T04:43:16.601 INFO:teuthology.orchestra.run.smithi117.stdout:[client.2] 2023-08-25T04:43:16.601 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBGMehkkCQqLhAA2fOKsQ5toObDtY5gJuVwXg== 2023-08-25T04:43:16.601 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2023-08-25T04:43:16.602 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBGMehkQWiEMRAA9Ckev4kBmJrk0Q81rR66gg== 2023-08-25T04:43:16.602 INFO:teuthology.orchestra.run.smithi117.stdout:[client.3] 2023-08-25T04:43:16.602 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBGMehk7Dc3NxAAHiaoAGuYF4PzBLWL26/PIQ== 2023-08-25T04:43:16.603 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T04:43:16.628 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T04:43:16.697 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:43:16.700 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:43:16.759 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:43:16.763 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:43:16.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:16.823 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:16.875 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:16.879 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:16.931 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:16.933 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:16.988 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:16.991 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:17.044 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T04:43:17.047 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T04:43:17.099 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:43:17.104 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:43:17.160 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:43:17.162 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:43:17.218 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:17.221 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:17.274 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:17.276 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:17.329 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:17.331 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:17.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:17.388 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:43:17.442 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:43:17.445 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:43:17.501 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:43:17.503 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:43:17.559 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:43:17.561 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:43:17.618 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:43:17.621 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:43:17.677 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-25T04:43:17.678 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-25T04:43:17.705 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-25T04:43:17.805 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-25T04:43:17.832 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-25T04:43:17.859 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-25T04:43:17.957 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-25T04:43:17.983 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-25T04:43:18.050 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-25T04:43:18.148 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-25T04:43:18.175 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:43:18.177 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:43:18.230 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-25T04:43:18.231 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-25T04:43:18.232 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-25T04:43:18.235 INFO:tasks.ceph.mon.a:Started 2023-08-25T04:43:18.235 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-25T04:43:18.236 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-25T04:43:18.273 INFO:tasks.ceph.mon.b:Started 2023-08-25T04:43:18.273 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-25T04:43:18.274 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-25T04:43:18.277 INFO:tasks.ceph.mon.c:Started 2023-08-25T04:43:18.278 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-25T04:43:18.279 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-25T04:43:18.279 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-25T04:43:18.282 INFO:tasks.ceph.mgr.y:Started 2023-08-25T04:43:18.283 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-25T04:43:18.283 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-25T04:43:18.285 INFO:tasks.ceph.mgr.x:Started 2023-08-25T04:43:18.286 INFO:tasks.ceph:Setting crush tunables to default 2023-08-25T04:43:18.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd crush tunables default 2023-08-25T04:43:18.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.412+0000 7effe19c0700 1 Processor -- start 2023-08-25T04:43:18.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.413+0000 7effe19c0700 1 -- start start 2023-08-25T04:43:18.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.413+0000 7effe19c0700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 0x7effdc0d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:18.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.413+0000 7effe19c0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effdc0cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:18.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.413+0000 7effe19c0700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effdc0d0060 con 0x7effdc15d370 2023-08-25T04:43:18.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.413+0000 7effe19c0700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effdc0d0620 con 0x7effdc0cde10 2023-08-25T04:43:18.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.413+0000 7effe19c0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effdc0d0340 con 0x7effdc0b0030 2023-08-25T04:43:18.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.413+0000 7effdaffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7effdc15d370 0x7effdc0cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38784/0 (socket says 172.21.15.16:38784) 2023-08-25T04:43:18.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.413+0000 7effdaffd700 1 -- 172.21.15.16:0/178059064 learned_addr learned my addr 172.21.15.16:0/178059064 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:18.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.414+0000 7effdb7fe700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effdc0cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:18.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.414+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 0x7effdc0d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:18.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.414+0000 7effdb7fe700 1 -- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 msgr2=0x7effdc0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-25T04:43:18.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.414+0000 7effdb7fe700 1 -- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 msgr2=0x7effdc0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:43:18.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.414+0000 7effdb7fe700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effdc0cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:43:18.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.414+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 msgr2=0x7effdc0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-25T04:43:18.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.414+0000 7effdb7fe700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effdc0cbe50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:43:18.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.414+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 msgr2=0x7effdc0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:43:18.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.414+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 0x7effdc0d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:43:18.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.414+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 0x7effdc0d19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:43:18.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.615+0000 7effdb7fe700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effdc0cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:18.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.615+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 0x7effdc0d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:18.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.615+0000 7effdb7fe700 1 -- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 msgr2=0x7effdc0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-25T04:43:18.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.615+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 msgr2=0x7effdc0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-25T04:43:18.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.615+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 msgr2=0x7effdc0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:43:18.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.615+0000 7effdb7fe700 1 -- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 msgr2=0x7effdc0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:43:18.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.615+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 0x7effdc0d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:43:18.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.615+0000 7effdb7fe700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effdc0cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:43:18.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.615+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 0x7effdc0d19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T04:43:18.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:18.615+0000 7effdb7fe700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effdc0cbe50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T04:43:19.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.016+0000 7effdb7fe700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effdc0cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.016+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 0x7effdc0d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.016+0000 7effdb7fe700 1 -- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 msgr2=0x7effdc0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-25T04:43:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.016+0000 7effdb7fe700 1 -- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 msgr2=0x7effdc0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:43:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.016+0000 7effdb7fe700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effdc0cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:43:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.016+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 msgr2=0x7effdc0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-25T04:43:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.016+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 msgr2=0x7effdc0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:43:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.016+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 0x7effdc0d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:43:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.016+0000 7effdb7fe700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effdc0cbe50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-25T04:43:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.016+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 0x7effdc0d19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-25T04:43:19.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.817+0000 7effdb7fe700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effdc0cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:19.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.817+0000 7effdb7fe700 1 -- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 msgr2=0x7effdc0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-25T04:43:19.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.817+0000 7effdb7fe700 1 -- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 msgr2=0x7effdc0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:43:19.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.817+0000 7effdb7fe700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effdc0cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:43:19.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.817+0000 7effdb7fe700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effdc0cbe50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-25T04:43:19.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.817+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 0x7effdc0d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:19.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.817+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 msgr2=0x7effdc0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-25T04:43:19.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.817+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 msgr2=0x7effdc0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:43:19.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.817+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 0x7effdc0d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:43:19.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:19.817+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 0x7effdc0d19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-25T04:43:21.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.413+0000 7effd8ff9700 1 -- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 msgr2=0x7effdc0cbe50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:43:21.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.413+0000 7effd8ff9700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effdc0cbe50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:21.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.413+0000 7effd8ff9700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 msgr2=0x7effdc0d19a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:43:21.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.413+0000 7effd8ff9700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.117:3300/0 conn(0x7effdc0cde10 0x7effdc0d19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:21.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.414+0000 7effd8ff9700 1 -- 172.21.15.16:0/178059064 >> v1:172.21.15.16:6789/0 conn(0x7effdc15d370 legacy=0x7effdc0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:21.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.414+0000 7effd8ff9700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 0x7effc80098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:21.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.414+0000 7effd8ff9700 1 -- 172.21.15.16:0/178059064 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effdc0cb650 con 0x7effc8003750 2023-08-25T04:43:21.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.414+0000 7effd8ff9700 1 -- 172.21.15.16:0/178059064 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effdc0d0620 con 0x7effc80073e0 2023-08-25T04:43:21.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.414+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 0x7effc80098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:21.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.414+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 msgr2=0x7effc80098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-25T04:43:21.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.414+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 msgr2=0x7effc80098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:43:21.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.414+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 0x7effc80098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:43:21.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.414+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 0x7effc80098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:43:21.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.615+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 0x7effc80098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:21.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.615+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 msgr2=0x7effc80098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-25T04:43:21.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.615+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 msgr2=0x7effc80098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:43:21.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.615+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 0x7effc80098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:43:21.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:21.615+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 0x7effc80098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T04:43:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:22.016+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 0x7effc80098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:22.016+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 msgr2=0x7effc80098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-25T04:43:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:22.016+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 msgr2=0x7effc80098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:43:22.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:22.016+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 0x7effc80098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:43:22.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:22.016+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 0x7effc80098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-25T04:43:22.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:22.817+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 0x7effc80098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:22.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:22.817+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 msgr2=0x7effc80098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-25T04:43:22.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:22.817+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 msgr2=0x7effc80098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:43:22.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:22.817+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 0x7effc80098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:43:22.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:22.817+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 0x7effc80098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-25T04:43:23.629 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.628+0000 7effd9ffb700 1 -- 172.21.15.16:0/178059064 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34288232 0 0) 0x7effdc0cb650 con 0x7effc8003750 2023-08-25T04:43:23.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.628+0000 7effd9ffb700 1 -- 172.21.15.16:0/178059064 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effc40035b0 con 0x7effc8003750 2023-08-25T04:43:23.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effd9ffb700 1 -- 172.21.15.16:0/178059064 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1076662158 0 0) 0x7effc40035b0 con 0x7effc8003750 2023-08-25T04:43:23.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effd9ffb700 1 -- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 msgr2=0x7effc80098a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:43:23.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effd9ffb700 1 --2- 172.21.15.16:0/178059064 >> v2:172.21.15.16:3300/0 conn(0x7effc80073e0 0x7effc80098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:23.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effd9ffb700 1 -- 172.21.15.16:0/178059064 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc800af80 con 0x7effc8003750 2023-08-25T04:43:23.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effd9ffb700 1 -- 172.21.15.16:0/178059064 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7effd0001870 con 0x7effc8003750 2023-08-25T04:43:23.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effd9ffb700 1 -- 172.21.15.16:0/178059064 >> v1:172.21.15.117:6789/0 conn(0x7effc8003750 legacy=0x7effc8005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:23.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effd9ffb700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effc4003a50 0x7effc4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:23.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effd9ffb700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effc4004850 0x7effc4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:23.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effd9ffb700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effc400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:23.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effd9ffb700 1 -- 172.21.15.16:0/178059064 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effdc0d0620 con 0x7effc4003a50 2023-08-25T04:43:23.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effd9ffb700 1 -- 172.21.15.16:0/178059064 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc4005650 con 0x7effc4004850 2023-08-25T04:43:23.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effd9ffb700 1 -- 172.21.15.16:0/178059064 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc400bf50 con 0x7effdc0b0030 2023-08-25T04:43:23.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effdb7fe700 1 -- 172.21.15.16:0/178059064 reap_dead start 2023-08-25T04:43:23.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effc4004850 0x7effc4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:23.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effdaffd700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effc4003a50 0x7effc4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:23.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.629+0000 7effdb7fe700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effc400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:23.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.630+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 msgr2=0x7effc400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:23.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.630+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effc400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:23.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.630+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effc4003a50 msgr2=0x7effc4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:23.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.630+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effc4003a50 0x7effc4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:23.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.630+0000 7effda7fc700 1 -- 172.21.15.16:0/178059064 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc40035b0 con 0x7effc4004850 2023-08-25T04:43:23.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.630+0000 7effdb7fe700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effc400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:23.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.630+0000 7effda7fc700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effc4004850 0x7effc4004cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7effdc0cef20 tx=0x7effc4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc8c2c08bb102432 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:23.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.630+0000 7effd9ffb700 1 -- 172.21.15.16:0/178059064 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc01e070 con 0x7effc4004850 2023-08-25T04:43:23.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.630+0000 7effd9ffb700 1 -- 172.21.15.16:0/178059064 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effcc00c040 con 0x7effc4004850 2023-08-25T04:43:23.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.630+0000 7effd9ffb700 1 -- 172.21.15.16:0/178059064 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc004270 con 0x7effc4004850 2023-08-25T04:43:23.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.631+0000 7effe19c0700 1 -- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effc4004850 msgr2=0x7effc4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:23.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.631+0000 7effe19c0700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effc4004850 0x7effc4004cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7effdc0cef20 tx=0x7effc4005880 comp rx=0 tx=0).stop 2023-08-25T04:43:23.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.631+0000 7effe19c0700 1 -- 172.21.15.16:0/178059064 shutdown_connections 2023-08-25T04:43:23.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.631+0000 7effe19c0700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effdc0b0030 0x7effc400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:23.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.631+0000 7effe19c0700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effc4004850 0x7effc4004cd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:23.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.631+0000 7effe19c0700 1 --2- 172.21.15.16:0/178059064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effc4003a50 0x7effc4003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:23.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.631+0000 7effe19c0700 1 -- 172.21.15.16:0/178059064 >> 172.21.15.16:0/178059064 conn(0x7effdc0d0e80 msgr2=0x7effdc0d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:23.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.631+0000 7effe19c0700 1 -- 172.21.15.16:0/178059064 shutdown_connections 2023-08-25T04:43:23.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.631+0000 7effe19c0700 1 -- 172.21.15.16:0/178059064 wait complete. 2023-08-25T04:43:23.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.634+0000 7effe19c0700 1 Processor -- start 2023-08-25T04:43:23.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.634+0000 7effe19c0700 1 -- start start 2023-08-25T04:43:23.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.635+0000 7effe19c0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effc4003a50 0x7effdc0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:23.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.635+0000 7effe19c0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc4004850 0x7effdc0c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:23.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.635+0000 7effe19c0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effdc0b0030 0x7effdc15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:23.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.635+0000 7effe19c0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effdc0b45e0 con 0x7effc4003a50 2023-08-25T04:43:23.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.635+0000 7effe19c0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effdc1fae10 con 0x7effdc0b0030 2023-08-25T04:43:23.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.635+0000 7effe19c0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effdc0b6be0 con 0x7effc4004850 2023-08-25T04:43:23.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.635+0000 7effdaffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effc4003a50 0x7effdc0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:23.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.635+0000 7effdaffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effc4003a50 0x7effdc0b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48442/0 (socket says 172.21.15.16:48442) 2023-08-25T04:43:23.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.635+0000 7effdaffd700 1 -- 172.21.15.16:0/1497875321 learned_addr learned my addr 172.21.15.16:0/1497875321 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:23.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.635+0000 7effda7fc700 1 --2- 172.21.15.16:0/1497875321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc4004850 0x7effdc0c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:23.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.635+0000 7effdb7fe700 1 --2- 172.21.15.16:0/1497875321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effdc0b0030 0x7effdc15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:23.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.636+0000 7effdaffd700 1 -- 172.21.15.16:0/1497875321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc4004850 msgr2=0x7effdc0c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:23.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.636+0000 7effdaffd700 1 --2- 172.21.15.16:0/1497875321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc4004850 0x7effdc0c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:23.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.636+0000 7effdaffd700 1 -- 172.21.15.16:0/1497875321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effdc0b0030 msgr2=0x7effdc15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:23.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.636+0000 7effdaffd700 1 --2- 172.21.15.16:0/1497875321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effdc0b0030 0x7effdc15b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:23.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.636+0000 7effdaffd700 1 -- 172.21.15.16:0/1497875321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc0b6620 con 0x7effc4003a50 2023-08-25T04:43:23.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.636+0000 7effdaffd700 1 --2- 172.21.15.16:0/1497875321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effc4003a50 0x7effdc0b3cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7effd000f8e0 tx=0x7effd000fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:23.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.638+0000 7effc3fff700 1 -- 172.21.15.16:0/1497875321 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd00072e0 con 0x7effc4003a50 2023-08-25T04:43:23.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.638+0000 7effc3fff700 1 -- 172.21.15.16:0/1497875321 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd0007440 con 0x7effc4003a50 2023-08-25T04:43:23.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.638+0000 7effe19c0700 1 -- 172.21.15.16:0/1497875321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effdc0b6900 con 0x7effc4003a50 2023-08-25T04:43:23.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.638+0000 7effc3fff700 1 -- 172.21.15.16:0/1497875321 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0005830 con 0x7effc4003a50 2023-08-25T04:43:23.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.638+0000 7effe19c0700 1 -- 172.21.15.16:0/1497875321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effdc0c9b70 con 0x7effc4003a50 2023-08-25T04:43:23.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.638+0000 7effc3fff700 1 -- 172.21.15.16:0/1497875321 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7effd0005c90 con 0x7effc4003a50 2023-08-25T04:43:23.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.639+0000 7effc3fff700 1 -- 172.21.15.16:0/1497875321 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7effd001dda0 con 0x7effc4003a50 2023-08-25T04:43:23.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.639+0000 7effe19c0700 1 -- 172.21.15.16:0/1497875321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effdc0b4850 con 0x7effc4003a50 2023-08-25T04:43:23.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.642+0000 7effc3fff700 1 -- 172.21.15.16:0/1497875321 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7effd001d460 con 0x7effc4003a50 2023-08-25T04:43:23.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.723+0000 7effe19c0700 1 -- 172.21.15.16:0/1497875321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7effdc0cb8e0 con 0x7effc4003a50 2023-08-25T04:43:23.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.725+0000 7effc3fff700 1 -- 172.21.15.16:0/1497875321 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7effd001d600 con 0x7effc4003a50 2023-08-25T04:43:23.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.726+0000 7effe19c0700 1 -- 172.21.15.16:0/1497875321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effc4003a50 msgr2=0x7effdc0b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:23.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.726+0000 7effe19c0700 1 --2- 172.21.15.16:0/1497875321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effc4003a50 0x7effdc0b3cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7effd000f8e0 tx=0x7effd000fbf0 comp rx=0 tx=0).stop 2023-08-25T04:43:23.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.726+0000 7effe19c0700 1 -- 172.21.15.16:0/1497875321 shutdown_connections 2023-08-25T04:43:23.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.726+0000 7effe19c0700 1 --2- 172.21.15.16:0/1497875321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effdc0b0030 0x7effdc15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:23.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.726+0000 7effe19c0700 1 --2- 172.21.15.16:0/1497875321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effc4003a50 0x7effdc0b3cd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:23.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.727+0000 7effe19c0700 1 --2- 172.21.15.16:0/1497875321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effc4004850 0x7effdc0c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:23.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.727+0000 7effe19c0700 1 -- 172.21.15.16:0/1497875321 >> 172.21.15.16:0/1497875321 conn(0x7effdc0d0e80 msgr2=0x7effdc0cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:23.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.727+0000 7effe19c0700 1 -- 172.21.15.16:0/1497875321 shutdown_connections 2023-08-25T04:43:23.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:23.727+0000 7effe19c0700 1 -- 172.21.15.16:0/1497875321 wait complete. 2023-08-25T04:43:23.732 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2023-08-25T04:43:23.741 INFO:tasks.ceph:check_enable_crimson: False 2023-08-25T04:43:23.742 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-25T04:43:23.743 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:43:23.744 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-25T04:43:23.753 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:23.752+0000 7fb873d5e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:43:23.764 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:23.763+0000 7f9a0cb53200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:43:23.772 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:43:23.772 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-25T04:43:23.818 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:23.817+0000 7fb873d5e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:43:23.834 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:23.833+0000 7f9a0cb53200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:43:23.840 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:43:23.841 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-25T04:43:23.893 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:23.892+0000 7fb873d5e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:43:23.910 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:43:23.911 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-25T04:43:23.919 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:23.918+0000 7f9a0cb53200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:43:23.946 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:43:23.946 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-25T04:43:23.971 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:23.971+0000 7fb873d5e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:43:23.972 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:43:23.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-25T04:43:24.004 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:24.003+0000 7f9a0cb53200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:43:24.040 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:43:24.041 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-25T04:43:24.107 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:43:24.108 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-25T04:43:24.123 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:24.122+0000 7fb873d5e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:43:24.148 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f 0 2023-08-25T04:43:24.153 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:24.152+0000 7f9a0cb53200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:43:24.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.307+0000 7f0337e06700 1 Processor -- start 2023-08-25T04:43:24.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.307+0000 7f0337e06700 1 -- start start 2023-08-25T04:43:24.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f0337e06700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f033015d370 0x7f03300d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:24.311 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f0337e06700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03300cde10 0x7f03300cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:24.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f0337e06700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03300d0060 con 0x7f03300b0030 2023-08-25T04:43:24.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f0337e06700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03300d0620 con 0x7f033015d370 2023-08-25T04:43:24.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f0337e06700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03300d0340 con 0x7f03300cde10 2023-08-25T04:43:24.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f03353a1700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f03300b0030 0x7f03300cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:47566/0 (socket says 172.21.15.117:47566) 2023-08-25T04:43:24.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f03363a3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03300cde10 0x7f03300cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:24.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f03353a1700 1 -- 172.21.15.117:0/3298247349 learned_addr learned my addr 172.21.15.117:0/3298247349 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-08-25T04:43:24.312 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f0335ba2700 1 --2- 172.21.15.117:0/3298247349 >> v2:172.21.15.16:3300/0 conn(0x7f033015d370 0x7f03300d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:24.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f0334ba0700 1 -- 172.21.15.117:0/3298247349 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705706589 0 0) 0x7f03300d0060 con 0x7f03300b0030 2023-08-25T04:43:24.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f03363a3700 1 -- 172.21.15.117:0/3298247349 >> v2:172.21.15.16:3300/0 conn(0x7f033015d370 msgr2=0x7f03300d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:24.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f03363a3700 1 --2- 172.21.15.117:0/3298247349 >> v2:172.21.15.16:3300/0 conn(0x7f033015d370 0x7f03300d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f03363a3700 1 -- 172.21.15.117:0/3298247349 >> v1:172.21.15.117:6789/0 conn(0x7f03300b0030 legacy=0x7f03300cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f03363a3700 1 -- 172.21.15.117:0/3298247349 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03300cb650 con 0x7f03300cde10 2023-08-25T04:43:24.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f03363a3700 1 --2- 172.21.15.117:0/3298247349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03300cde10 0x7f03300cbe50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0328009d90 tx=0x7f032800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcc665d2d777daf1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:24.313 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.308+0000 7f0334ba0700 1 -- 172.21.15.117:0/3298247349 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032800e070 con 0x7f03300cde10 2023-08-25T04:43:24.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.309+0000 7f0334ba0700 1 -- 172.21.15.117:0/3298247349 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032800bb20 con 0x7f03300cde10 2023-08-25T04:43:24.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.309+0000 7f0334ba0700 1 -- 172.21.15.117:0/3298247349 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328012430 con 0x7f03300cde10 2023-08-25T04:43:24.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.309+0000 7f0337e06700 1 -- 172.21.15.117:0/3298247349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03300cde10 msgr2=0x7f03300cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.309+0000 7f0337e06700 1 --2- 172.21.15.117:0/3298247349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03300cde10 0x7f03300cbe50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0328009d90 tx=0x7f032800b330 comp rx=0 tx=0).stop 2023-08-25T04:43:24.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.309+0000 7f0337e06700 1 -- 172.21.15.117:0/3298247349 shutdown_connections 2023-08-25T04:43:24.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.309+0000 7f0337e06700 1 --2- 172.21.15.117:0/3298247349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03300cde10 0x7f03300cbe50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.309+0000 7f0337e06700 1 --2- 172.21.15.117:0/3298247349 >> v2:172.21.15.16:3300/0 conn(0x7f033015d370 0x7f03300d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.314 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.309+0000 7f0337e06700 1 -- 172.21.15.117:0/3298247349 >> 172.21.15.117:0/3298247349 conn(0x7f03300d0e80 msgr2=0x7f03300d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:24.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.309+0000 7f0337e06700 1 -- 172.21.15.117:0/3298247349 shutdown_connections 2023-08-25T04:43:24.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.309+0000 7f0337e06700 1 -- 172.21.15.117:0/3298247349 wait complete. 2023-08-25T04:43:24.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.310+0000 7f0337e06700 1 Processor -- start 2023-08-25T04:43:24.315 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.310+0000 7f0337e06700 1 -- start start 2023-08-25T04:43:24.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f0337e06700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03300b0030 0x7f03300aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:24.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f0337e06700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03300cde10 0x7f03300b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:24.319 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f0337e06700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f033015d370 0x7f03300b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:24.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f0337e06700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033014a750 con 0x7f03300cde10 2023-08-25T04:43:24.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f0337e06700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0330149e20 con 0x7f03300b0030 2023-08-25T04:43:24.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f0337e06700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033014a100 con 0x7f033015d370 2023-08-25T04:43:24.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f0335ba2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03300b0030 0x7f03300aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:24.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f0335ba2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03300b0030 0x7f03300aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52458/0 (socket says 172.21.15.117:52458) 2023-08-25T04:43:24.320 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f0335ba2700 1 -- 172.21.15.117:0/3191116406 learned_addr learned my addr 172.21.15.117:0/3191116406 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-25T04:43:24.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f03363a3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f033015d370 0x7f03300b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:24.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f03353a1700 1 --2- 172.21.15.117:0/3191116406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03300cde10 0x7f03300b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:24.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f03363a3700 1 -- 172.21.15.117:0/3191116406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03300b0030 msgr2=0x7f03300aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f03363a3700 1 --2- 172.21.15.117:0/3191116406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03300b0030 0x7f03300aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f03363a3700 1 -- 172.21.15.117:0/3191116406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03300cde10 msgr2=0x7f03300b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.321 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f03363a3700 1 --2- 172.21.15.117:0/3191116406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03300cde10 0x7f03300b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f03363a3700 1 -- 172.21.15.117:0/3191116406 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0328009a70 con 0x7f033015d370 2023-08-25T04:43:24.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.311+0000 7f0335ba2700 1 --2- 172.21.15.117:0/3191116406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03300b0030 0x7f03300aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:24.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.312+0000 7f03363a3700 1 --2- 172.21.15.117:0/3191116406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f033015d370 0x7f03300b67a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0328016000 tx=0x7f0328004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:24.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.312+0000 7f03267fc700 1 -- 172.21.15.117:0/3191116406 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328012430 con 0x7f033015d370 2023-08-25T04:43:24.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.312+0000 7f03267fc700 1 -- 172.21.15.117:0/3191116406 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0328020070 con 0x7f033015d370 2023-08-25T04:43:24.322 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.312+0000 7f03267fc700 1 -- 172.21.15.117:0/3191116406 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328004280 con 0x7f033015d370 2023-08-25T04:43:24.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.312+0000 7f0337e06700 1 -- 172.21.15.117:0/3191116406 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033014a3e0 con 0x7f033015d370 2023-08-25T04:43:24.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.312+0000 7f0337e06700 1 -- 172.21.15.117:0/3191116406 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03300af510 con 0x7f033015d370 2023-08-25T04:43:24.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.312+0000 7f03267fc700 1 -- 172.21.15.117:0/3191116406 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f03280046e0 con 0x7f033015d370 2023-08-25T04:43:24.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.312+0000 7f03267fc700 1 -- 172.21.15.117:0/3191116406 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0328022070 con 0x7f033015d370 2023-08-25T04:43:24.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.313+0000 7f0337e06700 1 -- 172.21.15.117:0/3191116406 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03300af700 con 0x7f033015d370 2023-08-25T04:43:24.324 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.315+0000 7f03267fc700 1 -- 172.21.15.117:0/3191116406 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f032802c060 con 0x7f033015d370 2023-08-25T04:43:24.403 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.403+0000 7f0337e06700 1 -- 172.21.15.117:0/3191116406 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f", "id": 0} v 0) v1 -- 0x7f033014a8c0 con 0x7f033015d370 2023-08-25T04:43:24.407 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.406+0000 7f03267fc700 1 -- 172.21.15.117:0/3191116406 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0328012e20 con 0x7f033015d370 2023-08-25T04:43:24.407 INFO:teuthology.orchestra.run.smithi117.stdout:0 2023-08-25T04:43:24.408 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.407+0000 7f0337e06700 1 -- 172.21.15.117:0/3191116406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f033015d370 msgr2=0x7f03300b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.407+0000 7f0337e06700 1 --2- 172.21.15.117:0/3191116406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f033015d370 0x7f03300b67a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0328016000 tx=0x7f0328004ad0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.407+0000 7f0337e06700 1 -- 172.21.15.117:0/3191116406 shutdown_connections 2023-08-25T04:43:24.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.407+0000 7f0337e06700 1 --2- 172.21.15.117:0/3191116406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f033015d370 0x7f03300b67a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.409 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.407+0000 7f0337e06700 1 --2- 172.21.15.117:0/3191116406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03300b0030 0x7f03300aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.407+0000 7f0337e06700 1 --2- 172.21.15.117:0/3191116406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03300cde10 0x7f03300b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.408+0000 7f0337e06700 1 -- 172.21.15.117:0/3191116406 >> 172.21.15.117:0/3191116406 conn(0x7f03300d0e80 msgr2=0x7f033006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:24.410 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.408+0000 7f0337e06700 1 -- 172.21.15.117:0/3191116406 shutdown_connections 2023-08-25T04:43:24.411 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.408+0000 7f0337e06700 1 -- 172.21.15.117:0/3191116406 wait complete. 2023-08-25T04:43:24.421 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 2464520d-6804-474e-bcfd-11dcccc3f96e 1 2023-08-25T04:43:24.533 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:24.533+0000 7fb873d5e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:43:24.540 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.539+0000 7fd479fb0700 1 Processor -- start 2023-08-25T04:43:24.540 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.539+0000 7fd479fb0700 1 -- start start 2023-08-25T04:43:24.543 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.540+0000 7fd479fb0700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd47406d270 0x7fd47406d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:24.543 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.540+0000 7fd479fb0700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4740ce1c0 con 0x7fd4740ca450 2023-08-25T04:43:24.543 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.540+0000 7fd479fb0700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47406ead0 con 0x7fd47406a340 2023-08-25T04:43:24.543 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.540+0000 7fd479fb0700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4740ca900 con 0x7fd47406d270 2023-08-25T04:43:24.543 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.541+0000 7fd473fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd47406d270 0x7fd47406d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:24.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.541+0000 7fd4737fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd47406a340 0x7fd47406a720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:47578/0 (socket says 172.21.15.117:47578) 2023-08-25T04:43:24.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.541+0000 7fd4737fe700 1 -- 172.21.15.117:0/2542883505 learned_addr learned my addr 172.21.15.117:0/2542883505 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-08-25T04:43:24.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.541+0000 7fd473fff700 1 -- 172.21.15.117:0/2542883505 >> v1:172.21.15.117:6789/0 conn(0x7fd47406a340 legacy=0x7fd47406a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.541+0000 7fd4727fc700 1 -- 172.21.15.117:0/2542883505 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102479225 0 0) 0x7fd47406ead0 con 0x7fd47406a340 2023-08-25T04:43:24.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.541+0000 7fd473fff700 1 -- 172.21.15.117:0/2542883505 >> v1:172.21.15.16:6789/0 conn(0x7fd4740ca450 legacy=0x7fd4740cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.544 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.541+0000 7fd473fff700 1 -- 172.21.15.117:0/2542883505 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4740cdb70 con 0x7fd47406d270 2023-08-25T04:43:24.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.541+0000 7fd473fff700 1 --2- 172.21.15.117:0/2542883505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd47406d270 0x7fd47406d6a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd464009d90 tx=0x7fd46400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=467f4aa884011d1e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:24.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.541+0000 7fd4727fc700 1 -- 172.21.15.117:0/2542883505 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46400e070 con 0x7fd47406d270 2023-08-25T04:43:24.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.541+0000 7fd4727fc700 1 -- 172.21.15.117:0/2542883505 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46400bbd0 con 0x7fd47406d270 2023-08-25T04:43:24.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.541+0000 7fd4727fc700 1 -- 172.21.15.117:0/2542883505 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464012430 con 0x7fd47406d270 2023-08-25T04:43:24.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.542+0000 7fd479fb0700 1 -- 172.21.15.117:0/2542883505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd47406d270 msgr2=0x7fd47406d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.542+0000 7fd479fb0700 1 --2- 172.21.15.117:0/2542883505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd47406d270 0x7fd47406d6a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd464009d90 tx=0x7fd46400b330 comp rx=0 tx=0).stop 2023-08-25T04:43:24.545 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.542+0000 7fd479fb0700 1 -- 172.21.15.117:0/2542883505 shutdown_connections 2023-08-25T04:43:24.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.542+0000 7fd479fb0700 1 --2- 172.21.15.117:0/2542883505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd47406d270 0x7fd47406d6a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.542+0000 7fd479fb0700 1 -- 172.21.15.117:0/2542883505 >> 172.21.15.117:0/2542883505 conn(0x7fd4740cfe00 msgr2=0x7fd4740d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:24.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.542+0000 7fd479fb0700 1 -- 172.21.15.117:0/2542883505 shutdown_connections 2023-08-25T04:43:24.546 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.542+0000 7fd479fb0700 1 -- 172.21.15.117:0/2542883505 wait complete. 2023-08-25T04:43:24.548 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.543+0000 7fd479fb0700 1 Processor -- start 2023-08-25T04:43:24.548 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.544+0000 7fd479fb0700 1 -- start start 2023-08-25T04:43:24.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd479fb0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd47406a340 0x7fd4741410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:24.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd479fb0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd47406d270 0x7fd47413d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:24.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd479fb0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4740ca450 0x7fd474143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:24.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd479fb0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd474142a20 con 0x7fd47406a340 2023-08-25T04:43:24.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd479fb0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4740af300 con 0x7fd4740ca450 2023-08-25T04:43:24.549 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd479fb0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd474141600 con 0x7fd47406d270 2023-08-25T04:43:24.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd473fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4740ca450 0x7fd474143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:24.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd472ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd47406d270 0x7fd47413d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:24.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd473fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4740ca450 0x7fd474143730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52474/0 (socket says 172.21.15.117:52474) 2023-08-25T04:43:24.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd473fff700 1 -- 172.21.15.117:0/1216181098 learned_addr learned my addr 172.21.15.117:0/1216181098 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-25T04:43:24.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd4737fe700 1 --2- 172.21.15.117:0/1216181098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd47406a340 0x7fd4741410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:24.550 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd473fff700 1 -- 172.21.15.117:0/1216181098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd47406d270 msgr2=0x7fd47413d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd473fff700 1 --2- 172.21.15.117:0/1216181098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd47406d270 0x7fd47413d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd473fff700 1 -- 172.21.15.117:0/1216181098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd47406a340 msgr2=0x7fd4741410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd473fff700 1 --2- 172.21.15.117:0/1216181098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd47406a340 0x7fd4741410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd473fff700 1 -- 172.21.15.117:0/1216181098 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd464009a70 con 0x7fd4740ca450 2023-08-25T04:43:24.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd472ffd700 1 --2- 172.21.15.117:0/1216181098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd47406d270 0x7fd47413d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:24.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd473fff700 1 --2- 172.21.15.117:0/1216181098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4740ca450 0x7fd474143730 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd464014040 tx=0x7fd464004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:24.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd46bfff700 1 -- 172.21.15.117:0/1216181098 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46401b810 con 0x7fd4740ca450 2023-08-25T04:43:24.551 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd46bfff700 1 -- 172.21.15.117:0/1216181098 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd464020070 con 0x7fd4740ca450 2023-08-25T04:43:24.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd479fb0700 1 -- 172.21.15.117:0/1216181098 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4741f7370 con 0x7fd4740ca450 2023-08-25T04:43:24.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd46bfff700 1 -- 172.21.15.117:0/1216181098 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46401bbb0 con 0x7fd4740ca450 2023-08-25T04:43:24.552 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.545+0000 7fd479fb0700 1 -- 172.21.15.117:0/1216181098 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4741f7090 con 0x7fd4740ca450 2023-08-25T04:43:24.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.546+0000 7fd46bfff700 1 -- 172.21.15.117:0/1216181098 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd464027780 con 0x7fd4740ca450 2023-08-25T04:43:24.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.546+0000 7fd46bfff700 1 -- 172.21.15.117:0/1216181098 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fd464022070 con 0x7fd4740ca450 2023-08-25T04:43:24.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.546+0000 7fd479fb0700 1 -- 172.21.15.117:0/1216181098 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4740ce6e0 con 0x7fd4740ca450 2023-08-25T04:43:24.553 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.550+0000 7fd46bfff700 1 -- 172.21.15.117:0/1216181098 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd46401bd10 con 0x7fd4740ca450 2023-08-25T04:43:24.555 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:24.554+0000 7f9a0cb53200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:43:24.636 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.636+0000 7fd479fb0700 1 -- 172.21.15.117:0/1216181098 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2464520d-6804-474e-bcfd-11dcccc3f96e", "id": 1} v 0) v1 -- 0x7fd47404ee70 con 0x7fd4740ca450 2023-08-25T04:43:24.640 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.639+0000 7fd46bfff700 1 -- 172.21.15.117:0/1216181098 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2464520d-6804-474e-bcfd-11dcccc3f96e", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd464027ce0 con 0x7fd4740ca450 2023-08-25T04:43:24.640 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-25T04:43:24.641 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.640+0000 7fd479fb0700 1 -- 172.21.15.117:0/1216181098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4740ca450 msgr2=0x7fd474143730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.641 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.640+0000 7fd479fb0700 1 --2- 172.21.15.117:0/1216181098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4740ca450 0x7fd474143730 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd464014040 tx=0x7fd464004ad0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.641 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.640+0000 7fd479fb0700 1 -- 172.21.15.117:0/1216181098 shutdown_connections 2023-08-25T04:43:24.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.640+0000 7fd479fb0700 1 --2- 172.21.15.117:0/1216181098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4740ca450 0x7fd474143730 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.640+0000 7fd479fb0700 1 --2- 172.21.15.117:0/1216181098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd47406a340 0x7fd4741410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.640+0000 7fd479fb0700 1 --2- 172.21.15.117:0/1216181098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd47406d270 0x7fd47413d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.640+0000 7fd479fb0700 1 -- 172.21.15.117:0/1216181098 >> 172.21.15.117:0/1216181098 conn(0x7fd4740cfe00 msgr2=0x7fd4740ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:24.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.640+0000 7fd479fb0700 1 -- 172.21.15.117:0/1216181098 shutdown_connections 2023-08-25T04:43:24.642 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.640+0000 7fd479fb0700 1 -- 172.21.15.117:0/1216181098 wait complete. 2023-08-25T04:43:24.652 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 422719d9-1cb0-4099-8601-162d26fc1fe5 2 2023-08-25T04:43:24.657 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:24.657+0000 7fb873d5e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:43:24.677 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:24.676+0000 7f9a0cb53200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:43:24.742 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:24.741+0000 7fb873d5e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:43:24.773 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.772+0000 7f6c02b28700 1 Processor -- start 2023-08-25T04:43:24.773 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.772+0000 7f6c02b28700 1 -- start start 2023-08-25T04:43:24.775 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6c02b28700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bfc0cf660 0x7f6bfc0cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:24.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6c02b28700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6bfc0b0d20 0x7f6bfc0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:24.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6c02b28700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bfc0cf240 con 0x7f6bfc0b16e0 2023-08-25T04:43:24.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6c02b28700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bfc0cff80 con 0x7f6bfc0b0d20 2023-08-25T04:43:24.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6c02b28700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc0d1580 con 0x7f6bfc0cf660 2023-08-25T04:43:24.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6bfbfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6bfc0b0d20 0x7f6bfc0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:24.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6c008c4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bfc0cf660 0x7f6bfc0cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:24.776 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6bfbfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6bfc0b0d20 0x7f6bfc0b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52478/0 (socket says 172.21.15.117:52478) 2023-08-25T04:43:24.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6c008c4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bfc0cf660 0x7f6bfc0cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:35556/0 (socket says 172.21.15.117:35556) 2023-08-25T04:43:24.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6bfbfff700 1 -- 172.21.15.117:0/1978164870 learned_addr learned my addr 172.21.15.117:0/1978164870 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-25T04:43:24.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6c008c4700 1 -- 172.21.15.117:0/1978164870 >> v2:172.21.15.117:3300/0 conn(0x7f6bfc0b0d20 msgr2=0x7f6bfc0b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:24.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6c008c4700 1 --2- 172.21.15.117:0/1978164870 >> v2:172.21.15.117:3300/0 conn(0x7f6bfc0b0d20 0x7f6bfc0b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6c008c4700 1 -- 172.21.15.117:0/1978164870 >> v1:172.21.15.16:6789/0 conn(0x7f6bfc0b16e0 legacy=0x7f6bfc0cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6c008c4700 1 -- 172.21.15.117:0/1978164870 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc0d1860 con 0x7f6bfc0cf660 2023-08-25T04:43:24.777 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.773+0000 7f6bfbfff700 1 --2- 172.21.15.117:0/1978164870 >> v2:172.21.15.117:3300/0 conn(0x7f6bfc0b0d20 0x7f6bfc0b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:24.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.774+0000 7f6c008c4700 1 --2- 172.21.15.117:0/1978164870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bfc0cf660 0x7f6bfc0cfa40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009820 tx=0x7f6bf0009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e784312d9167d66 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:24.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.774+0000 7f6bfb7fe700 1 -- 172.21.15.117:0/1978164870 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0005e30 con 0x7f6bfc0cf660 2023-08-25T04:43:24.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.774+0000 7f6bfb7fe700 1 -- 172.21.15.117:0/1978164870 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf0006030 con 0x7f6bfc0cf660 2023-08-25T04:43:24.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.774+0000 7f6bfb7fe700 1 -- 172.21.15.117:0/1978164870 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf00063c0 con 0x7f6bfc0cf660 2023-08-25T04:43:24.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.774+0000 7f6c02b28700 1 -- 172.21.15.117:0/1978164870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bfc0cf660 msgr2=0x7f6bfc0cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.774+0000 7f6c02b28700 1 --2- 172.21.15.117:0/1978164870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bfc0cf660 0x7f6bfc0cfa40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009820 tx=0x7f6bf0009b30 comp rx=0 tx=0).stop 2023-08-25T04:43:24.778 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.774+0000 7f6c02b28700 1 -- 172.21.15.117:0/1978164870 shutdown_connections 2023-08-25T04:43:24.779 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.774+0000 7f6c02b28700 1 --2- 172.21.15.117:0/1978164870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bfc0cf660 0x7f6bfc0cfa40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.779 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.774+0000 7f6c02b28700 1 --2- 172.21.15.117:0/1978164870 >> v2:172.21.15.117:3300/0 conn(0x7f6bfc0b0d20 0x7f6bfc0b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.779 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.774+0000 7f6c02b28700 1 -- 172.21.15.117:0/1978164870 >> 172.21.15.117:0/1978164870 conn(0x7f6bfc08af60 msgr2=0x7f6bfc0d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:24.779 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.774+0000 7f6c02b28700 1 -- 172.21.15.117:0/1978164870 shutdown_connections 2023-08-25T04:43:24.779 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.774+0000 7f6c02b28700 1 -- 172.21.15.117:0/1978164870 wait complete. 2023-08-25T04:43:24.780 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:24.778+0000 7f9a0cb53200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:43:24.782 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.776+0000 7f6c02b28700 1 Processor -- start 2023-08-25T04:43:24.782 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.776+0000 7f6c02b28700 1 -- start start 2023-08-25T04:43:24.782 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.776+0000 7f6c02b28700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bfc0b0d20 0x7f6bfc14b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:24.782 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c02b28700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bfc0b16e0 0x7f6bfc06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:24.782 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c02b28700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bfc0cf660 0x7f6bfc0c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:24.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c02b28700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc14b8f0 con 0x7f6bfc0cf660 2023-08-25T04:43:24.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c02b28700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc06d460 con 0x7f6bfc0b0d20 2023-08-25T04:43:24.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c02b28700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc06cea0 con 0x7f6bfc0b16e0 2023-08-25T04:43:24.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c008c4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bfc0b0d20 0x7f6bfc14b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:24.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c008c4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bfc0b0d20 0x7f6bfc14b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52482/0 (socket says 172.21.15.117:52482) 2023-08-25T04:43:24.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c008c4700 1 -- 172.21.15.117:0/848670073 learned_addr learned my addr 172.21.15.117:0/848670073 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-25T04:43:24.783 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6bfbfff700 1 --2- 172.21.15.117:0/848670073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bfc0b16e0 0x7f6bfc06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:24.784 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c010c5700 1 --2- 172.21.15.117:0/848670073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bfc0cf660 0x7f6bfc0c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:24.784 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c008c4700 1 -- 172.21.15.117:0/848670073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bfc0b16e0 msgr2=0x7f6bfc06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.784 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c008c4700 1 --2- 172.21.15.117:0/848670073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bfc0b16e0 0x7f6bfc06bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.784 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c008c4700 1 -- 172.21.15.117:0/848670073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bfc0cf660 msgr2=0x7f6bfc0c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.784 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c008c4700 1 --2- 172.21.15.117:0/848670073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bfc0cf660 0x7f6bfc0c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.784 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c008c4700 1 -- 172.21.15.117:0/848670073 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8009550 con 0x7f6bfc0b0d20 2023-08-25T04:43:24.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c010c5700 1 --2- 172.21.15.117:0/848670073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bfc0cf660 0x7f6bfc0c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:24.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6bfbfff700 1 --2- 172.21.15.117:0/848670073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bfc0b16e0 0x7f6bfc06bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:24.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c008c4700 1 --2- 172.21.15.117:0/848670073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bfc0b0d20 0x7f6bfc14b3b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0000c00 tx=0x7f6bf0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:24.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6bf97fa700 1 -- 172.21.15.117:0/848670073 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf00061a0 con 0x7f6bfc0b0d20 2023-08-25T04:43:24.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6bf97fa700 1 -- 172.21.15.117:0/848670073 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf0020070 con 0x7f6bfc0b0d20 2023-08-25T04:43:24.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c02b28700 1 -- 172.21.15.117:0/848670073 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf0009430 con 0x7f6bfc0b0d20 2023-08-25T04:43:24.785 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6bf97fa700 1 -- 172.21.15.117:0/848670073 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0006560 con 0x7f6bfc0b0d20 2023-08-25T04:43:24.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6c02b28700 1 -- 172.21.15.117:0/848670073 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bfc06b580 con 0x7f6bfc0b0d20 2023-08-25T04:43:24.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6bf97fa700 1 -- 172.21.15.117:0/848670073 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6bf0022030 con 0x7f6bfc0b0d20 2023-08-25T04:43:24.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.777+0000 7f6bf97fa700 1 -- 172.21.15.117:0/848670073 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f6bf002e860 con 0x7f6bfc0b0d20 2023-08-25T04:43:24.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.778+0000 7f6c02b28700 1 -- 172.21.15.117:0/848670073 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bfc04ee70 con 0x7f6bfc0b0d20 2023-08-25T04:43:24.786 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.780+0000 7f6bf97fa700 1 -- 172.21.15.117:0/848670073 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6bf002e4f0 con 0x7f6bfc0b0d20 2023-08-25T04:43:24.837 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:24.837+0000 7fb873d5e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:43:24.864 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:24.863+0000 7f9a0cb53200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:43:24.864 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.863+0000 7f6c02b28700 1 -- 172.21.15.117:0/848670073 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "422719d9-1cb0-4099-8601-162d26fc1fe5", "id": 2} v 0) v1 -- 0x7f6bfc0b1290 con 0x7f6bfc0b0d20 2023-08-25T04:43:24.867 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.866+0000 7f6bf97fa700 1 -- 172.21.15.117:0/848670073 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "422719d9-1cb0-4099-8601-162d26fc1fe5", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6bf002ea90 con 0x7f6bfc0b0d20 2023-08-25T04:43:24.867 INFO:teuthology.orchestra.run.smithi117.stdout:2 2023-08-25T04:43:24.868 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.867+0000 7f6c02b28700 1 -- 172.21.15.117:0/848670073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bfc0b0d20 msgr2=0x7f6bfc14b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:24.868 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.867+0000 7f6c02b28700 1 --2- 172.21.15.117:0/848670073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bfc0b0d20 0x7f6bfc14b3b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0000c00 tx=0x7f6bf0004750 comp rx=0 tx=0).stop 2023-08-25T04:43:24.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.867+0000 7f6c02b28700 1 -- 172.21.15.117:0/848670073 shutdown_connections 2023-08-25T04:43:24.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.867+0000 7f6c02b28700 1 --2- 172.21.15.117:0/848670073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bfc0cf660 0x7f6bfc0c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.867+0000 7f6c02b28700 1 --2- 172.21.15.117:0/848670073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bfc0b0d20 0x7f6bfc14b3b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.867+0000 7f6c02b28700 1 --2- 172.21.15.117:0/848670073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bfc0b16e0 0x7f6bfc06bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:24.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.867+0000 7f6c02b28700 1 -- 172.21.15.117:0/848670073 >> 172.21.15.117:0/848670073 conn(0x7f6bfc08af60 msgr2=0x7f6bfc06f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:24.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.867+0000 7f6c02b28700 1 -- 172.21.15.117:0/848670073 shutdown_connections 2023-08-25T04:43:24.869 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:24.868+0000 7f6c02b28700 1 -- 172.21.15.117:0/848670073 wait complete. 2023-08-25T04:43:24.880 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 135d1dcf-18b7-493d-9468-9aa281436b98 3 2023-08-25T04:43:25.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.042+0000 7f5b5087e700 1 Processor -- start 2023-08-25T04:43:25.043 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.042+0000 7f5b5087e700 1 -- start start 2023-08-25T04:43:25.044 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.043+0000 7f5b5087e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b4c143420 0x7f5b4c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.043+0000 7f5b5087e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4c15b0b0 con 0x7f5b4c070eb0 2023-08-25T04:43:25.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.043+0000 7f5b5087e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4c15a4c0 con 0x7f5b4c0ce510 2023-08-25T04:43:25.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.043+0000 7f5b5087e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c15a780 con 0x7f5b4c143420 2023-08-25T04:43:25.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.043+0000 7f5b4ad9d700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f5b4c0ce510 0x7f5b4c0ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:47606/0 (socket says 172.21.15.117:47606) 2023-08-25T04:43:25.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.043+0000 7f5b4ad9d700 1 -- 172.21.15.117:0/622234993 learned_addr learned my addr 172.21.15.117:0/622234993 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-08-25T04:43:25.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.043+0000 7f5b49d9b700 1 --2- 172.21.15.117:0/622234993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b4c143420 0x7f5b4c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.045 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.043+0000 7f5b4959a700 1 -- 172.21.15.117:0/622234993 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089983216 0 0) 0x7f5b4c15a4c0 con 0x7f5b4c0ce510 2023-08-25T04:43:25.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.043+0000 7f5b4959a700 1 -- 172.21.15.117:0/622234993 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b340035b0 con 0x7f5b4c0ce510 2023-08-25T04:43:25.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.043+0000 7f5b49d9b700 1 -- 172.21.15.117:0/622234993 >> v1:172.21.15.117:6789/0 conn(0x7f5b4c0ce510 legacy=0x7f5b4c0ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.043+0000 7f5b49d9b700 1 -- 172.21.15.117:0/622234993 >> v1:172.21.15.16:6789/0 conn(0x7f5b4c070eb0 legacy=0x7f5b4c071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.043+0000 7f5b49d9b700 1 -- 172.21.15.117:0/622234993 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c15aa60 con 0x7f5b4c143420 2023-08-25T04:43:25.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.043+0000 7f5b49d9b700 1 --2- 172.21.15.117:0/622234993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b4c143420 0x7f5b4c071c00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009870 tx=0x7f5b40009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=619ba590dcb879a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:25.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.043+0000 7f5b4959a700 1 -- 172.21.15.117:0/622234993 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40011830 con 0x7f5b4c143420 2023-08-25T04:43:25.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.044+0000 7f5b4959a700 1 -- 172.21.15.117:0/622234993 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b40011990 con 0x7f5b4c143420 2023-08-25T04:43:25.046 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.044+0000 7f5b4959a700 1 -- 172.21.15.117:0/622234993 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40011d20 con 0x7f5b4c143420 2023-08-25T04:43:25.049 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.044+0000 7f5b5087e700 1 -- 172.21.15.117:0/622234993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b4c143420 msgr2=0x7f5b4c071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.049 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.044+0000 7f5b5087e700 1 --2- 172.21.15.117:0/622234993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b4c143420 0x7f5b4c071c00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009870 tx=0x7f5b40009b80 comp rx=0 tx=0).stop 2023-08-25T04:43:25.049 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.044+0000 7f5b5087e700 1 -- 172.21.15.117:0/622234993 shutdown_connections 2023-08-25T04:43:25.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.044+0000 7f5b5087e700 1 --2- 172.21.15.117:0/622234993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b4c143420 0x7f5b4c071c00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.050 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.044+0000 7f5b5087e700 1 -- 172.21.15.117:0/622234993 >> 172.21.15.117:0/622234993 conn(0x7f5b4c0cfe00 msgr2=0x7f5b4c0d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:25.051 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.044+0000 7f5b5087e700 1 -- 172.21.15.117:0/622234993 shutdown_connections 2023-08-25T04:43:25.052 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.044+0000 7f5b5087e700 1 -- 172.21.15.117:0/622234993 wait complete. 2023-08-25T04:43:25.052 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.046+0000 7f5b5087e700 1 Processor -- start 2023-08-25T04:43:25.052 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.046+0000 7f5b5087e700 1 -- start start 2023-08-25T04:43:25.053 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b5087e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b4c070eb0 0x7f5b4c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.053 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b5087e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b4c0ce510 0x7f5b4c1ef5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.053 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b5087e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b4c143420 0x7f5b4c159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.053 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b5087e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c0b4110 con 0x7f5b4c0ce510 2023-08-25T04:43:25.053 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b5087e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c0b43f0 con 0x7f5b4c143420 2023-08-25T04:43:25.053 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b5087e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c0b46d0 con 0x7f5b4c070eb0 2023-08-25T04:43:25.054 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b4a59c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b4c070eb0 0x7f5b4c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.054 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b4ad9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b4c143420 0x7f5b4c159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.054 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b4a59c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b4c070eb0 0x7f5b4c0b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:35574/0 (socket says 172.21.15.117:35574) 2023-08-25T04:43:25.054 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b4a59c700 1 -- 172.21.15.117:0/1837341063 learned_addr learned my addr 172.21.15.117:0/1837341063 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-25T04:43:25.055 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b49d9b700 1 --2- 172.21.15.117:0/1837341063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b4c0ce510 0x7f5b4c1ef5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.055 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b4a59c700 1 -- 172.21.15.117:0/1837341063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b4c143420 msgr2=0x7f5b4c159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.055 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b4a59c700 1 --2- 172.21.15.117:0/1837341063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b4c143420 0x7f5b4c159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.056 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b4a59c700 1 -- 172.21.15.117:0/1837341063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b4c0ce510 msgr2=0x7f5b4c1ef5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.056 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b4a59c700 1 --2- 172.21.15.117:0/1837341063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b4c0ce510 0x7f5b4c1ef5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.056 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b4a59c700 1 -- 172.21.15.117:0/1837341063 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b400094a0 con 0x7f5b4c070eb0 2023-08-25T04:43:25.057 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.047+0000 7f5b4ad9d700 1 --2- 172.21.15.117:0/1837341063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b4c143420 0x7f5b4c159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:25.057 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.048+0000 7f5b4a59c700 1 --2- 172.21.15.117:0/1837341063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b4c070eb0 0x7f5b4c0b51b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00c4e0 tx=0x7f5b3c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:25.057 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.048+0000 7f5b3affd700 1 -- 172.21.15.117:0/1837341063 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c0052d0 con 0x7f5b4c070eb0 2023-08-25T04:43:25.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.048+0000 7f5b3affd700 1 -- 172.21.15.117:0/1837341063 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c005430 con 0x7f5b4c070eb0 2023-08-25T04:43:25.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.048+0000 7f5b5087e700 1 -- 172.21.15.117:0/1837341063 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4c0b49b0 con 0x7f5b4c070eb0 2023-08-25T04:43:25.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.048+0000 7f5b3affd700 1 -- 172.21.15.117:0/1837341063 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c0038c0 con 0x7f5b4c070eb0 2023-08-25T04:43:25.058 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.048+0000 7f5b5087e700 1 -- 172.21.15.117:0/1837341063 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4c1efaf0 con 0x7f5b4c070eb0 2023-08-25T04:43:25.059 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.048+0000 7f5b3affd700 1 -- 172.21.15.117:0/1837341063 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5b3c003d20 con 0x7f5b4c070eb0 2023-08-25T04:43:25.059 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.048+0000 7f5b3affd700 1 -- 172.21.15.117:0/1837341063 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f5b3c011d60 con 0x7f5b4c070eb0 2023-08-25T04:43:25.059 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.049+0000 7f5b5087e700 1 -- 172.21.15.117:0/1837341063 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4c04ee70 con 0x7f5b4c070eb0 2023-08-25T04:43:25.060 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.051+0000 7f5b3affd700 1 -- 172.21.15.117:0/1837341063 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5b3c017070 con 0x7f5b4c070eb0 2023-08-25T04:43:25.134 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.133+0000 7f5b5087e700 1 -- 172.21.15.117:0/1837341063 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "135d1dcf-18b7-493d-9468-9aa281436b98", "id": 3} v 0) v1 -- 0x7f5b4c152e50 con 0x7f5b4c070eb0 2023-08-25T04:43:25.142 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.142+0000 7f5b3affd700 1 -- 172.21.15.117:0/1837341063 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "135d1dcf-18b7-493d-9468-9aa281436b98", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5b3c011590 con 0x7f5b4c070eb0 2023-08-25T04:43:25.143 INFO:teuthology.orchestra.run.smithi117.stdout:3 2023-08-25T04:43:25.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.142+0000 7f5b5087e700 1 -- 172.21.15.117:0/1837341063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b4c070eb0 msgr2=0x7f5b4c0b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.142+0000 7f5b5087e700 1 --2- 172.21.15.117:0/1837341063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b4c070eb0 0x7f5b4c0b51b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00c4e0 tx=0x7f5b3c00c7f0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.142+0000 7f5b5087e700 1 -- 172.21.15.117:0/1837341063 shutdown_connections 2023-08-25T04:43:25.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.142+0000 7f5b5087e700 1 --2- 172.21.15.117:0/1837341063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b4c143420 0x7f5b4c159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.142+0000 7f5b5087e700 1 --2- 172.21.15.117:0/1837341063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b4c070eb0 0x7f5b4c0b51b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.142+0000 7f5b5087e700 1 --2- 172.21.15.117:0/1837341063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b4c0ce510 0x7f5b4c1ef5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.144 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.142+0000 7f5b5087e700 1 -- 172.21.15.117:0/1837341063 >> 172.21.15.117:0/1837341063 conn(0x7f5b4c0cfe00 msgr2=0x7f5b4c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:25.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.143+0000 7f5b5087e700 1 -- 172.21.15.117:0/1837341063 shutdown_connections 2023-08-25T04:43:25.145 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.143+0000 7f5b5087e700 1 -- 172.21.15.117:0/1837341063 wait complete. 2023-08-25T04:43:25.155 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new f3e91719-3f56-4364-80c3-0d0892ef3caf 4 2023-08-25T04:43:25.274 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.273+0000 7f9d6021b700 1 Processor -- start 2023-08-25T04:43:25.275 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.274+0000 7f9d6021b700 1 -- start start 2023-08-25T04:43:25.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.274+0000 7f9d6021b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d58146560 0x7f9d580d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.274+0000 7f9d6021b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9d5806aa50 0x7f9d5806d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.274+0000 7f9d6021b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d58161810 con 0x7f9d58146aa0 2023-08-25T04:43:25.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.274+0000 7f9d6021b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d58146940 con 0x7f9d5806aa50 2023-08-25T04:43:25.278 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.275+0000 7f9d6021b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580c5400 con 0x7f9d58146560 2023-08-25T04:43:25.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.275+0000 7f9d5dfb7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d58146560 0x7f9d580d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.275+0000 7f9d5dfb7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d58146560 0x7f9d580d0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:35580/0 (socket says 172.21.15.117:35580) 2023-08-25T04:43:25.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.275+0000 7f9d5dfb7700 1 -- 172.21.15.117:0/1969729941 learned_addr learned my addr 172.21.15.117:0/1969729941 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-25T04:43:25.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.275+0000 7f9d5e7b8700 1 --2- 172.21.15.117:0/1969729941 >> v2:172.21.15.16:3300/0 conn(0x7f9d5806aa50 0x7f9d5806d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.275+0000 7f9d5dfb7700 1 -- 172.21.15.117:0/1969729941 >> v2:172.21.15.16:3300/0 conn(0x7f9d5806aa50 msgr2=0x7f9d5806d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:25.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.275+0000 7f9d5dfb7700 1 --2- 172.21.15.117:0/1969729941 >> v2:172.21.15.16:3300/0 conn(0x7f9d5806aa50 0x7f9d5806d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.279 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.275+0000 7f9d5dfb7700 1 -- 172.21.15.117:0/1969729941 >> v1:172.21.15.16:6789/0 conn(0x7f9d58146aa0 legacy=0x7f9d5806a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.275+0000 7f9d5dfb7700 1 -- 172.21.15.117:0/1969729941 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d58161d40 con 0x7f9d58146560 2023-08-25T04:43:25.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.275+0000 7f9d5dfb7700 1 --2- 172.21.15.117:0/1969729941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d58146560 0x7f9d580d0920 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9d540098f0 tx=0x7f9d54009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a785155c86693b43 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:25.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.275+0000 7f9d5cfb5700 1 -- 172.21.15.117:0/1969729941 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5400b8a0 con 0x7f9d58146560 2023-08-25T04:43:25.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.275+0000 7f9d5cfb5700 1 -- 172.21.15.117:0/1969729941 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5400ba00 con 0x7f9d58146560 2023-08-25T04:43:25.280 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.275+0000 7f9d5cfb5700 1 -- 172.21.15.117:0/1969729941 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5400bd90 con 0x7f9d58146560 2023-08-25T04:43:25.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.276+0000 7f9d6021b700 1 -- 172.21.15.117:0/1969729941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d58146560 msgr2=0x7f9d580d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.276+0000 7f9d6021b700 1 --2- 172.21.15.117:0/1969729941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d58146560 0x7f9d580d0920 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9d540098f0 tx=0x7f9d54009c00 comp rx=0 tx=0).stop 2023-08-25T04:43:25.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.276+0000 7f9d6021b700 1 -- 172.21.15.117:0/1969729941 shutdown_connections 2023-08-25T04:43:25.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.276+0000 7f9d6021b700 1 --2- 172.21.15.117:0/1969729941 >> v2:172.21.15.16:3300/0 conn(0x7f9d5806aa50 0x7f9d5806d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.276+0000 7f9d6021b700 1 --2- 172.21.15.117:0/1969729941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d58146560 0x7f9d580d0920 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.281 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.276+0000 7f9d6021b700 1 -- 172.21.15.117:0/1969729941 >> 172.21.15.117:0/1969729941 conn(0x7f9d580cfe00 msgr2=0x7f9d580d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:25.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.276+0000 7f9d6021b700 1 -- 172.21.15.117:0/1969729941 shutdown_connections 2023-08-25T04:43:25.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.276+0000 7f9d6021b700 1 -- 172.21.15.117:0/1969729941 wait complete. 2023-08-25T04:43:25.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.277+0000 7f9d6021b700 1 Processor -- start 2023-08-25T04:43:25.282 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.277+0000 7f9d6021b700 1 -- start start 2023-08-25T04:43:25.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d6021b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5806aa50 0x7f9d580cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.284 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d6021b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d58146560 0x7f9d5813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d6021b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d58146aa0 0x7f9d580b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d6021b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580b4440 con 0x7f9d58146aa0 2023-08-25T04:43:25.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d6021b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580cf920 con 0x7f9d5806aa50 2023-08-25T04:43:25.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d6021b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5813e000 con 0x7f9d58146560 2023-08-25T04:43:25.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d5dfb7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5806aa50 0x7f9d580cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.285 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d5dfb7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5806aa50 0x7f9d580cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52506/0 (socket says 172.21.15.117:52506) 2023-08-25T04:43:25.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d5dfb7700 1 -- 172.21.15.117:0/2422435173 learned_addr learned my addr 172.21.15.117:0/2422435173 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-25T04:43:25.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d5d7b6700 1 --2- 172.21.15.117:0/2422435173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d58146560 0x7f9d5813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d5e7b8700 1 --2- 172.21.15.117:0/2422435173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d58146aa0 0x7f9d580b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d5dfb7700 1 -- 172.21.15.117:0/2422435173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d58146560 msgr2=0x7f9d5813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d5dfb7700 1 --2- 172.21.15.117:0/2422435173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d58146560 0x7f9d5813b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d5dfb7700 1 -- 172.21.15.117:0/2422435173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d58146aa0 msgr2=0x7f9d580b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.286 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d5dfb7700 1 --2- 172.21.15.117:0/2422435173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d58146aa0 0x7f9d580b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d5dfb7700 1 -- 172.21.15.117:0/2422435173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54009550 con 0x7f9d5806aa50 2023-08-25T04:43:25.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.278+0000 7f9d5dfb7700 1 --2- 172.21.15.117:0/2422435173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5806aa50 0x7f9d580cf3e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009c40 tx=0x7f9d54004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:25.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.279+0000 7f9d4e7fc700 1 -- 172.21.15.117:0/2422435173 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54004300 con 0x7f9d5806aa50 2023-08-25T04:43:25.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.279+0000 7f9d4e7fc700 1 -- 172.21.15.117:0/2422435173 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5401e070 con 0x7f9d5806aa50 2023-08-25T04:43:25.287 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.279+0000 7f9d6021b700 1 -- 172.21.15.117:0/2422435173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5813e2e0 con 0x7f9d5806aa50 2023-08-25T04:43:25.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.279+0000 7f9d4e7fc700 1 -- 172.21.15.117:0/2422435173 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540036a0 con 0x7f9d5806aa50 2023-08-25T04:43:25.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.279+0000 7f9d6021b700 1 -- 172.21.15.117:0/2422435173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d580b4690 con 0x7f9d5806aa50 2023-08-25T04:43:25.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.279+0000 7f9d4e7fc700 1 -- 172.21.15.117:0/2422435173 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9d54020030 con 0x7f9d5806aa50 2023-08-25T04:43:25.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.279+0000 7f9d4e7fc700 1 -- 172.21.15.117:0/2422435173 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f9d5402cc20 con 0x7f9d5806aa50 2023-08-25T04:43:25.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.280+0000 7f9d6021b700 1 -- 172.21.15.117:0/2422435173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5806edf0 con 0x7f9d5806aa50 2023-08-25T04:43:25.288 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.283+0000 7f9d4e7fc700 1 -- 172.21.15.117:0/2422435173 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9d54015020 con 0x7f9d5806aa50 2023-08-25T04:43:25.311 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:25.310+0000 7f9a0cb53200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:43:25.338 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:25.337+0000 7fb873d5e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:43:25.367 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.366+0000 7f9d6021b700 1 -- 172.21.15.117:0/2422435173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f3e91719-3f56-4364-80c3-0d0892ef3caf", "id": 4} v 0) v1 -- 0x7f9d5804ee70 con 0x7f9d5806aa50 2023-08-25T04:43:25.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.374+0000 7f9d4e7fc700 1 -- 172.21.15.117:0/2422435173 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f3e91719-3f56-4364-80c3-0d0892ef3caf", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9d5402cde0 con 0x7f9d5806aa50 2023-08-25T04:43:25.376 INFO:teuthology.orchestra.run.smithi117.stdout:4 2023-08-25T04:43:25.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.376+0000 7f9d6021b700 1 -- 172.21.15.117:0/2422435173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5806aa50 msgr2=0x7f9d580cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.376+0000 7f9d6021b700 1 --2- 172.21.15.117:0/2422435173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5806aa50 0x7f9d580cf3e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009c40 tx=0x7f9d54004750 comp rx=0 tx=0).stop 2023-08-25T04:43:25.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.376+0000 7f9d6021b700 1 -- 172.21.15.117:0/2422435173 shutdown_connections 2023-08-25T04:43:25.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.376+0000 7f9d6021b700 1 --2- 172.21.15.117:0/2422435173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d58146aa0 0x7f9d580b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.376+0000 7f9d6021b700 1 --2- 172.21.15.117:0/2422435173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5806aa50 0x7f9d580cf3e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.376+0000 7f9d6021b700 1 --2- 172.21.15.117:0/2422435173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d58146560 0x7f9d5813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.376+0000 7f9d6021b700 1 -- 172.21.15.117:0/2422435173 >> 172.21.15.117:0/2422435173 conn(0x7f9d580cfe00 msgr2=0x7f9d580b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:25.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.376+0000 7f9d6021b700 1 -- 172.21.15.117:0/2422435173 shutdown_connections 2023-08-25T04:43:25.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.376+0000 7f9d6021b700 1 -- 172.21.15.117:0/2422435173 wait complete. 2023-08-25T04:43:25.389 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 8baa272c-97fe-4bb9-b946-caee44901153 5 2023-08-25T04:43:25.510 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.510+0000 7f456829a700 1 Processor -- start 2023-08-25T04:43:25.511 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.510+0000 7f456829a700 1 -- start start 2023-08-25T04:43:25.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f456829a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4560143420 0x7f4560071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f456829a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f45600ce510 0x7f45600ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f456829a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456015b0b0 con 0x7f4560070eb0 2023-08-25T04:43:25.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f456829a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456015a4c0 con 0x7f4560143420 2023-08-25T04:43:25.513 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f456829a700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456015a780 con 0x7f45600ce510 2023-08-25T04:43:25.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f4566837700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f45600ce510 0x7f45600ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f4566837700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f45600ce510 0x7f45600ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52516/0 (socket says 172.21.15.117:52516) 2023-08-25T04:43:25.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f4566837700 1 -- 172.21.15.117:0/3206685540 learned_addr learned my addr 172.21.15.117:0/3206685540 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-25T04:43:25.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f4565835700 1 --2- 172.21.15.117:0/3206685540 >> v2:172.21.15.16:3300/0 conn(0x7f4560143420 0x7f4560071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f4566837700 1 -- 172.21.15.117:0/3206685540 >> v2:172.21.15.16:3300/0 conn(0x7f4560143420 msgr2=0x7f4560071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:25.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f4566837700 1 --2- 172.21.15.117:0/3206685540 >> v2:172.21.15.16:3300/0 conn(0x7f4560143420 0x7f4560071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.514 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f4566837700 1 -- 172.21.15.117:0/3206685540 >> v1:172.21.15.16:6789/0 conn(0x7f4560070eb0 legacy=0x7f4560071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f4566837700 1 -- 172.21.15.117:0/3206685540 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456015aa60 con 0x7f45600ce510 2023-08-25T04:43:25.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f4565835700 1 --2- 172.21.15.117:0/3206685540 >> v2:172.21.15.16:3300/0 conn(0x7f4560143420 0x7f4560071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:25.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f4566837700 1 --2- 172.21.15.117:0/3206685540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600ce510 0x7f45600ce980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4560070c70 tx=0x7f455800d430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=435c5eaf3d283747 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:25.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f4565034700 1 -- 172.21.15.117:0/3206685540 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558010070 con 0x7f45600ce510 2023-08-25T04:43:25.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f4565034700 1 -- 172.21.15.117:0/3206685540 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455800dd90 con 0x7f45600ce510 2023-08-25T04:43:25.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.511+0000 7f4565034700 1 -- 172.21.15.117:0/3206685540 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455800b310 con 0x7f45600ce510 2023-08-25T04:43:25.515 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.512+0000 7f456829a700 1 -- 172.21.15.117:0/3206685540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600ce510 msgr2=0x7f45600ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.516 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.512+0000 7f456829a700 1 --2- 172.21.15.117:0/3206685540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600ce510 0x7f45600ce980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4560070c70 tx=0x7f455800d430 comp rx=0 tx=0).stop 2023-08-25T04:43:25.516 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.512+0000 7f456829a700 1 -- 172.21.15.117:0/3206685540 shutdown_connections 2023-08-25T04:43:25.516 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.512+0000 7f456829a700 1 --2- 172.21.15.117:0/3206685540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600ce510 0x7f45600ce980 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.516 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.512+0000 7f456829a700 1 --2- 172.21.15.117:0/3206685540 >> v2:172.21.15.16:3300/0 conn(0x7f4560143420 0x7f4560071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.517 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.512+0000 7f456829a700 1 -- 172.21.15.117:0/3206685540 >> 172.21.15.117:0/3206685540 conn(0x7f45600cfe00 msgr2=0x7f45600d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:25.517 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.512+0000 7f456829a700 1 -- 172.21.15.117:0/3206685540 shutdown_connections 2023-08-25T04:43:25.517 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.512+0000 7f456829a700 1 -- 172.21.15.117:0/3206685540 wait complete. 2023-08-25T04:43:25.519 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.513+0000 7f456829a700 1 Processor -- start 2023-08-25T04:43:25.520 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.513+0000 7f456829a700 1 -- start start 2023-08-25T04:43:25.520 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f456829a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4560070eb0 0x7f456013c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.520 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f456829a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600ce510 0x7f4560159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.520 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f456829a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4560143420 0x7f456013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.521 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f456829a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456013cde0 con 0x7f4560143420 2023-08-25T04:43:25.521 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f456829a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456013d0b0 con 0x7f45600ce510 2023-08-25T04:43:25.521 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f456829a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456013d390 con 0x7f4560070eb0 2023-08-25T04:43:25.521 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f4565835700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600ce510 0x7f4560159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.521 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f4565835700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600ce510 0x7f4560159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52520/0 (socket says 172.21.15.117:52520) 2023-08-25T04:43:25.522 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f4566036700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4560070eb0 0x7f456013c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.522 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f4565835700 1 -- 172.21.15.117:0/731469138 learned_addr learned my addr 172.21.15.117:0/731469138 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-25T04:43:25.522 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f4566837700 1 --2- 172.21.15.117:0/731469138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4560143420 0x7f456013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.522 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f4565835700 1 -- 172.21.15.117:0/731469138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4560070eb0 msgr2=0x7f456013c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.522 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f4565835700 1 --2- 172.21.15.117:0/731469138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4560070eb0 0x7f456013c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.523 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f4565835700 1 -- 172.21.15.117:0/731469138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4560143420 msgr2=0x7f456013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.523 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f4565835700 1 --2- 172.21.15.117:0/731469138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4560143420 0x7f456013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.523 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f4565835700 1 -- 172.21.15.117:0/731469138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455800bd40 con 0x7f45600ce510 2023-08-25T04:43:25.523 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.514+0000 7f4566036700 1 --2- 172.21.15.117:0/731469138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4560070eb0 0x7f456013c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:25.523 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.515+0000 7f4565835700 1 --2- 172.21.15.117:0/731469138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600ce510 0x7f4560159830 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f455000e760 tx=0x7f455000ea70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:25.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.515+0000 7f4556ffd700 1 -- 172.21.15.117:0/731469138 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455000c070 con 0x7f45600ce510 2023-08-25T04:43:25.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.515+0000 7f4556ffd700 1 -- 172.21.15.117:0/731469138 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4550013610 con 0x7f45600ce510 2023-08-25T04:43:25.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.515+0000 7f4556ffd700 1 -- 172.21.15.117:0/731469138 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45500139c0 con 0x7f45600ce510 2023-08-25T04:43:25.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.515+0000 7f456829a700 1 -- 172.21.15.117:0/731469138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456013b4e0 con 0x7f45600ce510 2023-08-25T04:43:25.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.515+0000 7f456829a700 1 -- 172.21.15.117:0/731469138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4560159d70 con 0x7f45600ce510 2023-08-25T04:43:25.524 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.515+0000 7f4556ffd700 1 -- 172.21.15.117:0/731469138 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f455001c400 con 0x7f45600ce510 2023-08-25T04:43:25.525 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.515+0000 7f4556ffd700 1 -- 172.21.15.117:0/731469138 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f455001b930 con 0x7f45600ce510 2023-08-25T04:43:25.525 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.516+0000 7f456829a700 1 -- 172.21.15.117:0/731469138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456004ee70 con 0x7f45600ce510 2023-08-25T04:43:25.525 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.518+0000 7f4556ffd700 1 -- 172.21.15.117:0/731469138 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4550017020 con 0x7f45600ce510 2023-08-25T04:43:25.601 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.600+0000 7f456829a700 1 -- 172.21.15.117:0/731469138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8baa272c-97fe-4bb9-b946-caee44901153", "id": 5} v 0) v1 -- 0x7f45600719e0 con 0x7f45600ce510 2023-08-25T04:43:25.609 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.608+0000 7f4556ffd700 1 -- 172.21.15.117:0/731469138 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8baa272c-97fe-4bb9-b946-caee44901153", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f455002b0b0 con 0x7f45600ce510 2023-08-25T04:43:25.609 INFO:teuthology.orchestra.run.smithi117.stdout:5 2023-08-25T04:43:25.610 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.609+0000 7f456829a700 1 -- 172.21.15.117:0/731469138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600ce510 msgr2=0x7f4560159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.610 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.609+0000 7f456829a700 1 --2- 172.21.15.117:0/731469138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600ce510 0x7f4560159830 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f455000e760 tx=0x7f455000ea70 comp rx=0 tx=0).stop 2023-08-25T04:43:25.611 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.609+0000 7f456829a700 1 -- 172.21.15.117:0/731469138 shutdown_connections 2023-08-25T04:43:25.611 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.609+0000 7f456829a700 1 --2- 172.21.15.117:0/731469138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4560143420 0x7f456013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.611 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.609+0000 7f456829a700 1 --2- 172.21.15.117:0/731469138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4560070eb0 0x7f456013c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.611 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.609+0000 7f456829a700 1 --2- 172.21.15.117:0/731469138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600ce510 0x7f4560159830 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.611 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.609+0000 7f456829a700 1 -- 172.21.15.117:0/731469138 >> 172.21.15.117:0/731469138 conn(0x7f45600cfe00 msgr2=0x7f45600b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:25.611 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.609+0000 7f456829a700 1 -- 172.21.15.117:0/731469138 shutdown_connections 2023-08-25T04:43:25.612 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.609+0000 7f456829a700 1 -- 172.21.15.117:0/731469138 wait complete. 2023-08-25T04:43:25.621 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new a0217dcf-afc7-4bad-8df9-e1de4dddab64 6 2023-08-25T04:43:25.756 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.753+0000 7ff9e0c55700 1 Processor -- start 2023-08-25T04:43:25.756 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.754+0000 7ff9e0c55700 1 -- start start 2023-08-25T04:43:25.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9e0c55700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff9dc165190 0x7ff9dc0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9e0c55700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9dc165570 0x7ff9dc1659f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9e0c55700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9dc0c25e0 con 0x7ff9dc161b30 2023-08-25T04:43:25.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9e0c55700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9dc0ccf50 con 0x7ff9dc165190 2023-08-25T04:43:25.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9e0c55700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0cd230 con 0x7ff9dc165570 2023-08-25T04:43:25.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9d9d9b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9dc165570 0x7ff9dc1659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.757 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9d9d9b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9dc165570 0x7ff9dc1659f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:35606/0 (socket says 172.21.15.117:35606) 2023-08-25T04:43:25.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9d9d9b700 1 -- 172.21.15.117:0/3499923174 learned_addr learned my addr 172.21.15.117:0/3499923174 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-25T04:43:25.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9da59c700 1 --2- 172.21.15.117:0/3499923174 >> v2:172.21.15.16:3300/0 conn(0x7ff9dc165190 0x7ff9dc0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9d959a700 1 -- 172.21.15.117:0/3499923174 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743693771 0 0) 0x7ff9dc0c25e0 con 0x7ff9dc161b30 2023-08-25T04:43:25.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9d959a700 1 -- 172.21.15.117:0/3499923174 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9c80035b0 con 0x7ff9dc161b30 2023-08-25T04:43:25.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9d9d9b700 1 -- 172.21.15.117:0/3499923174 >> v2:172.21.15.16:3300/0 conn(0x7ff9dc165190 msgr2=0x7ff9dc0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:25.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9d9d9b700 1 --2- 172.21.15.117:0/3499923174 >> v2:172.21.15.16:3300/0 conn(0x7ff9dc165190 0x7ff9dc0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9d9d9b700 1 -- 172.21.15.117:0/3499923174 >> v1:172.21.15.117:6789/0 conn(0x7ff9dc161b30 legacy=0x7ff9dc161fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.758 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.755+0000 7ff9d9d9b700 1 -- 172.21.15.117:0/3499923174 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc0cd510 con 0x7ff9dc165570 2023-08-25T04:43:25.759 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.756+0000 7ff9d9d9b700 1 --2- 172.21.15.117:0/3499923174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9dc165570 0x7ff9dc1659f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40098f0 tx=0x7ff9c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2460fc002532544 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:25.760 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.756+0000 7ff9d959a700 1 -- 172.21.15.117:0/3499923174 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4011830 con 0x7ff9dc165570 2023-08-25T04:43:25.760 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.756+0000 7ff9d959a700 1 -- 172.21.15.117:0/3499923174 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c4011990 con 0x7ff9dc165570 2023-08-25T04:43:25.760 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.756+0000 7ff9d959a700 1 -- 172.21.15.117:0/3499923174 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4011d20 con 0x7ff9dc165570 2023-08-25T04:43:25.760 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.756+0000 7ff9e0c55700 1 -- 172.21.15.117:0/3499923174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9dc165570 msgr2=0x7ff9dc1659f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.757+0000 7ff9e0c55700 1 --2- 172.21.15.117:0/3499923174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9dc165570 0x7ff9dc1659f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40098f0 tx=0x7ff9c4009c00 comp rx=0 tx=0).stop 2023-08-25T04:43:25.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.757+0000 7ff9e0c55700 1 -- 172.21.15.117:0/3499923174 shutdown_connections 2023-08-25T04:43:25.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.757+0000 7ff9e0c55700 1 --2- 172.21.15.117:0/3499923174 >> v2:172.21.15.16:3300/0 conn(0x7ff9dc165190 0x7ff9dc0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.757+0000 7ff9e0c55700 1 --2- 172.21.15.117:0/3499923174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9dc165570 0x7ff9dc1659f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.757+0000 7ff9e0c55700 1 -- 172.21.15.117:0/3499923174 >> 172.21.15.117:0/3499923174 conn(0x7ff9dc0cecc0 msgr2=0x7ff9dc0cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:25.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.757+0000 7ff9e0c55700 1 -- 172.21.15.117:0/3499923174 shutdown_connections 2023-08-25T04:43:25.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.757+0000 7ff9e0c55700 1 -- 172.21.15.117:0/3499923174 wait complete. 2023-08-25T04:43:25.761 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.759+0000 7ff9e0c55700 1 Processor -- start 2023-08-25T04:43:25.762 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.759+0000 7ff9e0c55700 1 -- start start 2023-08-25T04:43:25.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.760+0000 7ff9e0c55700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9dc161b30 0x7ff9dc14f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.760+0000 7ff9e0c55700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9dc165190 0x7ff9dc0c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.760+0000 7ff9e0c55700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9dc165570 0x7ff9dc0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:25.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.760+0000 7ff9e0c55700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc161890 con 0x7ff9dc161b30 2023-08-25T04:43:25.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.760+0000 7ff9e0c55700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc1615b0 con 0x7ff9dc165570 2023-08-25T04:43:25.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.760+0000 7ff9e0c55700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc14e6a0 con 0x7ff9dc165190 2023-08-25T04:43:25.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.760+0000 7ff9da59c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9dc161b30 0x7ff9dc14f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.760+0000 7ff9dad9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9dc165570 0x7ff9dc0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.760+0000 7ff9da59c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9dc161b30 0x7ff9dc14f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.117:59720/0 (socket says 172.21.15.117:59720) 2023-08-25T04:43:25.764 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.760+0000 7ff9da59c700 1 -- 172.21.15.117:0/2751608108 learned_addr learned my addr 172.21.15.117:0/2751608108 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-25T04:43:25.765 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.760+0000 7ff9d9d9b700 1 --2- 172.21.15.117:0/2751608108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9dc165190 0x7ff9dc0c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:25.765 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.761+0000 7ff9da59c700 1 -- 172.21.15.117:0/2751608108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9dc165190 msgr2=0x7ff9dc0c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.765 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.761+0000 7ff9da59c700 1 --2- 172.21.15.117:0/2751608108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9dc165190 0x7ff9dc0c5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.765 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.761+0000 7ff9da59c700 1 -- 172.21.15.117:0/2751608108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9dc165570 msgr2=0x7ff9dc0c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.765 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.761+0000 7ff9da59c700 1 --2- 172.21.15.117:0/2751608108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9dc165570 0x7ff9dc0c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.765 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.761+0000 7ff9da59c700 1 -- 172.21.15.117:0/2751608108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4009550 con 0x7ff9dc161b30 2023-08-25T04:43:25.765 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.761+0000 7ff9dad9d700 1 --2- 172.21.15.117:0/2751608108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9dc165570 0x7ff9dc0c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:25.765 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.761+0000 7ff9d9d9b700 1 --2- 172.21.15.117:0/2751608108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9dc165190 0x7ff9dc0c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:25.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.761+0000 7ff9da59c700 1 --2- 172.21.15.117:0/2751608108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9dc161b30 0x7ff9dc14f180 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400efc0 tx=0x7ff9d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:25.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.761+0000 7ff9d2ffd700 1 -- 172.21.15.117:0/2751608108 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d400cd10 con 0x7ff9dc161b30 2023-08-25T04:43:25.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.761+0000 7ff9d2ffd700 1 -- 172.21.15.117:0/2751608108 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d400f040 con 0x7ff9dc161b30 2023-08-25T04:43:25.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.761+0000 7ff9d2ffd700 1 -- 172.21.15.117:0/2751608108 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d40146a0 con 0x7ff9dc161b30 2023-08-25T04:43:25.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.761+0000 7ff9e0c55700 1 -- 172.21.15.117:0/2751608108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9dc14e980 con 0x7ff9dc161b30 2023-08-25T04:43:25.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.761+0000 7ff9e0c55700 1 -- 172.21.15.117:0/2751608108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9dc14f6c0 con 0x7ff9dc161b30 2023-08-25T04:43:25.766 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.762+0000 7ff9d2ffd700 1 -- 172.21.15.117:0/2751608108 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff9d4014b00 con 0x7ff9dc161b30 2023-08-25T04:43:25.767 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.762+0000 7ff9d2ffd700 1 -- 172.21.15.117:0/2751608108 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7ff9d40139d0 con 0x7ff9dc161b30 2023-08-25T04:43:25.767 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.763+0000 7ff9e0c55700 1 -- 172.21.15.117:0/2751608108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9dc0cb5b0 con 0x7ff9dc161b30 2023-08-25T04:43:25.768 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.768+0000 7ff9d2ffd700 1 -- 172.21.15.117:0/2751608108 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff9d4018020 con 0x7ff9dc161b30 2023-08-25T04:43:25.866 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.865+0000 7ff9e0c55700 1 -- 172.21.15.117:0/2751608108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a0217dcf-afc7-4bad-8df9-e1de4dddab64", "id": 6} v 0) v1 -- 0x7ff9dc14eea0 con 0x7ff9dc161b30 2023-08-25T04:43:25.868 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.868+0000 7ff9d2ffd700 1 -- 172.21.15.117:0/2751608108 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a0217dcf-afc7-4bad-8df9-e1de4dddab64", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff9dc14eea0 con 0x7ff9dc161b30 2023-08-25T04:43:25.869 INFO:teuthology.orchestra.run.smithi117.stdout:6 2023-08-25T04:43:25.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.869+0000 7ff9e0c55700 1 -- 172.21.15.117:0/2751608108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9dc161b30 msgr2=0x7ff9dc14f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:25.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.869+0000 7ff9e0c55700 1 --2- 172.21.15.117:0/2751608108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9dc161b30 0x7ff9dc14f180 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400efc0 tx=0x7ff9d400c3a0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.869+0000 7ff9e0c55700 1 -- 172.21.15.117:0/2751608108 shutdown_connections 2023-08-25T04:43:25.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.869+0000 7ff9e0c55700 1 --2- 172.21.15.117:0/2751608108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9dc165570 0x7ff9dc0c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.869+0000 7ff9e0c55700 1 --2- 172.21.15.117:0/2751608108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9dc161b30 0x7ff9dc14f180 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.869+0000 7ff9e0c55700 1 --2- 172.21.15.117:0/2751608108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9dc165190 0x7ff9dc0c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:25.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.869+0000 7ff9e0c55700 1 -- 172.21.15.117:0/2751608108 >> 172.21.15.117:0/2751608108 conn(0x7ff9dc0cecc0 msgr2=0x7ff9dc0715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:25.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.869+0000 7ff9e0c55700 1 -- 172.21.15.117:0/2751608108 shutdown_connections 2023-08-25T04:43:25.871 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:25.869+0000 7ff9e0c55700 1 -- 172.21.15.117:0/2751608108 wait complete. 2023-08-25T04:43:25.883 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 8729cb4b-5082-43ab-a73f-41df6aa7d84f 7 2023-08-25T04:43:25.983 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:25.982+0000 7f9a0cb53200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-25T04:43:26.002 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:26.001+0000 7fb873d5e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-25T04:43:26.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.005+0000 7f75806d7700 1 Processor -- start 2023-08-25T04:43:26.006 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.005+0000 7f75806d7700 1 -- start start 2023-08-25T04:43:26.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.006+0000 7f75806d7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7578146560 0x7f75780d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:26.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.006+0000 7f75806d7700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f757806aa50 0x7f757806d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:26.008 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.006+0000 7f75806d7700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7578161810 con 0x7f7578146aa0 2023-08-25T04:43:26.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.006+0000 7f75806d7700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7578146940 con 0x7f757806aa50 2023-08-25T04:43:26.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.006+0000 7f75806d7700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75780c5400 con 0x7f7578146560 2023-08-25T04:43:26.009 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.006+0000 7f757e473700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7578146560 0x7f75780d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:26.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.006+0000 7f757e473700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7578146560 0x7f75780d0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:35616/0 (socket says 172.21.15.117:35616) 2023-08-25T04:43:26.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.007+0000 7f757e473700 1 -- 172.21.15.117:0/1850009035 learned_addr learned my addr 172.21.15.117:0/1850009035 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-25T04:43:26.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.007+0000 7f757ec74700 1 --2- 172.21.15.117:0/1850009035 >> v2:172.21.15.117:3300/0 conn(0x7f757806aa50 0x7f757806d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:26.010 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.007+0000 7f757e473700 1 -- 172.21.15.117:0/1850009035 >> v2:172.21.15.117:3300/0 conn(0x7f757806aa50 msgr2=0x7f757806d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:26.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.007+0000 7f757e473700 1 --2- 172.21.15.117:0/1850009035 >> v2:172.21.15.117:3300/0 conn(0x7f757806aa50 0x7f757806d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.011 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.007+0000 7f757e473700 1 -- 172.21.15.117:0/1850009035 >> v1:172.21.15.117:6789/0 conn(0x7f7578146aa0 legacy=0x7f757806a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:26.012 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.007+0000 7f757e473700 1 -- 172.21.15.117:0/1850009035 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7578161d40 con 0x7f7578146560 2023-08-25T04:43:26.012 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.007+0000 7f757ec74700 1 --2- 172.21.15.117:0/1850009035 >> v2:172.21.15.117:3300/0 conn(0x7f757806aa50 0x7f757806d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:26.012 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.007+0000 7f757e473700 1 --2- 172.21.15.117:0/1850009035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7578146560 0x7f75780d0920 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f75740098f0 tx=0x7f7574009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6daa5f3861fb2891 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:26.013 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.007+0000 7f757d471700 1 -- 172.21.15.117:0/1850009035 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574011830 con 0x7f7578146560 2023-08-25T04:43:26.014 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.007+0000 7f757d471700 1 -- 172.21.15.117:0/1850009035 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7574011990 con 0x7f7578146560 2023-08-25T04:43:26.014 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.007+0000 7f757d471700 1 -- 172.21.15.117:0/1850009035 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574011d20 con 0x7f7578146560 2023-08-25T04:43:26.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.008+0000 7f75806d7700 1 -- 172.21.15.117:0/1850009035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7578146560 msgr2=0x7f75780d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:26.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.008+0000 7f75806d7700 1 --2- 172.21.15.117:0/1850009035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7578146560 0x7f75780d0920 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f75740098f0 tx=0x7f7574009c00 comp rx=0 tx=0).stop 2023-08-25T04:43:26.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.008+0000 7f75806d7700 1 -- 172.21.15.117:0/1850009035 shutdown_connections 2023-08-25T04:43:26.018 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.008+0000 7f75806d7700 1 --2- 172.21.15.117:0/1850009035 >> v2:172.21.15.117:3300/0 conn(0x7f757806aa50 0x7f757806d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.008+0000 7f75806d7700 1 --2- 172.21.15.117:0/1850009035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7578146560 0x7f75780d0920 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.008+0000 7f75806d7700 1 -- 172.21.15.117:0/1850009035 >> 172.21.15.117:0/1850009035 conn(0x7f75780cfe00 msgr2=0x7f75780d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:26.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.008+0000 7f75806d7700 1 -- 172.21.15.117:0/1850009035 shutdown_connections 2023-08-25T04:43:26.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.008+0000 7f75806d7700 1 -- 172.21.15.117:0/1850009035 wait complete. 2023-08-25T04:43:26.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.009+0000 7f75806d7700 1 Processor -- start 2023-08-25T04:43:26.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.009+0000 7f75806d7700 1 -- start start 2023-08-25T04:43:26.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f75806d7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f757806aa50 0x7f75780b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:26.019 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f75806d7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7578146560 0x7f757813d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:26.020 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f75806d7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7578146aa0 0x7f75781f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:26.020 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f75806d7700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757813d560 con 0x7f757806aa50 2023-08-25T04:43:26.020 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f75806d7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75780ad890 con 0x7f7578146560 2023-08-25T04:43:26.020 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f75806d7700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757813d790 con 0x7f7578146aa0 2023-08-25T04:43:26.021 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f757ec74700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7578146aa0 0x7f75781f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:26.022 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f757ec74700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7578146aa0 0x7f75781f6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:35624/0 (socket says 172.21.15.117:35624) 2023-08-25T04:43:26.022 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f757dc72700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7578146560 0x7f757813d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:26.022 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f757ec74700 1 -- 172.21.15.117:0/1381345151 learned_addr learned my addr 172.21.15.117:0/1381345151 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-08-25T04:43:26.022 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f757e473700 1 --2- 172.21.15.117:0/1381345151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f757806aa50 0x7f75780b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:26.023 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f757ec74700 1 -- 172.21.15.117:0/1381345151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7578146560 msgr2=0x7f757813d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:26.023 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f757ec74700 1 --2- 172.21.15.117:0/1381345151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7578146560 0x7f757813d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.023 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f757ec74700 1 -- 172.21.15.117:0/1381345151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f757806aa50 msgr2=0x7f75780b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:26.023 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f757ec74700 1 --2- 172.21.15.117:0/1381345151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f757806aa50 0x7f75780b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.023 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f757ec74700 1 -- 172.21.15.117:0/1381345151 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7570009a70 con 0x7f7578146aa0 2023-08-25T04:43:26.023 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f757ec74700 1 --2- 172.21.15.117:0/1381345151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7578146aa0 0x7f75781f6440 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f757000efc0 tx=0x7f757000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:26.023 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f756effd700 1 -- 172.21.15.117:0/1381345151 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000ca90 con 0x7f7578146aa0 2023-08-25T04:43:26.023 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f756effd700 1 -- 172.21.15.117:0/1381345151 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757000f040 con 0x7f7578146aa0 2023-08-25T04:43:26.024 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f756effd700 1 -- 172.21.15.117:0/1381345151 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000ce30 con 0x7f7578146aa0 2023-08-25T04:43:26.024 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.010+0000 7f75806d7700 1 -- 172.21.15.117:0/1381345151 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7574009550 con 0x7f7578146aa0 2023-08-25T04:43:26.024 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.011+0000 7f75806d7700 1 -- 172.21.15.117:0/1381345151 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75780addc0 con 0x7f7578146aa0 2023-08-25T04:43:26.024 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.011+0000 7f756effd700 1 -- 172.21.15.117:0/1381345151 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7570003d20 con 0x7f7578146aa0 2023-08-25T04:43:26.024 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.011+0000 7f756effd700 1 -- 172.21.15.117:0/1381345151 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f7570014480 con 0x7f7578146aa0 2023-08-25T04:43:26.024 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.011+0000 7f75806d7700 1 -- 172.21.15.117:0/1381345151 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757806edf0 con 0x7f7578146aa0 2023-08-25T04:43:26.024 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.014+0000 7f756effd700 1 -- 172.21.15.117:0/1381345151 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f7570018030 con 0x7f7578146aa0 2023-08-25T04:43:26.054 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:26.053+0000 7f9a0cb53200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:43:26.074 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:26.073+0000 7fb873d5e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:43:26.098 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.097+0000 7f75806d7700 1 -- 172.21.15.117:0/1381345151 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8729cb4b-5082-43ab-a73f-41df6aa7d84f", "id": 7} v 0) v1 -- 0x7f757804ee70 con 0x7f7578146aa0 2023-08-25T04:43:26.103 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.103+0000 7f756effd700 1 -- 172.21.15.117:0/1381345151 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8729cb4b-5082-43ab-a73f-41df6aa7d84f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7570003fd0 con 0x7f7578146aa0 2023-08-25T04:43:26.105 INFO:teuthology.orchestra.run.smithi117.stdout:7 2023-08-25T04:43:26.107 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.104+0000 7f75806d7700 1 -- 172.21.15.117:0/1381345151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7578146aa0 msgr2=0x7f75781f6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:26.107 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.104+0000 7f75806d7700 1 --2- 172.21.15.117:0/1381345151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7578146aa0 0x7f75781f6440 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f757000efc0 tx=0x7f757000c3a0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.108 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.104+0000 7f75806d7700 1 -- 172.21.15.117:0/1381345151 shutdown_connections 2023-08-25T04:43:26.108 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.104+0000 7f75806d7700 1 --2- 172.21.15.117:0/1381345151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7578146aa0 0x7f75781f6440 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.104+0000 7f75806d7700 1 --2- 172.21.15.117:0/1381345151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f757806aa50 0x7f75780b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.109 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.104+0000 7f75806d7700 1 --2- 172.21.15.117:0/1381345151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7578146560 0x7f757813d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.104+0000 7f75806d7700 1 -- 172.21.15.117:0/1381345151 >> 172.21.15.117:0/1381345151 conn(0x7f75780cfe00 msgr2=0x7f75780d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:26.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.104+0000 7f75806d7700 1 -- 172.21.15.117:0/1381345151 shutdown_connections 2023-08-25T04:43:26.110 INFO:teuthology.orchestra.run.smithi117.stderr:2023-08-25T04:43:26.104+0000 7f75806d7700 1 -- 172.21.15.117:0/1381345151 wait complete. 2023-08-25T04:43:26.116 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-25T04:43:26.117 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-25T04:43:26.120 INFO:tasks.ceph.osd.0:Started 2023-08-25T04:43:26.120 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-25T04:43:26.120 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-25T04:43:26.123 INFO:tasks.ceph.osd.1:Started 2023-08-25T04:43:26.123 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-25T04:43:26.124 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-25T04:43:26.126 INFO:tasks.ceph.osd.2:Started 2023-08-25T04:43:26.127 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-25T04:43:26.128 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-25T04:43:26.130 INFO:tasks.ceph.osd.3:Started 2023-08-25T04:43:26.131 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-25T04:43:26.132 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-25T04:43:26.134 INFO:tasks.ceph.osd.4:Started 2023-08-25T04:43:26.134 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-25T04:43:26.135 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-25T04:43:26.137 INFO:tasks.ceph.osd.5:Started 2023-08-25T04:43:26.137 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-25T04:43:26.137 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-25T04:43:26.139 INFO:tasks.ceph.osd.6:Started 2023-08-25T04:43:26.139 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-25T04:43:26.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-25T04:43:26.141 INFO:tasks.ceph.osd.7:Started 2023-08-25T04:43:26.142 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:43:26.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.302+0000 7f0c01f87700 1 Processor -- start 2023-08-25T04:43:26.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.302+0000 7f0c01f87700 1 -- start start 2023-08-25T04:43:26.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.303+0000 7f0c01f87700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0bfc0b3170 0x7f0bfc0701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:26.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.303+0000 7f0c01f87700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bfc0d0970 0x7f0bfc0b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:26.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.303+0000 7f0c01f87700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bfc0cd340 con 0x7f0bfc15b380 2023-08-25T04:43:26.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.303+0000 7f0c01f87700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bfc0cd900 con 0x7f0bfc0b3170 2023-08-25T04:43:26.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.303+0000 7f0c01f87700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc070730 con 0x7f0bfc0d0970 2023-08-25T04:43:26.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.303+0000 7f0bfb7fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0bfc15b380 0x7f0bfc0b2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38888/0 (socket says 172.21.15.16:38888) 2023-08-25T04:43:26.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.303+0000 7f0bfb7fe700 1 -- 172.21.15.16:0/2695060939 learned_addr learned my addr 172.21.15.16:0/2695060939 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:26.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.303+0000 7f0bfaffd700 1 --2- 172.21.15.16:0/2695060939 >> v2:172.21.15.117:3300/0 conn(0x7f0bfc0b3170 0x7f0bfc0701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:26.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.304+0000 7f0bfbfff700 1 --2- 172.21.15.16:0/2695060939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bfc0d0970 0x7f0bfc0b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:26.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.304+0000 7f0bfa7fc700 1 -- 172.21.15.16:0/2695060939 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849260210 0 0) 0x7f0bfc0cd340 con 0x7f0bfc15b380 2023-08-25T04:43:26.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.304+0000 7f0bfa7fc700 1 -- 172.21.15.16:0/2695060939 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0be80035b0 con 0x7f0bfc15b380 2023-08-25T04:43:26.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.304+0000 7f0bfaffd700 1 -- 172.21.15.16:0/2695060939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bfc0d0970 msgr2=0x7f0bfc0b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:26.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.304+0000 7f0bfaffd700 1 --2- 172.21.15.16:0/2695060939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bfc0d0970 0x7f0bfc0b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.304+0000 7f0bfaffd700 1 -- 172.21.15.16:0/2695060939 >> v1:172.21.15.16:6789/0 conn(0x7f0bfc15b380 legacy=0x7f0bfc0b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.304+0000 7f0bfaffd700 1 -- 172.21.15.16:0/2695060939 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc0cd620 con 0x7f0bfc0b3170 2023-08-25T04:43:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.304+0000 7f0bfbfff700 1 --2- 172.21.15.16:0/2695060939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bfc0d0970 0x7f0bfc0b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.304+0000 7f0bfaffd700 1 --2- 172.21.15.16:0/2695060939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bfc0b3170 0x7f0bfc0701f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009840 tx=0x7f0be4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c551906dc698864 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.304+0000 7f0bfa7fc700 1 -- 172.21.15.16:0/2695060939 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4011830 con 0x7f0bfc0b3170 2023-08-25T04:43:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.304+0000 7f0bfa7fc700 1 -- 172.21.15.16:0/2695060939 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be4011990 con 0x7f0bfc0b3170 2023-08-25T04:43:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.304+0000 7f0bfa7fc700 1 -- 172.21.15.16:0/2695060939 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4011d20 con 0x7f0bfc0b3170 2023-08-25T04:43:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.305+0000 7f0c01f87700 1 -- 172.21.15.16:0/2695060939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bfc0b3170 msgr2=0x7f0bfc0701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.305+0000 7f0c01f87700 1 --2- 172.21.15.16:0/2695060939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bfc0b3170 0x7f0bfc0701f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009840 tx=0x7f0be4009b50 comp rx=0 tx=0).stop 2023-08-25T04:43:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.305+0000 7f0c01f87700 1 -- 172.21.15.16:0/2695060939 shutdown_connections 2023-08-25T04:43:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.305+0000 7f0c01f87700 1 --2- 172.21.15.16:0/2695060939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bfc0d0970 0x7f0bfc0b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.305+0000 7f0c01f87700 1 --2- 172.21.15.16:0/2695060939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bfc0b3170 0x7f0bfc0701f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.305+0000 7f0c01f87700 1 -- 172.21.15.16:0/2695060939 >> 172.21.15.16:0/2695060939 conn(0x7f0bfc0d0fe0 msgr2=0x7f0bfc0d13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.305+0000 7f0c01f87700 1 -- 172.21.15.16:0/2695060939 shutdown_connections 2023-08-25T04:43:26.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.305+0000 7f0c01f87700 1 -- 172.21.15.16:0/2695060939 wait complete. 2023-08-25T04:43:26.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.306+0000 7f0c01f87700 1 Processor -- start 2023-08-25T04:43:26.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.306+0000 7f0c01f87700 1 -- start start 2023-08-25T04:43:26.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.307+0000 7f0c01f87700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bfc0b3170 0x7f0bfc1f1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:26.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.307+0000 7f0c01f87700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bfc0d0970 0x7f0bfc1ef060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.307+0000 7f0c01f87700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bfc15b380 0x7f0bfc0c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.307+0000 7f0c01f87700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc1ef5a0 con 0x7f0bfc0d0970 2023-08-25T04:43:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.307+0000 7f0c01f87700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc1f2af0 con 0x7f0bfc0b3170 2023-08-25T04:43:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.307+0000 7f0c01f87700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc15bb80 con 0x7f0bfc15b380 2023-08-25T04:43:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.307+0000 7f0bfaffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bfc0d0970 0x7f0bfc1ef060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.307+0000 7f0bfaffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bfc0d0970 0x7f0bfc1ef060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48482/0 (socket says 172.21.15.16:48482) 2023-08-25T04:43:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.307+0000 7f0bfaffd700 1 -- 172.21.15.16:0/3004557360 learned_addr learned my addr 172.21.15.16:0/3004557360 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:26.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.307+0000 7f0bfb7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bfc0b3170 0x7f0bfc1f1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:26.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.307+0000 7f0bfbfff700 1 --2- 172.21.15.16:0/3004557360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bfc15b380 0x7f0bfc0c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:26.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0bfaffd700 1 -- 172.21.15.16:0/3004557360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bfc15b380 msgr2=0x7f0bfc0c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:26.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0bfaffd700 1 --2- 172.21.15.16:0/3004557360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bfc15b380 0x7f0bfc0c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0bfaffd700 1 -- 172.21.15.16:0/3004557360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bfc0b3170 msgr2=0x7f0bfc1f1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:26.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0bfaffd700 1 --2- 172.21.15.16:0/3004557360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bfc0b3170 0x7f0bfc1f1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0bfaffd700 1 -- 172.21.15.16:0/3004557360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf400d940 con 0x7f0bfc0d0970 2023-08-25T04:43:26.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0bfb7fe700 1 --2- 172.21.15.16:0/3004557360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bfc0b3170 0x7f0bfc1f1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:26.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0bfbfff700 1 --2- 172.21.15.16:0/3004557360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bfc15b380 0x7f0bfc0c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:26.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0bfaffd700 1 --2- 172.21.15.16:0/3004557360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bfc0d0970 0x7f0bfc1ef060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0be40090b0 tx=0x7f0be4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:26.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0bf3fff700 1 -- 172.21.15.16:0/3004557360 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4004550 con 0x7f0bfc0d0970 2023-08-25T04:43:26.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0bf3fff700 1 -- 172.21.15.16:0/3004557360 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be401e070 con 0x7f0bfc0d0970 2023-08-25T04:43:26.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0c01f87700 1 -- 172.21.15.16:0/3004557360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be40094a0 con 0x7f0bfc0d0970 2023-08-25T04:43:26.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0bf3fff700 1 -- 172.21.15.16:0/3004557360 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40038e0 con 0x7f0bfc0d0970 2023-08-25T04:43:26.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0c01f87700 1 -- 172.21.15.16:0/3004557360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bfc0c95b0 con 0x7f0bfc0d0970 2023-08-25T04:43:26.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0bf3fff700 1 -- 172.21.15.16:0/3004557360 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0be4003d40 con 0x7f0bfc0d0970 2023-08-25T04:43:26.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.308+0000 7f0bf3fff700 1 -- 172.21.15.16:0/3004557360 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0be402dcc0 con 0x7f0bfc0d0970 2023-08-25T04:43:26.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.309+0000 7f0c01f87700 1 -- 172.21.15.16:0/3004557360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bfc04ee70 con 0x7f0bfc0d0970 2023-08-25T04:43:26.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.311+0000 7f0bf3fff700 1 -- 172.21.15.16:0/3004557360 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0be4020070 con 0x7f0bfc0d0970 2023-08-25T04:43:26.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.381+0000 7f0c01f87700 1 -- 172.21.15.16:0/3004557360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bfc15bcc0 con 0x7f0bfc0d0970 2023-08-25T04:43:26.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.382+0000 7f0bf3fff700 1 -- 172.21.15.16:0/3004557360 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0be4015020 con 0x7f0bfc0d0970 2023-08-25T04:43:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:26.384 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":10,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:43:26.098941+0000","last_up_change":"0.000000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:43:26.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.383+0000 7f0c01f87700 1 -- 172.21.15.16:0/3004557360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bfc0d0970 msgr2=0x7f0bfc1ef060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:26.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.383+0000 7f0c01f87700 1 --2- 172.21.15.16:0/3004557360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bfc0d0970 0x7f0bfc1ef060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0be40090b0 tx=0x7f0be4004750 comp rx=0 tx=0).stop 2023-08-25T04:43:26.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.383+0000 7f0c01f87700 1 -- 172.21.15.16:0/3004557360 shutdown_connections 2023-08-25T04:43:26.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.383+0000 7f0c01f87700 1 --2- 172.21.15.16:0/3004557360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0bfc15b380 0x7f0bfc0c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.383+0000 7f0c01f87700 1 --2- 172.21.15.16:0/3004557360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bfc0b3170 0x7f0bfc1f1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.383+0000 7f0c01f87700 1 --2- 172.21.15.16:0/3004557360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bfc0d0970 0x7f0bfc1ef060 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:26.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.383+0000 7f0c01f87700 1 -- 172.21.15.16:0/3004557360 >> 172.21.15.16:0/3004557360 conn(0x7f0bfc0d0fe0 msgr2=0x7f0bfc0c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:26.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.383+0000 7f0c01f87700 1 -- 172.21.15.16:0/3004557360 shutdown_connections 2023-08-25T04:43:26.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:26.383+0000 7f0c01f87700 1 -- 172.21.15.16:0/3004557360 wait complete. 2023-08-25T04:43:26.398 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-25T04:43:26.398 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-25T04:43:26.503 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-08-25T04:43:26.502+0000 7f3e3606d640 -1 Falling back to public interface 2023-08-25T04:43:26.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2023-08-25T04:43:26.747+0000 7f050c157640 -1 Falling back to public interface 2023-08-25T04:43:26.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2023-08-25T04:43:26.748+0000 7f79ae3f1640 -1 Falling back to public interface 2023-08-25T04:43:26.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2023-08-25T04:43:26.748+0000 7f79a57af700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6805/0: (98) Address already in use 2023-08-25T04:43:26.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2023-08-25T04:43:26.756+0000 7fcbec36a640 -1 Falling back to public interface 2023-08-25T04:43:26.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2023-08-25T04:43:26.759+0000 7fdda0872640 -1 Falling back to public interface 2023-08-25T04:43:26.761 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-08-25T04:43:26.760+0000 7f0a1dbc8640 -1 Falling back to public interface 2023-08-25T04:43:26.762 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-08-25T04:43:26.760+0000 7f2976256640 -1 Falling back to public interface 2023-08-25T04:43:26.762 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-08-25T04:43:26.761+0000 7f296d614700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2023-08-25T04:43:26.766 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-08-25T04:43:26.766+0000 7f14ba74b640 -1 Falling back to public interface 2023-08-25T04:43:26.793 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:26.792+0000 7fb873d5e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:43:26.810 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:26.809+0000 7f9a0cb53200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:43:26.870 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:26.869+0000 7fb873d5e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:43:26.890 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:26.889+0000 7f9a0cb53200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:43:27.011 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:27.008+0000 7fb873d5e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:43:27.038 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:27.037+0000 7f9a0cb53200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:43:27.204 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-25T04:43:27.243 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:27.242+0000 7fb873d5e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-25T04:43:27.284 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:27.283+0000 7f9a0cb53200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-25T04:43:27.320 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.319+0000 7f52d667b700 1 Processor -- start 2023-08-25T04:43:27.320 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.319+0000 7f52d667b700 1 -- start start 2023-08-25T04:43:27.322 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.319+0000 7f52d667b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52d006a340 0x7f52d00b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:27.322 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52d667b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52d006a720 0x7f52d006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:27.322 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52d667b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d00b5200 con 0x7f52d006b0e0 2023-08-25T04:43:27.323 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52d667b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d006c5b0 con 0x7f52d006a720 2023-08-25T04:43:27.323 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52d667b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d006b9c0 con 0x7f52d006a340 2023-08-25T04:43:27.323 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52cf7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52d006a720 0x7f52d006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:27.323 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52d4c18700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f52d006b0e0 0x7f52d006d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38904/0 (socket says 172.21.15.16:38904) 2023-08-25T04:43:27.323 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52d4c18700 1 -- 172.21.15.16:0/2778085618 learned_addr learned my addr 172.21.15.16:0/2778085618 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:27.323 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52cf7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52d006a720 0x7f52d006aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48488/0 (socket says 172.21.15.16:48488) 2023-08-25T04:43:27.324 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52cffff700 1 --2- 172.21.15.16:0/2778085618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52d006a340 0x7f52d00b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:27.324 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52cf7fe700 1 -- 172.21.15.16:0/2778085618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52d006a340 msgr2=0x7f52d00b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:27.324 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52cf7fe700 1 --2- 172.21.15.16:0/2778085618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52d006a340 0x7f52d00b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:27.324 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52cf7fe700 1 -- 172.21.15.16:0/2778085618 >> v1:172.21.15.16:6789/0 conn(0x7f52d006b0e0 legacy=0x7f52d006d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:27.324 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52ceffd700 1 -- 172.21.15.16:0/2778085618 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738747673 0 0) 0x7f52d00b5200 con 0x7f52d006b0e0 2023-08-25T04:43:27.324 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52cf7fe700 1 -- 172.21.15.16:0/2778085618 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d006c850 con 0x7f52d006a720 2023-08-25T04:43:27.324 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52cf7fe700 1 --2- 172.21.15.16:0/2778085618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52d006a720 0x7f52d006aba0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009840 tx=0x7f52c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49015348c804502 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:27.325 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52ceffd700 1 -- 172.21.15.16:0/2778085618 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4011830 con 0x7f52d006a720 2023-08-25T04:43:27.325 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52ceffd700 1 -- 172.21.15.16:0/2778085618 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c4011990 con 0x7f52d006a720 2023-08-25T04:43:27.325 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.320+0000 7f52ceffd700 1 -- 172.21.15.16:0/2778085618 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4011d20 con 0x7f52d006a720 2023-08-25T04:43:27.325 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.321+0000 7f52d667b700 1 -- 172.21.15.16:0/2778085618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52d006a720 msgr2=0x7f52d006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:27.325 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.321+0000 7f52d667b700 1 --2- 172.21.15.16:0/2778085618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52d006a720 0x7f52d006aba0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009840 tx=0x7f52c4009b50 comp rx=0 tx=0).stop 2023-08-25T04:43:27.325 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.321+0000 7f52d667b700 1 -- 172.21.15.16:0/2778085618 shutdown_connections 2023-08-25T04:43:27.325 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.321+0000 7f52d667b700 1 --2- 172.21.15.16:0/2778085618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52d006a340 0x7f52d00b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:27.326 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.321+0000 7f52d667b700 1 --2- 172.21.15.16:0/2778085618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52d006a720 0x7f52d006aba0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:27.326 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.321+0000 7f52d667b700 1 -- 172.21.15.16:0/2778085618 >> 172.21.15.16:0/2778085618 conn(0x7f52d00cc190 msgr2=0x7f52d00cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:27.326 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.321+0000 7f52d667b700 1 -- 172.21.15.16:0/2778085618 shutdown_connections 2023-08-25T04:43:27.326 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.321+0000 7f52d667b700 1 -- 172.21.15.16:0/2778085618 wait complete. 2023-08-25T04:43:27.328 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.322+0000 7f52d667b700 1 Processor -- start 2023-08-25T04:43:27.328 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.323+0000 7f52d667b700 1 -- start start 2023-08-25T04:43:27.328 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.323+0000 7f52d667b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52d006a340 0x7f52d013a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:27.329 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.323+0000 7f52d667b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52d006a720 0x7f52d00cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:27.329 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.323+0000 7f52d667b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52d006b0e0 0x7f52d00cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:27.329 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.323+0000 7f52d667b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d013ded0 con 0x7f52d006a340 2023-08-25T04:43:27.329 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.323+0000 7f52d667b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0157720 con 0x7f52d006a720 2023-08-25T04:43:27.329 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.323+0000 7f52d667b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0157a00 con 0x7f52d006b0e0 2023-08-25T04:43:27.329 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.323+0000 7f52cffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52d006a340 0x7f52d013a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:27.329 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52cffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52d006a340 0x7f52d013a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48492/0 (socket says 172.21.15.16:48492) 2023-08-25T04:43:27.330 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52cffff700 1 -- 172.21.15.16:0/2593004982 learned_addr learned my addr 172.21.15.16:0/2593004982 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:27.330 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52d4c18700 1 --2- 172.21.15.16:0/2593004982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52d006b0e0 0x7f52d00cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:27.330 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52cf7fe700 1 --2- 172.21.15.16:0/2593004982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52d006a720 0x7f52d00cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:27.330 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52cffff700 1 -- 172.21.15.16:0/2593004982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52d006b0e0 msgr2=0x7f52d00cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:27.330 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52cffff700 1 --2- 172.21.15.16:0/2593004982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52d006b0e0 0x7f52d00cb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:27.330 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52cffff700 1 -- 172.21.15.16:0/2593004982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52d006a720 msgr2=0x7f52d00cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:27.330 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52cffff700 1 --2- 172.21.15.16:0/2593004982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52d006a720 0x7f52d00cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:27.331 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52cffff700 1 -- 172.21.15.16:0/2593004982 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40094a0 con 0x7f52d006a340 2023-08-25T04:43:27.331 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52cffff700 1 --2- 172.21.15.16:0/2593004982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52d006a340 0x7f52d013a640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f52c000e9b0 tx=0x7f52c000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:27.331 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52ccff9700 1 -- 172.21.15.16:0/2593004982 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0009710 con 0x7f52d006a340 2023-08-25T04:43:27.331 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52ccff9700 1 -- 172.21.15.16:0/2593004982 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c000ee50 con 0x7f52d006a340 2023-08-25T04:43:27.331 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52d667b700 1 -- 172.21.15.16:0/2593004982 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d0157ce0 con 0x7f52d006a340 2023-08-25T04:43:27.331 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52ccff9700 1 -- 172.21.15.16:0/2593004982 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c000ca50 con 0x7f52d006a340 2023-08-25T04:43:27.331 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52d667b700 1 -- 172.21.15.16:0/2593004982 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d01584e0 con 0x7f52d006a340 2023-08-25T04:43:27.332 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52ccff9700 1 -- 172.21.15.16:0/2593004982 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f52c0005a20 con 0x7f52d006a340 2023-08-25T04:43:27.332 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.324+0000 7f52ccff9700 1 -- 172.21.15.16:0/2593004982 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f52c0006810 con 0x7f52d006a340 2023-08-25T04:43:27.332 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.325+0000 7f52d667b700 1 -- 172.21.15.16:0/2593004982 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d00746a0 con 0x7f52d006a340 2023-08-25T04:43:27.332 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.328+0000 7f52ccff9700 1 -- 172.21.15.16:0/2593004982 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f52c0021060 con 0x7f52d006a340 2023-08-25T04:43:27.400 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.399+0000 7f52d667b700 1 -- 172.21.15.16:0/2593004982 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52d006cb10 con 0x7f52d006a340 2023-08-25T04:43:27.400 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.399+0000 7f52ccff9700 1 -- 172.21.15.16:0/2593004982 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f52d006cb10 con 0x7f52d006a340 2023-08-25T04:43:27.401 INFO:teuthology.misc.health.smithi016.stdout: 2023-08-25T04:43:27.401 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":10,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:43:26.098941+0000","last_up_change":"0.000000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:43:27.402 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.400+0000 7f52d667b700 1 -- 172.21.15.16:0/2593004982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52d006a340 msgr2=0x7f52d013a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:27.402 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.400+0000 7f52d667b700 1 --2- 172.21.15.16:0/2593004982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52d006a340 0x7f52d013a640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f52c000e9b0 tx=0x7f52c000ecc0 comp rx=0 tx=0).stop 2023-08-25T04:43:27.402 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.400+0000 7f52d667b700 1 -- 172.21.15.16:0/2593004982 shutdown_connections 2023-08-25T04:43:27.402 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.400+0000 7f52d667b700 1 --2- 172.21.15.16:0/2593004982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52d006b0e0 0x7f52d00cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:27.402 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.400+0000 7f52d667b700 1 --2- 172.21.15.16:0/2593004982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52d006a340 0x7f52d013a640 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:27.403 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.400+0000 7f52d667b700 1 --2- 172.21.15.16:0/2593004982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52d006a720 0x7f52d00cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:27.403 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.400+0000 7f52d667b700 1 -- 172.21.15.16:0/2593004982 >> 172.21.15.16:0/2593004982 conn(0x7f52d00cc190 msgr2=0x7f52d006cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:27.403 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.400+0000 7f52d667b700 1 -- 172.21.15.16:0/2593004982 shutdown_connections 2023-08-25T04:43:27.403 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:27.400+0000 7f52d667b700 1 -- 172.21.15.16:0/2593004982 wait complete. 2023-08-25T04:43:27.413 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-25T04:43:27.453 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:27.453+0000 7fb873d5e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:43:27.506 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:27.505+0000 7f9a0cb53200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:43:27.586 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:27.585+0000 7fb873d5e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:43:27.646 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:27.645+0000 7f9a0cb53200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:43:27.805 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:27.804+0000 7fb873d5e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:43:27.873 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:27.872+0000 7f9a0cb53200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:43:27.963 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:27.962+0000 7fb873d5e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:43:28.035 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:28.034+0000 7f9a0cb53200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:43:28.078 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:28.078+0000 7fb873d5e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:43:28.156 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:28.155+0000 7f9a0cb53200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:43:28.402 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:28.401+0000 7fb873d5e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:43:28.489 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:28.488+0000 7f9a0cb53200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:43:28.508 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:28.500+0000 7fb873d5e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:43:28.594 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:28.593+0000 7f9a0cb53200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:43:28.687 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:28.687+0000 7fb873d5e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:43:28.787 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:28.786+0000 7f9a0cb53200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:43:29.284 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:29.283+0000 7fb873d5e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:43:29.431 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-08-25T04:43:29.430+0000 7f9a0cb53200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:43:30.020 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-08-25T04:43:30.019+0000 7f3e3606d640 -1 osd.1 0 log_to_monitors true 2023-08-25T04:43:30.275 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-08-25T04:43:30.274+0000 7f0a1dbc8640 -1 osd.3 0 log_to_monitors true 2023-08-25T04:43:30.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2023-08-25T04:43:30.285+0000 7f79ae3f1640 -1 osd.5 0 log_to_monitors true 2023-08-25T04:43:30.313 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-08-25T04:43:30.311+0000 7f2976256640 -1 osd.0 0 log_to_monitors true 2023-08-25T04:43:30.313 INFO:tasks.ceph.osd.4.smithi117.stderr:2023-08-25T04:43:30.311+0000 7fcbec36a640 -1 osd.4 0 log_to_monitors true 2023-08-25T04:43:30.314 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:30.312+0000 7fb82bd91700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-25T04:43:30.314 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-08-25T04:43:30.313+0000 7fb82bd91700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-25T04:43:30.322 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-08-25T04:43:30.322+0000 7f14ba74b640 -1 osd.2 0 log_to_monitors true 2023-08-25T04:43:30.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2023-08-25T04:43:30.324+0000 7f050c157640 -1 osd.6 0 log_to_monitors true 2023-08-25T04:43:30.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2023-08-25T04:43:30.324+0000 7fdda0872640 -1 osd.7 0 log_to_monitors true 2023-08-25T04:43:32.758 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-08-25T04:43:32.756+0000 7f14ae302700 -1 osd.2 0 waiting for initial osdmap 2023-08-25T04:43:32.770 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-08-25T04:43:32.769+0000 7f14a66dd700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:43:32.771 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-08-25T04:43:32.769+0000 7f0a1177f700 -1 osd.3 0 waiting for initial osdmap 2023-08-25T04:43:32.774 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-08-25T04:43:32.773+0000 7f2969e0d700 -1 osd.0 0 waiting for initial osdmap 2023-08-25T04:43:32.782 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-08-25T04:43:32.781+0000 7f0a09b5a700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:43:32.783 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-08-25T04:43:32.781+0000 7f3e29c24700 -1 osd.1 0 waiting for initial osdmap 2023-08-25T04:43:32.791 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-08-25T04:43:32.790+0000 7f29621e8700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:43:32.795 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-08-25T04:43:32.794+0000 7f3e21fff700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:43:33.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2023-08-25T04:43:33.351+0000 7f79a1fa8700 -1 osd.5 0 waiting for initial osdmap 2023-08-25T04:43:33.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2023-08-25T04:43:33.365+0000 7f799a383700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:43:33.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2023-08-25T04:43:33.384+0000 7fcbdff21700 -1 osd.4 0 waiting for initial osdmap 2023-08-25T04:43:33.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2023-08-25T04:43:33.389+0000 7f04ffd0e700 -1 osd.6 0 waiting for initial osdmap 2023-08-25T04:43:33.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2023-08-25T04:43:33.398+0000 7fcbd82fc700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:43:33.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2023-08-25T04:43:33.400+0000 7f04f80e9700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:43:33.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2023-08-25T04:43:33.427+0000 7fdd94429700 -1 osd.7 0 waiting for initial osdmap 2023-08-25T04:43:33.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2023-08-25T04:43:33.439+0000 7fdd8c804700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:43:34.220 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-25T04:43:34.350 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.348+0000 7f345770a700 1 Processor -- start 2023-08-25T04:43:34.350 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.349+0000 7f345770a700 1 -- start start 2023-08-25T04:43:34.351 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f345770a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f345006aa50 0x7f34500aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:34.351 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f345770a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3450161fb0 con 0x7f34500d0b50 2023-08-25T04:43:34.352 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f345770a700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3450161410 con 0x7f345006d9f0 2023-08-25T04:43:34.352 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f345770a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345006e980 con 0x7f345006aa50 2023-08-25T04:43:34.352 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f3455ca7700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f345006aa50 0x7f34500aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:34.352 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f3455ca7700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f345006aa50 0x7f34500aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48682/0 (socket says 172.21.15.16:48682) 2023-08-25T04:43:34.352 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f3455ca7700 1 -- 172.21.15.16:0/3911542748 learned_addr learned my addr 172.21.15.16:0/3911542748 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:34.352 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f3454ca5700 1 --1- 172.21.15.16:0/3911542748 >> v1:172.21.15.16:6789/0 conn(0x7f34500d0b50 0x7f345006a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39094/0 (socket says 172.21.15.16:39094) 2023-08-25T04:43:34.352 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f3455ca7700 1 -- 172.21.15.16:0/3911542748 >> v1:172.21.15.117:6789/0 conn(0x7f345006d9f0 legacy=0x7f34501618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:34.353 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f3455ca7700 1 -- 172.21.15.16:0/3911542748 >> v1:172.21.15.16:6789/0 conn(0x7f34500d0b50 legacy=0x7f345006a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:34.353 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f3455ca7700 1 -- 172.21.15.16:0/3911542748 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345006e0e0 con 0x7f345006aa50 2023-08-25T04:43:34.353 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f3455ca7700 1 --2- 172.21.15.16:0/3911542748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f345006aa50 0x7f34500aef40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3448009e50 tx=0x7f344800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b9ca595242bbce server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:34.353 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f3443fff700 1 -- 172.21.15.16:0/3911542748 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344800e070 con 0x7f345006aa50 2023-08-25T04:43:34.353 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f3443fff700 1 -- 172.21.15.16:0/3911542748 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344800b9c0 con 0x7f345006aa50 2023-08-25T04:43:34.353 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.350+0000 7f3443fff700 1 -- 172.21.15.16:0/3911542748 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344800bd70 con 0x7f345006aa50 2023-08-25T04:43:34.354 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.351+0000 7f345770a700 1 -- 172.21.15.16:0/3911542748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f345006aa50 msgr2=0x7f34500aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:34.354 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.351+0000 7f345770a700 1 --2- 172.21.15.16:0/3911542748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f345006aa50 0x7f34500aef40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3448009e50 tx=0x7f344800b330 comp rx=0 tx=0).stop 2023-08-25T04:43:34.354 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.351+0000 7f345770a700 1 -- 172.21.15.16:0/3911542748 shutdown_connections 2023-08-25T04:43:34.355 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.351+0000 7f345770a700 1 --2- 172.21.15.16:0/3911542748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f345006aa50 0x7f34500aef40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:34.355 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.351+0000 7f345770a700 1 -- 172.21.15.16:0/3911542748 >> 172.21.15.16:0/3911542748 conn(0x7f34500cfee0 msgr2=0x7f34500d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:34.355 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.351+0000 7f345770a700 1 -- 172.21.15.16:0/3911542748 shutdown_connections 2023-08-25T04:43:34.355 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.351+0000 7f345770a700 1 -- 172.21.15.16:0/3911542748 wait complete. 2023-08-25T04:43:34.355 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.353+0000 7f345770a700 1 Processor -- start 2023-08-25T04:43:34.355 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.353+0000 7f345770a700 1 -- start start 2023-08-25T04:43:34.357 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f345770a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f345006aa50 0x7f34500b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:34.357 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f345770a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f345006d9f0 0x7f34500b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:34.358 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f345770a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34500d0b50 0x7f3450153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:34.358 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f345770a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34500b3a20 con 0x7f34500d0b50 2023-08-25T04:43:34.358 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f345770a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34500b4ee0 con 0x7f345006aa50 2023-08-25T04:43:34.358 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f345770a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34500b3c60 con 0x7f345006d9f0 2023-08-25T04:43:34.358 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f3455ca7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34500d0b50 0x7f3450153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:34.358 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f34554a6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f345006aa50 0x7f34500b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:34.358 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f3455ca7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34500d0b50 0x7f3450153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48688/0 (socket says 172.21.15.16:48688) 2023-08-25T04:43:34.359 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f34554a6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f345006aa50 0x7f34500b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36014/0 (socket says 172.21.15.16:36014) 2023-08-25T04:43:34.359 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f3454ca5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f345006d9f0 0x7f34500b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:34.359 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f3455ca7700 1 -- 172.21.15.16:0/2823773068 learned_addr learned my addr 172.21.15.16:0/2823773068 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:34.359 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f3455ca7700 1 -- 172.21.15.16:0/2823773068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f345006d9f0 msgr2=0x7f34500b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:34.359 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f3455ca7700 1 --2- 172.21.15.16:0/2823773068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f345006d9f0 0x7f34500b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:34.359 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f3455ca7700 1 -- 172.21.15.16:0/2823773068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f345006aa50 msgr2=0x7f34500b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:34.359 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f3455ca7700 1 --2- 172.21.15.16:0/2823773068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f345006aa50 0x7f34500b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:34.360 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f3455ca7700 1 -- 172.21.15.16:0/2823773068 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3448009b30 con 0x7f34500d0b50 2023-08-25T04:43:34.360 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.354+0000 7f3455ca7700 1 --2- 172.21.15.16:0/2823773068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34500d0b50 0x7f3450153180 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3448012000 tx=0x7f3448004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:34.360 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.355+0000 7f3441ffb700 1 -- 172.21.15.16:0/2823773068 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448004800 con 0x7f34500d0b50 2023-08-25T04:43:34.360 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.355+0000 7f3441ffb700 1 -- 172.21.15.16:0/2823773068 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3448004960 con 0x7f34500d0b50 2023-08-25T04:43:34.360 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.355+0000 7f3441ffb700 1 -- 172.21.15.16:0/2823773068 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344801b670 con 0x7f34500d0b50 2023-08-25T04:43:34.360 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.355+0000 7f345770a700 1 -- 172.21.15.16:0/2823773068 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34500b3f40 con 0x7f34500d0b50 2023-08-25T04:43:34.360 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.355+0000 7f345770a700 1 -- 172.21.15.16:0/2823773068 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34500c82e0 con 0x7f34500d0b50 2023-08-25T04:43:34.360 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.356+0000 7f345770a700 1 -- 172.21.15.16:0/2823773068 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34500746a0 con 0x7f34500d0b50 2023-08-25T04:43:34.361 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.357+0000 7f3441ffb700 1 -- 172.21.15.16:0/2823773068 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f344801b7d0 con 0x7f34500d0b50 2023-08-25T04:43:34.361 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.357+0000 7f3441ffb700 1 --2- 172.21.15.16:0/2823773068 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f343406a050 0x7f343406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:34.362 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.357+0000 7f3441ffb700 1 -- 172.21.15.16:0/2823773068 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f34480893b0 con 0x7f34500d0b50 2023-08-25T04:43:34.362 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.357+0000 7f34554a6700 1 --2- 172.21.15.16:0/2823773068 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f343406a050 0x7f343406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:34.362 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.358+0000 7f34554a6700 1 --2- 172.21.15.16:0/2823773068 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f343406a050 0x7f343406c510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f344c007fd0 tx=0x7f344c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:34.363 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.362+0000 7f3441ffb700 1 -- 172.21.15.16:0/2823773068 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3448055240 con 0x7f34500d0b50 2023-08-25T04:43:34.565 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.564+0000 7f345770a700 1 -- 172.21.15.16:0/2823773068 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34500c37b0 con 0x7f34500d0b50 2023-08-25T04:43:34.566 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.565+0000 7f3441ffb700 1 -- 172.21.15.16:0/2823773068 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10920 (secure 0 0 0) 0x7f344801f090 con 0x7f34500d0b50 2023-08-25T04:43:34.566 INFO:teuthology.misc.health.smithi016.stdout: 2023-08-25T04:43:34.566 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":13,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:43:33.764200+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:43:34.568 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.567+0000 7f345770a700 1 -- 172.21.15.16:0/2823773068 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f343406a050 msgr2=0x7f343406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:34.569 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.567+0000 7f345770a700 1 --2- 172.21.15.16:0/2823773068 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f343406a050 0x7f343406c510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f344c007fd0 tx=0x7f344c009040 comp rx=0 tx=0).stop 2023-08-25T04:43:34.569 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.567+0000 7f345770a700 1 -- 172.21.15.16:0/2823773068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34500d0b50 msgr2=0x7f3450153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:34.569 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.567+0000 7f345770a700 1 --2- 172.21.15.16:0/2823773068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34500d0b50 0x7f3450153180 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3448012000 tx=0x7f3448004ad0 comp rx=0 tx=0).stop 2023-08-25T04:43:34.569 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.567+0000 7f345770a700 1 -- 172.21.15.16:0/2823773068 shutdown_connections 2023-08-25T04:43:34.569 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.567+0000 7f345770a700 1 --2- 172.21.15.16:0/2823773068 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f343406a050 0x7f343406c510 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:34.569 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.567+0000 7f345770a700 1 --2- 172.21.15.16:0/2823773068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34500d0b50 0x7f3450153180 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:34.569 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.567+0000 7f345770a700 1 --2- 172.21.15.16:0/2823773068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f345006aa50 0x7f34500b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:34.570 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.567+0000 7f345770a700 1 --2- 172.21.15.16:0/2823773068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f345006d9f0 0x7f34500b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:34.570 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.567+0000 7f345770a700 1 -- 172.21.15.16:0/2823773068 >> 172.21.15.16:0/2823773068 conn(0x7f34500cfee0 msgr2=0x7f34500aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:34.570 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.567+0000 7f345770a700 1 -- 172.21.15.16:0/2823773068 shutdown_connections 2023-08-25T04:43:34.570 INFO:teuthology.misc.health.smithi016.stderr:2023-08-25T04:43:34.567+0000 7f345770a700 1 -- 172.21.15.16:0/2823773068 wait complete. 2023-08-25T04:43:34.579 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-25T04:43:34.580 INFO:tasks.ceph:Creating RBD pool 2023-08-25T04:43:34.580 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-25T04:43:34.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.704+0000 7fc85a85e700 1 Processor -- start 2023-08-25T04:43:34.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.704+0000 7fc85a85e700 1 -- start start 2023-08-25T04:43:34.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc85a85e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc854160b60 0x7fc8540d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:34.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc85a85e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8540d1d90 0x7fc8540b0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:34.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc85a85e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8540d4040 con 0x7fc8540b2040 2023-08-25T04:43:34.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc85a85e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8540cf230 con 0x7fc854160b60 2023-08-25T04:43:34.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc85a85e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540b0180 con 0x7fc8540d1d90 2023-08-25T04:43:34.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc8537fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc8540b2040 0x7fc8540d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39134/0 (socket says 172.21.15.16:39134) 2023-08-25T04:43:34.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc8537fe700 1 -- 172.21.15.16:0/2412037179 learned_addr learned my addr 172.21.15.16:0/2412037179 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:34.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc853fff700 1 --2- 172.21.15.16:0/2412037179 >> v2:172.21.15.117:3300/0 conn(0x7fc854160b60 0x7fc8540d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:34.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc858dfb700 1 --2- 172.21.15.16:0/2412037179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8540d1d90 0x7fc8540b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:34.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc852ffd700 1 -- 172.21.15.16:0/2412037179 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123136080 0 0) 0x7fc8540d4040 con 0x7fc8540b2040 2023-08-25T04:43:34.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc852ffd700 1 -- 172.21.15.16:0/2412037179 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc83c0035b0 con 0x7fc8540b2040 2023-08-25T04:43:34.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc852ffd700 1 -- 172.21.15.16:0/2412037179 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 198673236 0 0) 0x7fc83c0035b0 con 0x7fc8540b2040 2023-08-25T04:43:34.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc858dfb700 1 -- 172.21.15.16:0/2412037179 >> v2:172.21.15.117:3300/0 conn(0x7fc854160b60 msgr2=0x7fc8540d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:34.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc858dfb700 1 --2- 172.21.15.16:0/2412037179 >> v2:172.21.15.117:3300/0 conn(0x7fc854160b60 0x7fc8540d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:34.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc858dfb700 1 -- 172.21.15.16:0/2412037179 >> v1:172.21.15.16:6789/0 conn(0x7fc8540b2040 legacy=0x7fc8540d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:34.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc858dfb700 1 -- 172.21.15.16:0/2412037179 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854160f40 con 0x7fc8540d1d90 2023-08-25T04:43:34.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.705+0000 7fc858dfb700 1 --2- 172.21.15.16:0/2412037179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8540d1d90 0x7fc8540b0610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc84c009d90 tx=0x7fc84c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2176127217925093 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:34.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.706+0000 7fc852ffd700 1 -- 172.21.15.16:0/2412037179 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00e070 con 0x7fc8540d1d90 2023-08-25T04:43:34.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.706+0000 7fc852ffd700 1 -- 172.21.15.16:0/2412037179 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c003a20 con 0x7fc8540d1d90 2023-08-25T04:43:34.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.706+0000 7fc852ffd700 1 -- 172.21.15.16:0/2412037179 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc848001670 con 0x7fc8540d1d90 2023-08-25T04:43:34.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.706+0000 7fc85a85e700 1 -- 172.21.15.16:0/2412037179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8540d1d90 msgr2=0x7fc8540b0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:34.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.706+0000 7fc85a85e700 1 --2- 172.21.15.16:0/2412037179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8540d1d90 0x7fc8540b0610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc84c009d90 tx=0x7fc84c00b330 comp rx=0 tx=0).stop 2023-08-25T04:43:34.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.706+0000 7fc85a85e700 1 -- 172.21.15.16:0/2412037179 shutdown_connections 2023-08-25T04:43:34.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.706+0000 7fc85a85e700 1 --2- 172.21.15.16:0/2412037179 >> v2:172.21.15.117:3300/0 conn(0x7fc854160b60 0x7fc8540d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:34.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.706+0000 7fc85a85e700 1 --2- 172.21.15.16:0/2412037179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8540d1d90 0x7fc8540b0610 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:34.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.706+0000 7fc85a85e700 1 -- 172.21.15.16:0/2412037179 >> 172.21.15.16:0/2412037179 conn(0x7fc8540d30a0 msgr2=0x7fc8540d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:34.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.706+0000 7fc85a85e700 1 -- 172.21.15.16:0/2412037179 shutdown_connections 2023-08-25T04:43:34.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.706+0000 7fc85a85e700 1 -- 172.21.15.16:0/2412037179 wait complete. 2023-08-25T04:43:34.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.707+0000 7fc85a85e700 1 Processor -- start 2023-08-25T04:43:34.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.708+0000 7fc85a85e700 1 -- start start 2023-08-25T04:43:34.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.708+0000 7fc85a85e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8540b2040 0x7fc85415a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:34.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.708+0000 7fc85a85e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8540d1d90 0x7fc8540b8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:34.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.708+0000 7fc85a85e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc854160b60 0x7fc8540b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:34.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.708+0000 7fc85a85e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540b5ca0 con 0x7fc8540b2040 2023-08-25T04:43:34.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.708+0000 7fc85a85e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540c8b00 con 0x7fc854160b60 2023-08-25T04:43:34.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.708+0000 7fc85a85e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540c8de0 con 0x7fc8540d1d90 2023-08-25T04:43:34.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.708+0000 7fc853fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8540b2040 0x7fc85415a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:34.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc853fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8540b2040 0x7fc85415a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48724/0 (socket says 172.21.15.16:48724) 2023-08-25T04:43:34.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc853fff700 1 -- 172.21.15.16:0/3784451915 learned_addr learned my addr 172.21.15.16:0/3784451915 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:34.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc858dfb700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc854160b60 0x7fc8540b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:34.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc8537fe700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8540d1d90 0x7fc8540b8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:34.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc853fff700 1 -- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8540d1d90 msgr2=0x7fc8540b8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:34.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc853fff700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8540d1d90 0x7fc8540b8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:34.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc853fff700 1 -- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc854160b60 msgr2=0x7fc8540b86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:34.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc853fff700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc854160b60 0x7fc8540b86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:34.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc853fff700 1 -- 172.21.15.16:0/3784451915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c009a70 con 0x7fc8540b2040 2023-08-25T04:43:34.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc858dfb700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc854160b60 0x7fc8540b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:34.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc853fff700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8540b2040 0x7fc85415a3f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc84400e870 tx=0x7fc84400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:34.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc850ff9700 1 -- 172.21.15.16:0/3784451915 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844009590 con 0x7fc8540b2040 2023-08-25T04:43:34.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc850ff9700 1 -- 172.21.15.16:0/3784451915 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84400ee70 con 0x7fc8540b2040 2023-08-25T04:43:34.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc85a85e700 1 -- 172.21.15.16:0/3784451915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8540b5ef0 con 0x7fc8540b2040 2023-08-25T04:43:34.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc850ff9700 1 -- 172.21.15.16:0/3784451915 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84400ca50 con 0x7fc8540b2040 2023-08-25T04:43:34.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.709+0000 7fc85a85e700 1 -- 172.21.15.16:0/3784451915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85415a930 con 0x7fc8540b2040 2023-08-25T04:43:34.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.710+0000 7fc85a85e700 1 -- 172.21.15.16:0/3784451915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8540c9000 con 0x7fc8540b2040 2023-08-25T04:43:34.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.711+0000 7fc850ff9700 1 -- 172.21.15.16:0/3784451915 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fc84400cbb0 con 0x7fc8540b2040 2023-08-25T04:43:34.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.711+0000 7fc850ff9700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc84006a050 0x7fc84006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:34.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.711+0000 7fc850ff9700 1 -- 172.21.15.16:0/3784451915 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fc844087e40 con 0x7fc8540b2040 2023-08-25T04:43:34.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.711+0000 7fc8537fe700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc84006a050 0x7fc84006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:34.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.712+0000 7fc8537fe700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc84006a050 0x7fc84006c510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc848001eb0 tx=0x7fc848001d40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:34.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.716+0000 7fc850ff9700 1 -- 172.21.15.16:0/3784451915 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc844053c40 con 0x7fc8540b2040 2023-08-25T04:43:34.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:34.920+0000 7fc85a85e700 1 -- 172.21.15.16:0/3784451915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fc85404ee70 con 0x7fc8540b2040 2023-08-25T04:43:35.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.777+0000 7fc850ff9700 1 -- 172.21.15.16:0/3784451915 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7fc84400ce60 con 0x7fc8540b2040 2023-08-25T04:43:35.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.781+0000 7fc85a85e700 1 -- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc84006a050 msgr2=0x7fc84006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:35.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.781+0000 7fc85a85e700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc84006a050 0x7fc84006c510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc848001eb0 tx=0x7fc848001d40 comp rx=0 tx=0).stop 2023-08-25T04:43:35.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.781+0000 7fc85a85e700 1 -- 172.21.15.16:0/3784451915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8540b2040 msgr2=0x7fc85415a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:35.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.781+0000 7fc85a85e700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8540b2040 0x7fc85415a3f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc84400e870 tx=0x7fc84400ec30 comp rx=0 tx=0).stop 2023-08-25T04:43:35.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.781+0000 7fc85a85e700 1 -- 172.21.15.16:0/3784451915 shutdown_connections 2023-08-25T04:43:35.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.781+0000 7fc85a85e700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc84006a050 0x7fc84006c510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:35.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.781+0000 7fc85a85e700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc854160b60 0x7fc8540b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:35.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.781+0000 7fc85a85e700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8540b2040 0x7fc85415a3f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:35.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.781+0000 7fc85a85e700 1 --2- 172.21.15.16:0/3784451915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8540d1d90 0x7fc8540b8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:35.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.782+0000 7fc85a85e700 1 -- 172.21.15.16:0/3784451915 >> 172.21.15.16:0/3784451915 conn(0x7fc8540d30a0 msgr2=0x7fc85406c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:35.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.782+0000 7fc85a85e700 1 -- 172.21.15.16:0/3784451915 shutdown_connections 2023-08-25T04:43:35.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.782+0000 7fc85a85e700 1 -- 172.21.15.16:0/3784451915 wait complete. 2023-08-25T04:43:35.785 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'rbd' created 2023-08-25T04:43:35.798 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-25T04:43:35.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.930+0000 7f3221b83700 1 Processor -- start 2023-08-25T04:43:35.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.930+0000 7f3221b83700 1 -- start start 2023-08-25T04:43:35.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f3221b83700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f321c0b27a0 0x7f321c15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:35.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f3221b83700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c06a340 0x7f321c06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:35.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f3221b83700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321c0ce170 con 0x7f321c15b4d0 2023-08-25T04:43:35.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f3221b83700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321c15b8b0 con 0x7f321c0b27a0 2023-08-25T04:43:35.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f3221b83700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321c0b2c20 con 0x7f321c06a340 2023-08-25T04:43:35.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f321affd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f321c0b27a0 0x7f321c15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:35.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f321affd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f321c0b27a0 0x7f321c15f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48760/0 (socket says 172.21.15.16:48760) 2023-08-25T04:43:35.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f321affd700 1 -- 172.21.15.16:0/1123022322 learned_addr learned my addr 172.21.15.16:0/1123022322 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:35.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f321bfff700 1 --2- 172.21.15.16:0/1123022322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c06a340 0x7f321c06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:35.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f321affd700 1 -- 172.21.15.16:0/1123022322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c06a340 msgr2=0x7f321c06a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:35.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f321affd700 1 --2- 172.21.15.16:0/1123022322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c06a340 0x7f321c06a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:35.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f321affd700 1 -- 172.21.15.16:0/1123022322 >> v1:172.21.15.117:6789/0 conn(0x7f321c15b4d0 legacy=0x7f321c0b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:35.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f321affd700 1 -- 172.21.15.16:0/1123022322 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c071170 con 0x7f321c0b27a0 2023-08-25T04:43:35.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f321bfff700 1 --2- 172.21.15.16:0/1123022322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c06a340 0x7f321c06a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:35.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f321affd700 1 --2- 172.21.15.16:0/1123022322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f321c0b27a0 0x7f321c15f8b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f320c009920 tx=0x7f320c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a8be438a265ce server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:35.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.931+0000 7f321a7fc700 1 -- 172.21.15.16:0/1123022322 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c00ba20 con 0x7f321c0b27a0 2023-08-25T04:43:35.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.932+0000 7f321a7fc700 1 -- 172.21.15.16:0/1123022322 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c00bb80 con 0x7f321c0b27a0 2023-08-25T04:43:35.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.932+0000 7f321a7fc700 1 -- 172.21.15.16:0/1123022322 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c009e70 con 0x7f321c0b27a0 2023-08-25T04:43:35.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.932+0000 7f3221b83700 1 -- 172.21.15.16:0/1123022322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f321c0b27a0 msgr2=0x7f321c15f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:35.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.932+0000 7f3221b83700 1 --2- 172.21.15.16:0/1123022322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f321c0b27a0 0x7f321c15f8b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f320c009920 tx=0x7f320c009c30 comp rx=0 tx=0).stop 2023-08-25T04:43:35.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.932+0000 7f3221b83700 1 -- 172.21.15.16:0/1123022322 shutdown_connections 2023-08-25T04:43:35.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.932+0000 7f3221b83700 1 --2- 172.21.15.16:0/1123022322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c06a340 0x7f321c06a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:35.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.932+0000 7f3221b83700 1 --2- 172.21.15.16:0/1123022322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f321c0b27a0 0x7f321c15f8b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:35.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.932+0000 7f3221b83700 1 -- 172.21.15.16:0/1123022322 >> 172.21.15.16:0/1123022322 conn(0x7f321c0b1cb0 msgr2=0x7f321c0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:35.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.932+0000 7f3221b83700 1 -- 172.21.15.16:0/1123022322 shutdown_connections 2023-08-25T04:43:35.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.932+0000 7f3221b83700 1 -- 172.21.15.16:0/1123022322 wait complete. 2023-08-25T04:43:35.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.933+0000 7f3221b83700 1 Processor -- start 2023-08-25T04:43:35.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.934+0000 7f3221b83700 1 -- start start 2023-08-25T04:43:35.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.934+0000 7f3221b83700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c06a340 0x7f321c1f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:35.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.934+0000 7f3221b83700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f321c0b27a0 0x7f321c0ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:35.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.934+0000 7f3221b83700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f321c15b4d0 0x7f321c0cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:35.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.934+0000 7f3221b83700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c15c170 con 0x7f321c15b4d0 2023-08-25T04:43:35.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.934+0000 7f3221b83700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c15be90 con 0x7f321c0b27a0 2023-08-25T04:43:35.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.934+0000 7f3221b83700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321c0c3fe0 con 0x7f321c06a340 2023-08-25T04:43:35.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.934+0000 7f321bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f321c15b4d0 0x7f321c0cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:35.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.934+0000 7f321bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f321c15b4d0 0x7f321c0cac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48768/0 (socket says 172.21.15.16:48768) 2023-08-25T04:43:35.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.934+0000 7f321bfff700 1 -- 172.21.15.16:0/1340363009 learned_addr learned my addr 172.21.15.16:0/1340363009 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:35.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.934+0000 7f321affd700 1 --2- 172.21.15.16:0/1340363009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f321c0b27a0 0x7f321c0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:35.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.934+0000 7f321b7fe700 1 --2- 172.21.15.16:0/1340363009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c06a340 0x7f321c1f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:35.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.935+0000 7f321bfff700 1 -- 172.21.15.16:0/1340363009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c06a340 msgr2=0x7f321c1f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:35.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.935+0000 7f321bfff700 1 --2- 172.21.15.16:0/1340363009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c06a340 0x7f321c1f56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:35.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.935+0000 7f321bfff700 1 -- 172.21.15.16:0/1340363009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f321c0b27a0 msgr2=0x7f321c0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:35.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.935+0000 7f321bfff700 1 --2- 172.21.15.16:0/1340363009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f321c0b27a0 0x7f321c0ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:35.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.935+0000 7f321bfff700 1 -- 172.21.15.16:0/1340363009 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c009550 con 0x7f321c15b4d0 2023-08-25T04:43:35.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.935+0000 7f321bfff700 1 --2- 172.21.15.16:0/1340363009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f321c15b4d0 0x7f321c0cac40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3214007ef0 tx=0x7f321400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:35.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.935+0000 7f3203fff700 1 -- 172.21.15.16:0/1340363009 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321400dd80 con 0x7f321c15b4d0 2023-08-25T04:43:35.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.935+0000 7f3203fff700 1 -- 172.21.15.16:0/1340363009 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321400f040 con 0x7f321c15b4d0 2023-08-25T04:43:35.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.935+0000 7f3221b83700 1 -- 172.21.15.16:0/1340363009 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321c0c42c0 con 0x7f321c15b4d0 2023-08-25T04:43:35.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.935+0000 7f3203fff700 1 -- 172.21.15.16:0/1340363009 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3214003c60 con 0x7f321c15b4d0 2023-08-25T04:43:35.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.935+0000 7f3221b83700 1 -- 172.21.15.16:0/1340363009 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321c15ba00 con 0x7f321c15b4d0 2023-08-25T04:43:35.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.936+0000 7f3221b83700 1 -- 172.21.15.16:0/1340363009 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321c068550 con 0x7f321c15b4d0 2023-08-25T04:43:35.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.937+0000 7f3203fff700 1 -- 172.21.15.16:0/1340363009 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f3214004030 con 0x7f321c15b4d0 2023-08-25T04:43:35.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.937+0000 7f3203fff700 1 --2- 172.21.15.16:0/1340363009 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f320806a050 0x7f320806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:35.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.937+0000 7f3203fff700 1 -- 172.21.15.16:0/1340363009 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f32140880f0 con 0x7f321c15b4d0 2023-08-25T04:43:35.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.937+0000 7f321b7fe700 1 --2- 172.21.15.16:0/1340363009 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f320806a050 0x7f320806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:35.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.938+0000 7f321b7fe700 1 --2- 172.21.15.16:0/1340363009 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f320806a050 0x7f320806c510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3210007fd0 tx=0x7f3210009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:35.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:35.942+0000 7f3203fff700 1 -- 172.21.15.16:0/1340363009 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3214053cb0 con 0x7f321c15b4d0 2023-08-25T04:43:36.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.145+0000 7f3221b83700 1 -- 172.21.15.16:0/1340363009 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f321c0c47e0 con 0x7f321c15b4d0 2023-08-25T04:43:36.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.779+0000 7f3203fff700 1 -- 172.21.15.16:0/1340363009 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f321c0c47e0 con 0x7f321c15b4d0 2023-08-25T04:43:36.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.782+0000 7f3221b83700 1 -- 172.21.15.16:0/1340363009 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f320806a050 msgr2=0x7f320806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:36.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.782+0000 7f3221b83700 1 --2- 172.21.15.16:0/1340363009 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f320806a050 0x7f320806c510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3210007fd0 tx=0x7f3210009040 comp rx=0 tx=0).stop 2023-08-25T04:43:36.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.782+0000 7f3221b83700 1 -- 172.21.15.16:0/1340363009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f321c15b4d0 msgr2=0x7f321c0cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:36.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.782+0000 7f3221b83700 1 --2- 172.21.15.16:0/1340363009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f321c15b4d0 0x7f321c0cac40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3214007ef0 tx=0x7f321400d3b0 comp rx=0 tx=0).stop 2023-08-25T04:43:36.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.783+0000 7f3221b83700 1 -- 172.21.15.16:0/1340363009 shutdown_connections 2023-08-25T04:43:36.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.783+0000 7f3221b83700 1 --2- 172.21.15.16:0/1340363009 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f320806a050 0x7f320806c510 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:36.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.783+0000 7f3221b83700 1 --2- 172.21.15.16:0/1340363009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f321c15b4d0 0x7f321c0cac40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:36.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.783+0000 7f3221b83700 1 --2- 172.21.15.16:0/1340363009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c06a340 0x7f321c1f56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:36.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.783+0000 7f3221b83700 1 --2- 172.21.15.16:0/1340363009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f321c0b27a0 0x7f321c0ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:36.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.783+0000 7f3221b83700 1 -- 172.21.15.16:0/1340363009 >> 172.21.15.16:0/1340363009 conn(0x7f321c0b1cb0 msgr2=0x7f321c15ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:36.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.783+0000 7f3221b83700 1 -- 172.21.15.16:0/1340363009 shutdown_connections 2023-08-25T04:43:36.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.783+0000 7f3221b83700 1 -- 172.21.15.16:0/1340363009 wait complete. 2023-08-25T04:43:36.786 INFO:teuthology.orchestra.run.smithi016.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-25T04:43:36.801 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-25T04:43:36.801 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T04:43:36.802 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T04:43:36.803 INFO:tasks.ceph.mds.a:Started 2023-08-25T04:43:36.804 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T04:43:36.804 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T04:43:36.806 INFO:tasks.ceph.mds.c:Started 2023-08-25T04:43:36.806 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T04:43:36.806 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T04:43:36.809 INFO:tasks.ceph.mds.b:Started 2023-08-25T04:43:36.809 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T04:43:36.809 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T04:43:36.811 INFO:tasks.ceph.mds.d:Started 2023-08-25T04:43:36.811 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-25T04:43:36.812 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:43:36.900 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2023-08-25T04:43:36.900 INFO:tasks.ceph.mds.c.smithi016.stdout:starting mds.c at 2023-08-25T04:43:36.901 INFO:tasks.ceph.mds.a.smithi016.stderr:2023-08-25T04:43:36.900+0000 7f2aea4a7700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6833/0: (98) Address already in use 2023-08-25T04:43:36.902 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-08-25T04:43:36.906 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-25T04:43:36.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.959+0000 7f4b93052700 1 Processor -- start 2023-08-25T04:43:36.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.959+0000 7f4b93052700 1 -- start start 2023-08-25T04:43:36.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b93052700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b8c15b380 0x7f4b8c0701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:36.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b93052700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8c0cd340 con 0x7f4b8c0b3170 2023-08-25T04:43:36.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b93052700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8c0cd620 con 0x7f4b8c0d0970 2023-08-25T04:43:36.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b93052700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8c0cd900 con 0x7f4b8c15b380 2023-08-25T04:43:36.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b915ef700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4b8c0b3170 0x7f4b8c0b3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39226/0 (socket says 172.21.15.16:39226) 2023-08-25T04:43:36.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b915ef700 1 -- 172.21.15.16:0/2181020298 learned_addr learned my addr 172.21.15.16:0/2181020298 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:36.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b90dee700 1 --2- 172.21.15.16:0/2181020298 >> v2:172.21.15.117:3300/0 conn(0x7f4b8c15b380 0x7f4b8c0701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:36.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b8b7fe700 1 -- 172.21.15.16:0/2181020298 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932212700 0 0) 0x7f4b8c0cd340 con 0x7f4b8c0b3170 2023-08-25T04:43:36.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b8b7fe700 1 -- 172.21.15.16:0/2181020298 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b7c0035b0 con 0x7f4b8c0b3170 2023-08-25T04:43:36.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b8b7fe700 1 -- 172.21.15.16:0/2181020298 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057451799 0 0) 0x7f4b8c0cd620 con 0x7f4b8c0d0970 2023-08-25T04:43:36.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b8b7fe700 1 -- 172.21.15.16:0/2181020298 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b8c0cd340 con 0x7f4b8c0d0970 2023-08-25T04:43:36.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b90dee700 1 -- 172.21.15.16:0/2181020298 >> v1:172.21.15.117:6789/0 conn(0x7f4b8c0d0970 legacy=0x7f4b8c0b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:36.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b90dee700 1 -- 172.21.15.16:0/2181020298 >> v1:172.21.15.16:6789/0 conn(0x7f4b8c0b3170 legacy=0x7f4b8c0b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:36.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b90dee700 1 -- 172.21.15.16:0/2181020298 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c0cb6b0 con 0x7f4b8c15b380 2023-08-25T04:43:36.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.960+0000 7f4b90dee700 1 --2- 172.21.15.16:0/2181020298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b8c15b380 0x7f4b8c0701f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009840 tx=0x7f4b80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a70be9f6622d3ba5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:36.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.961+0000 7f4b8b7fe700 1 -- 172.21.15.16:0/2181020298 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80011830 con 0x7f4b8c15b380 2023-08-25T04:43:36.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.961+0000 7f4b8b7fe700 1 -- 172.21.15.16:0/2181020298 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b80011990 con 0x7f4b8c15b380 2023-08-25T04:43:36.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.961+0000 7f4b8b7fe700 1 -- 172.21.15.16:0/2181020298 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80011d20 con 0x7f4b8c15b380 2023-08-25T04:43:36.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.961+0000 7f4b93052700 1 -- 172.21.15.16:0/2181020298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b8c15b380 msgr2=0x7f4b8c0701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:36.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.961+0000 7f4b93052700 1 --2- 172.21.15.16:0/2181020298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b8c15b380 0x7f4b8c0701f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009840 tx=0x7f4b80009b50 comp rx=0 tx=0).stop 2023-08-25T04:43:36.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.961+0000 7f4b93052700 1 -- 172.21.15.16:0/2181020298 shutdown_connections 2023-08-25T04:43:36.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.961+0000 7f4b93052700 1 --2- 172.21.15.16:0/2181020298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b8c15b380 0x7f4b8c0701f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.961+0000 7f4b93052700 1 -- 172.21.15.16:0/2181020298 >> 172.21.15.16:0/2181020298 conn(0x7f4b8c0d0fe0 msgr2=0x7f4b8c0d13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.961+0000 7f4b93052700 1 -- 172.21.15.16:0/2181020298 shutdown_connections 2023-08-25T04:43:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.961+0000 7f4b93052700 1 -- 172.21.15.16:0/2181020298 wait complete. 2023-08-25T04:43:36.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.962+0000 7f4b93052700 1 Processor -- start 2023-08-25T04:43:36.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.962+0000 7f4b93052700 1 -- start start 2023-08-25T04:43:36.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.963+0000 7f4b93052700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b8c0b3170 0x7f4b8c1f0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:36.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.963+0000 7f4b93052700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b8c0d0970 0x7f4b8c0a8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:36.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.963+0000 7f4b93052700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b8c15b380 0x7f4b8c0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:36.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.963+0000 7f4b93052700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c0a8c90 con 0x7f4b8c0d0970 2023-08-25T04:43:36.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.963+0000 7f4b93052700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c0a8f70 con 0x7f4b8c0b3170 2023-08-25T04:43:36.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.963+0000 7f4b93052700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c0a9250 con 0x7f4b8c15b380 2023-08-25T04:43:36.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.963+0000 7f4b8bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b8c0d0970 0x7f4b8c0a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:36.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b8bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b8c0d0970 0x7f4b8c0a8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48816/0 (socket says 172.21.15.16:48816) 2023-08-25T04:43:36.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b8bfff700 1 -- 172.21.15.16:0/3066916243 learned_addr learned my addr 172.21.15.16:0/3066916243 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b90dee700 1 --2- 172.21.15.16:0/3066916243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b8c0b3170 0x7f4b8c1f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b915ef700 1 --2- 172.21.15.16:0/3066916243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b8c15b380 0x7f4b8c0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:36.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b8bfff700 1 -- 172.21.15.16:0/3066916243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b8c15b380 msgr2=0x7f4b8c0b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:36.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b8bfff700 1 --2- 172.21.15.16:0/3066916243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b8c15b380 0x7f4b8c0b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:36.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b8bfff700 1 -- 172.21.15.16:0/3066916243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b8c0b3170 msgr2=0x7f4b8c1f0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:36.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b8bfff700 1 --2- 172.21.15.16:0/3066916243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b8c0b3170 0x7f4b8c1f0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:36.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b8bfff700 1 -- 172.21.15.16:0/3066916243 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800094a0 con 0x7f4b8c0d0970 2023-08-25T04:43:36.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b8bfff700 1 --2- 172.21.15.16:0/3066916243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b8c0d0970 0x7f4b8c0a8440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800c4f0 tx=0x7f4b7800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:36.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b897fa700 1 -- 172.21.15.16:0/3066916243 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780052d0 con 0x7f4b8c0d0970 2023-08-25T04:43:36.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b897fa700 1 -- 172.21.15.16:0/3066916243 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b78005430 con 0x7f4b8c0d0970 2023-08-25T04:43:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b93052700 1 -- 172.21.15.16:0/3066916243 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8c0a9530 con 0x7f4b8c0d0970 2023-08-25T04:43:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b897fa700 1 -- 172.21.15.16:0/3066916243 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78003880 con 0x7f4b8c0d0970 2023-08-25T04:43:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.964+0000 7f4b93052700 1 -- 172.21.15.16:0/3066916243 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8c0a8980 con 0x7f4b8c0d0970 2023-08-25T04:43:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.965+0000 7f4b93052700 1 -- 172.21.15.16:0/3066916243 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8c1f0bd0 con 0x7f4b8c0d0970 2023-08-25T04:43:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.966+0000 7f4b897fa700 1 -- 172.21.15.16:0/3066916243 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f4b780039e0 con 0x7f4b8c0d0970 2023-08-25T04:43:36.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.966+0000 7f4b897fa700 1 --2- 172.21.15.16:0/3066916243 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4b7006a050 0x7f4b7006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:36.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.966+0000 7f4b897fa700 1 -- 172.21.15.16:0/3066916243 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4b780874e0 con 0x7f4b8c0d0970 2023-08-25T04:43:36.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.966+0000 7f4b90dee700 1 --2- 172.21.15.16:0/3066916243 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4b7006a050 0x7f4b7006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:36.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.967+0000 7f4b90dee700 1 --2- 172.21.15.16:0/3066916243 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4b7006a050 0x7f4b7006c510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009fd0 tx=0x7f4b8001c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:36.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:36.971+0000 7f4b897fa700 1 -- 172.21.15.16:0/3066916243 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4b8c1f0bd0 con 0x7f4b8c0d0970 2023-08-25T04:43:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.180+0000 7f4b93052700 1 -- 172.21.15.16:0/3066916243 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b8c1f0bd0 con 0x7f4b8c0d0970 2023-08-25T04:43:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.181+0000 7f4b897fa700 1 -- 172.21.15.16:0/3066916243 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14617 (secure 0 0 0) 0x7f4b8c1f0bd0 con 0x7f4b8c0d0970 2023-08-25T04:43:37.182 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:37.182 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":16,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:43:36.776502+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:43:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.183+0000 7f4b93052700 1 -- 172.21.15.16:0/3066916243 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4b7006a050 msgr2=0x7f4b7006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.183+0000 7f4b93052700 1 --2- 172.21.15.16:0/3066916243 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4b7006a050 0x7f4b7006c510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009fd0 tx=0x7f4b8001c040 comp rx=0 tx=0).stop 2023-08-25T04:43:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.183+0000 7f4b93052700 1 -- 172.21.15.16:0/3066916243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b8c0d0970 msgr2=0x7f4b8c0a8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.183+0000 7f4b93052700 1 --2- 172.21.15.16:0/3066916243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b8c0d0970 0x7f4b8c0a8440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800c4f0 tx=0x7f4b7800c800 comp rx=0 tx=0).stop 2023-08-25T04:43:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.183+0000 7f4b93052700 1 -- 172.21.15.16:0/3066916243 shutdown_connections 2023-08-25T04:43:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.183+0000 7f4b93052700 1 --2- 172.21.15.16:0/3066916243 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4b7006a050 0x7f4b7006c510 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.183+0000 7f4b93052700 1 --2- 172.21.15.16:0/3066916243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b8c15b380 0x7f4b8c0b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.183+0000 7f4b93052700 1 --2- 172.21.15.16:0/3066916243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b8c0b3170 0x7f4b8c1f0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.183+0000 7f4b93052700 1 --2- 172.21.15.16:0/3066916243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b8c0d0970 0x7f4b8c0a8440 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.183+0000 7f4b93052700 1 -- 172.21.15.16:0/3066916243 >> 172.21.15.16:0/3066916243 conn(0x7f4b8c0d0fe0 msgr2=0x7f4b8c0b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:37.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.183+0000 7f4b93052700 1 -- 172.21.15.16:0/3066916243 shutdown_connections 2023-08-25T04:43:37.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.183+0000 7f4b93052700 1 -- 172.21.15.16:0/3066916243 wait complete. 2023-08-25T04:43:37.200 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:43:34.951742+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:43:35.360236+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:43:37.201 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:43:37.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.331+0000 7f30745c4700 1 Processor -- start 2023-08-25T04:43:37.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.331+0000 7f30745c4700 1 -- start start 2023-08-25T04:43:37.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f30745c4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f306c146560 0x7f306c0d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:37.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f30745c4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f306c146aa0 0x7f306c06a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:37.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f30745c4700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c161810 con 0x7f306c06a880 2023-08-25T04:43:37.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f30745c4700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c146940 con 0x7f306c146560 2023-08-25T04:43:37.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f30745c4700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c06ad30 con 0x7f306c146aa0 2023-08-25T04:43:37.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f3072360700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f306c146560 0x7f306c0d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:37.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f3072360700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f306c146560 0x7f306c0d0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48822/0 (socket says 172.21.15.16:48822) 2023-08-25T04:43:37.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f3072360700 1 -- 172.21.15.16:0/2130652000 learned_addr learned my addr 172.21.15.16:0/2130652000 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:37.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f3071b5f700 1 --2- 172.21.15.16:0/2130652000 >> v2:172.21.15.117:3300/0 conn(0x7f306c146aa0 0x7f306c06a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:37.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f307135e700 1 -- 172.21.15.16:0/2130652000 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142299099 0 0) 0x7f306c161810 con 0x7f306c06a880 2023-08-25T04:43:37.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f3072360700 1 -- 172.21.15.16:0/2130652000 >> v2:172.21.15.117:3300/0 conn(0x7f306c146aa0 msgr2=0x7f306c06a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:37.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f3072360700 1 --2- 172.21.15.16:0/2130652000 >> v2:172.21.15.117:3300/0 conn(0x7f306c146aa0 0x7f306c06a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f3072360700 1 -- 172.21.15.16:0/2130652000 >> v1:172.21.15.117:6789/0 conn(0x7f306c06a880 legacy=0x7f306c070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:37.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f3072360700 1 -- 172.21.15.16:0/2130652000 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c06e210 con 0x7f306c146560 2023-08-25T04:43:37.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.332+0000 7f3071b5f700 1 --2- 172.21.15.16:0/2130652000 >> v2:172.21.15.117:3300/0 conn(0x7f306c146aa0 0x7f306c06a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:37.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.333+0000 7f3072360700 1 --2- 172.21.15.16:0/2130652000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f306c146560 0x7f306c0d0920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f306c0cfdd0 tx=0x7f3068009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f342ae5bf0834641 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:37.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.333+0000 7f307135e700 1 -- 172.21.15.16:0/2130652000 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068011830 con 0x7f306c146560 2023-08-25T04:43:37.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.333+0000 7f307135e700 1 -- 172.21.15.16:0/2130652000 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3068011990 con 0x7f306c146560 2023-08-25T04:43:37.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.333+0000 7f307135e700 1 -- 172.21.15.16:0/2130652000 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068011d20 con 0x7f306c146560 2023-08-25T04:43:37.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.333+0000 7f30745c4700 1 -- 172.21.15.16:0/2130652000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f306c146560 msgr2=0x7f306c0d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:37.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.333+0000 7f30745c4700 1 --2- 172.21.15.16:0/2130652000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f306c146560 0x7f306c0d0920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f306c0cfdd0 tx=0x7f3068009bd0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.333+0000 7f30745c4700 1 -- 172.21.15.16:0/2130652000 shutdown_connections 2023-08-25T04:43:37.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.333+0000 7f30745c4700 1 --2- 172.21.15.16:0/2130652000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f306c146560 0x7f306c0d0920 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.333+0000 7f30745c4700 1 --2- 172.21.15.16:0/2130652000 >> v2:172.21.15.117:3300/0 conn(0x7f306c146aa0 0x7f306c06a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.333+0000 7f30745c4700 1 -- 172.21.15.16:0/2130652000 >> 172.21.15.16:0/2130652000 conn(0x7f306c0cfe00 msgr2=0x7f306c0d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:37.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.334+0000 7f30745c4700 1 -- 172.21.15.16:0/2130652000 shutdown_connections 2023-08-25T04:43:37.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.334+0000 7f30745c4700 1 -- 172.21.15.16:0/2130652000 wait complete. 2023-08-25T04:43:37.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.335+0000 7f30745c4700 1 Processor -- start 2023-08-25T04:43:37.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.335+0000 7f30745c4700 1 -- start start 2023-08-25T04:43:37.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.335+0000 7f30745c4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f306c06a880 0x7f306c0af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:37.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.335+0000 7f30745c4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f306c146560 0x7f306c13b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:37.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f30745c4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f306c146aa0 0x7f306c13ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:37.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f30745c4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c1409b0 con 0x7f306c146560 2023-08-25T04:43:37.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f30745c4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c13ba60 con 0x7f306c06a880 2023-08-25T04:43:37.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f30745c4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c13bd40 con 0x7f306c146aa0 2023-08-25T04:43:37.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3071b5f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f306c146560 0x7f306c13b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:37.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3071b5f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f306c146560 0x7f306c13b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48830/0 (socket says 172.21.15.16:48830) 2023-08-25T04:43:37.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3071b5f700 1 -- 172.21.15.16:0/2983796931 learned_addr learned my addr 172.21.15.16:0/2983796931 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:37.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3072360700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f306c06a880 0x7f306c0af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:37.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3072b61700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f306c146aa0 0x7f306c13ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:37.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3071b5f700 1 -- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f306c146aa0 msgr2=0x7f306c13ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:37.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3071b5f700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f306c146aa0 0x7f306c13ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3071b5f700 1 -- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f306c06a880 msgr2=0x7f306c0af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:37.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3071b5f700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f306c06a880 0x7f306c0af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3071b5f700 1 -- 172.21.15.16:0/2983796931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c0094a0 con 0x7f306c146560 2023-08-25T04:43:37.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3072360700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f306c06a880 0x7f306c0af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3071b5f700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f306c146560 0x7f306c13b210 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f305c00ebb0 tx=0x7f305c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3062ffd700 1 -- 172.21.15.16:0/2983796931 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00c850 con 0x7f306c146560 2023-08-25T04:43:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3062ffd700 1 -- 172.21.15.16:0/2983796931 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c00c9b0 con 0x7f306c146560 2023-08-25T04:43:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f30745c4700 1 -- 172.21.15.16:0/2983796931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3068009550 con 0x7f306c146560 2023-08-25T04:43:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f3062ffd700 1 -- 172.21.15.16:0/2983796931 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00cd40 con 0x7f306c146560 2023-08-25T04:43:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.336+0000 7f30745c4700 1 -- 172.21.15.16:0/2983796931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c13b750 con 0x7f306c146560 2023-08-25T04:43:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.338+0000 7f30745c4700 1 -- 172.21.15.16:0/2983796931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c06edf0 con 0x7f306c146560 2023-08-25T04:43:37.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.338+0000 7f3062ffd700 1 -- 172.21.15.16:0/2983796931 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f305c013470 con 0x7f306c146560 2023-08-25T04:43:37.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.339+0000 7f3062ffd700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f305006a050 0x7f305006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:37.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.339+0000 7f3062ffd700 1 -- 172.21.15.16:0/2983796931 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f305c088050 con 0x7f306c146560 2023-08-25T04:43:37.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.339+0000 7f3072360700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f305006a050 0x7f305006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:37.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.339+0000 7f3072360700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f305006a050 0x7f305006c510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3068014040 tx=0x7f3068008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:37.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.343+0000 7f3062ffd700 1 -- 172.21.15.16:0/2983796931 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f305c053c00 con 0x7f306c146560 2023-08-25T04:43:37.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.551+0000 7f30745c4700 1 -- 172.21.15.16:0/2983796931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f306c140710 con 0x7f306c146560 2023-08-25T04:43:37.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.551+0000 7f3062ffd700 1 -- 172.21.15.16:0/2983796931 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f306c140710 con 0x7f306c146560 2023-08-25T04:43:37.553 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-08-25T04:43:37.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.553+0000 7f30745c4700 1 -- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f305006a050 msgr2=0x7f305006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:37.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.553+0000 7f30745c4700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f305006a050 0x7f305006c510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3068014040 tx=0x7f3068008030 comp rx=0 tx=0).stop 2023-08-25T04:43:37.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.553+0000 7f30745c4700 1 -- 172.21.15.16:0/2983796931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f306c146560 msgr2=0x7f306c13b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:37.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.553+0000 7f30745c4700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f306c146560 0x7f306c13b210 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f305c00ebb0 tx=0x7f305c00eec0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.553+0000 7f30745c4700 1 -- 172.21.15.16:0/2983796931 shutdown_connections 2023-08-25T04:43:37.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.553+0000 7f30745c4700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f305006a050 0x7f305006c510 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.553+0000 7f30745c4700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f306c146aa0 0x7f306c13ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.553+0000 7f30745c4700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f306c06a880 0x7f306c0af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.553+0000 7f30745c4700 1 --2- 172.21.15.16:0/2983796931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f306c146560 0x7f306c13b210 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.554+0000 7f30745c4700 1 -- 172.21.15.16:0/2983796931 >> 172.21.15.16:0/2983796931 conn(0x7f306c0cfe00 msgr2=0x7f306c0b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:37.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.554+0000 7f30745c4700 1 -- 172.21.15.16:0/2983796931 shutdown_connections 2023-08-25T04:43:37.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.554+0000 7f30745c4700 1 -- 172.21.15.16:0/2983796931 wait complete. 2023-08-25T04:43:37.567 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:43:37.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.694+0000 7f0a503e1700 1 Processor -- start 2023-08-25T04:43:37.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.694+0000 7f0a503e1700 1 -- start start 2023-08-25T04:43:37.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.695+0000 7f0a503e1700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0a480ca450 0x7f0a480cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:37.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.695+0000 7f0a503e1700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a4806d270 0x7f0a4806d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:37.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.695+0000 7f0a503e1700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a480ce1c0 con 0x7f0a4806a340 2023-08-25T04:43:37.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.695+0000 7f0a503e1700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a480ca900 con 0x7f0a4806d270 2023-08-25T04:43:37.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.695+0000 7f0a503e1700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4806edb0 con 0x7f0a480ca450 2023-08-25T04:43:37.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.695+0000 7f0a4e97e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a4806d270 0x7f0a4806d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:37.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.695+0000 7f0a4e97e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a4806d270 0x7f0a4806d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48840/0 (socket says 172.21.15.16:48840) 2023-08-25T04:43:37.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.695+0000 7f0a4e97e700 1 -- 172.21.15.16:0/3464471053 learned_addr learned my addr 172.21.15.16:0/3464471053 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:37.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.695+0000 7f0a4d97c700 1 --2- 172.21.15.16:0/3464471053 >> v2:172.21.15.117:3300/0 conn(0x7f0a480ca450 0x7f0a480cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:37.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.696+0000 7f0a4e97e700 1 -- 172.21.15.16:0/3464471053 >> v2:172.21.15.117:3300/0 conn(0x7f0a480ca450 msgr2=0x7f0a480cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:37.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.696+0000 7f0a4e97e700 1 --2- 172.21.15.16:0/3464471053 >> v2:172.21.15.117:3300/0 conn(0x7f0a480ca450 0x7f0a480cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.696+0000 7f0a4e97e700 1 -- 172.21.15.16:0/3464471053 >> v1:172.21.15.117:6789/0 conn(0x7f0a4806a340 legacy=0x7f0a4806a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:37.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.696+0000 7f0a4e97e700 1 -- 172.21.15.16:0/3464471053 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4806ead0 con 0x7f0a4806d270 2023-08-25T04:43:37.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.696+0000 7f0a4e97e700 1 --2- 172.21.15.16:0/3464471053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a4806d270 0x7f0a4806d6a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a480d0f00 tx=0x7f0a4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9953d05135d654e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:37.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.778+0000 7f0a4d17b700 1 -- 172.21.15.16:0/3464471053 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000e070 con 0x7f0a4806d270 2023-08-25T04:43:37.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.778+0000 7f0a4d17b700 1 -- 172.21.15.16:0/3464471053 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4000b910 con 0x7f0a4806d270 2023-08-25T04:43:37.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.778+0000 7f0a4d17b700 1 -- 172.21.15.16:0/3464471053 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000bcc0 con 0x7f0a4806d270 2023-08-25T04:43:37.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.779+0000 7f0a503e1700 1 -- 172.21.15.16:0/3464471053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a4806d270 msgr2=0x7f0a4806d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:37.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.779+0000 7f0a503e1700 1 --2- 172.21.15.16:0/3464471053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a4806d270 0x7f0a4806d6a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a480d0f00 tx=0x7f0a4000b330 comp rx=0 tx=0).stop 2023-08-25T04:43:37.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.779+0000 7f0a503e1700 1 -- 172.21.15.16:0/3464471053 shutdown_connections 2023-08-25T04:43:37.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.779+0000 7f0a503e1700 1 --2- 172.21.15.16:0/3464471053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a4806d270 0x7f0a4806d6a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.779+0000 7f0a503e1700 1 --2- 172.21.15.16:0/3464471053 >> v2:172.21.15.117:3300/0 conn(0x7f0a480ca450 0x7f0a480cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.779+0000 7f0a503e1700 1 -- 172.21.15.16:0/3464471053 >> 172.21.15.16:0/3464471053 conn(0x7f0a480cfe00 msgr2=0x7f0a480d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:37.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.779+0000 7f0a503e1700 1 -- 172.21.15.16:0/3464471053 shutdown_connections 2023-08-25T04:43:37.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.779+0000 7f0a503e1700 1 -- 172.21.15.16:0/3464471053 wait complete. 2023-08-25T04:43:37.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.780+0000 7f0a503e1700 1 Processor -- start 2023-08-25T04:43:37.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.781+0000 7f0a503e1700 1 -- start start 2023-08-25T04:43:37.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.781+0000 7f0a503e1700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4806a340 0x7f0a48159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:37.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.781+0000 7f0a503e1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a4806d270 0x7f0a480b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:37.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a503e1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a480ca450 0x7f0a480b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:37.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a503e1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a481f5110 con 0x7f0a480ca450 2023-08-25T04:43:37.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a503e1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a481f44d0 con 0x7f0a4806d270 2023-08-25T04:43:37.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a503e1700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4813bf30 con 0x7f0a4806a340 2023-08-25T04:43:37.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a4e97e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a480ca450 0x7f0a480b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:37.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a4e97e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a480ca450 0x7f0a480b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48846/0 (socket says 172.21.15.16:48846) 2023-08-25T04:43:37.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a4e97e700 1 -- 172.21.15.16:0/1939931946 learned_addr learned my addr 172.21.15.16:0/1939931946 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:37.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a4e17d700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4806a340 0x7f0a48159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:37.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a4d97c700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a4806d270 0x7f0a480b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:37.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a4e97e700 1 -- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4806a340 msgr2=0x7f0a48159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:37.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a4e97e700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4806a340 0x7f0a48159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a4e97e700 1 -- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a4806d270 msgr2=0x7f0a480b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:37.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a4e97e700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a4806d270 0x7f0a480b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a4e97e700 1 -- 172.21.15.16:0/1939931946 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a40009b30 con 0x7f0a480ca450 2023-08-25T04:43:37.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a4d97c700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a4806d270 0x7f0a480b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:37.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a4e97e700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a480ca450 0x7f0a480b50f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a480cd980 tx=0x7f0a40004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:37.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a3effd700 1 -- 172.21.15.16:0/1939931946 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40004930 con 0x7f0a480ca450 2023-08-25T04:43:37.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a3effd700 1 -- 172.21.15.16:0/1939931946 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a400099b0 con 0x7f0a480ca450 2023-08-25T04:43:37.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a503e1700 1 -- 172.21.15.16:0/1939931946 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a481f4770 con 0x7f0a480ca450 2023-08-25T04:43:37.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a3effd700 1 -- 172.21.15.16:0/1939931946 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4001c680 con 0x7f0a480ca450 2023-08-25T04:43:37.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.782+0000 7f0a503e1700 1 -- 172.21.15.16:0/1939931946 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a481f4d30 con 0x7f0a480ca450 2023-08-25T04:43:37.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.783+0000 7f0a503e1700 1 -- 172.21.15.16:0/1939931946 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a480ce6e0 con 0x7f0a480ca450 2023-08-25T04:43:37.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.784+0000 7f0a3effd700 1 -- 172.21.15.16:0/1939931946 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f0a4001c7e0 con 0x7f0a480ca450 2023-08-25T04:43:37.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.784+0000 7f0a3effd700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0a2c06a050 0x7f0a2c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:37.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.784+0000 7f0a3effd700 1 -- 172.21.15.16:0/1939931946 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0a40089950 con 0x7f0a480ca450 2023-08-25T04:43:37.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.784+0000 7f0a4e17d700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0a2c06a050 0x7f0a2c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:37.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.785+0000 7f0a4e17d700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0a2c06a050 0x7f0a2c06c510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0a44007fd0 tx=0x7f0a44009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:37.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.789+0000 7f0a3effd700 1 -- 172.21.15.16:0/1939931946 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0a40055500 con 0x7f0a480ca450 2023-08-25T04:43:37.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.994+0000 7f0a503e1700 1 -- 172.21.15.16:0/1939931946 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a481f5250 con 0x7f0a480ca450 2023-08-25T04:43:37.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.994+0000 7f0a3effd700 1 -- 172.21.15.16:0/1939931946 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a40058b20 con 0x7f0a480ca450 2023-08-25T04:43:37.996 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-08-25T04:43:37.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.996+0000 7f0a503e1700 1 -- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0a2c06a050 msgr2=0x7f0a2c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:37.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.996+0000 7f0a503e1700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0a2c06a050 0x7f0a2c06c510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0a44007fd0 tx=0x7f0a44009040 comp rx=0 tx=0).stop 2023-08-25T04:43:37.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.996+0000 7f0a503e1700 1 -- 172.21.15.16:0/1939931946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a480ca450 msgr2=0x7f0a480b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:37.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.996+0000 7f0a503e1700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a480ca450 0x7f0a480b50f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a480cd980 tx=0x7f0a40004ad0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.996+0000 7f0a503e1700 1 -- 172.21.15.16:0/1939931946 shutdown_connections 2023-08-25T04:43:37.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.996+0000 7f0a503e1700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0a2c06a050 0x7f0a2c06c510 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.996+0000 7f0a503e1700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a480ca450 0x7f0a480b50f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.996+0000 7f0a503e1700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4806a340 0x7f0a48159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.996+0000 7f0a503e1700 1 --2- 172.21.15.16:0/1939931946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a4806d270 0x7f0a480b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:37.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.997+0000 7f0a503e1700 1 -- 172.21.15.16:0/1939931946 >> 172.21.15.16:0/1939931946 conn(0x7f0a480cfe00 msgr2=0x7f0a4806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:37.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.997+0000 7f0a503e1700 1 -- 172.21.15.16:0/1939931946 shutdown_connections 2023-08-25T04:43:37.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:37.997+0000 7f0a503e1700 1 -- 172.21.15.16:0/1939931946 wait complete. 2023-08-25T04:43:38.010 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:43:38.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.136+0000 7f9c5737e700 1 Processor -- start 2023-08-25T04:43:38.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.136+0000 7f9c5737e700 1 -- start start 2023-08-25T04:43:38.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c5737e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9c500cf970 0x7f9c5006a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c5737e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c500ac850 con 0x7f9c5015cf40 2023-08-25T04:43:38.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c5737e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c500ce240 con 0x7f9c5015d320 2023-08-25T04:43:38.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c5737e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c50071a60 con 0x7f9c500cf970 2023-08-25T04:43:38.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c5511a700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9c5015cf40 0x7f9c500cda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39266/0 (socket says 172.21.15.16:39266) 2023-08-25T04:43:38.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c5511a700 1 -- 172.21.15.16:0/3206760072 learned_addr learned my addr 172.21.15.16:0/3206760072 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:38.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c54919700 1 --2- 172.21.15.16:0/3206760072 >> v2:172.21.15.117:3300/0 conn(0x7f9c500cf970 0x7f9c5006a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424706122 0 0) 0x7f9c500ac850 con 0x7f9c5015cf40 2023-08-25T04:43:38.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c380035b0 con 0x7f9c5015cf40 2023-08-25T04:43:38.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960622490 0 0) 0x7f9c500ce240 con 0x7f9c5015d320 2023-08-25T04:43:38.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c500ac850 con 0x7f9c5015d320 2023-08-25T04:43:38.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 892039458 0 0) 0x7f9c380035b0 con 0x7f9c5015cf40 2023-08-25T04:43:38.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 >> v2:172.21.15.117:3300/0 conn(0x7f9c500cf970 msgr2=0x7f9c5006a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:38.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c4ffff700 1 --2- 172.21.15.16:0/3206760072 >> v2:172.21.15.117:3300/0 conn(0x7f9c500cf970 0x7f9c5006a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 >> v1:172.21.15.117:6789/0 conn(0x7f9c5015d320 legacy=0x7f9c500acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c50071d40 con 0x7f9c5015cf40 2023-08-25T04:43:38.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.137+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f9c48001670 con 0x7f9c5015cf40 2023-08-25T04:43:38.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 >> v1:172.21.15.16:6789/0 conn(0x7f9c5015cf40 legacy=0x7f9c500cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c4ffff700 1 --2- 172.21.15.16:0/3206760072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c38003c00 0x7f9c38004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c4ffff700 1 --2- 172.21.15.16:0/3206760072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c38004850 0x7f9c38004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c4ffff700 1 --2- 172.21.15.16:0/3206760072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c38005210 0x7f9c3800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c50071a60 con 0x7f9c38004850 2023-08-25T04:43:38.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3800c110 con 0x7f9c38005210 2023-08-25T04:43:38.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3800c2d0 con 0x7f9c38003c00 2023-08-25T04:43:38.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c54919700 1 --2- 172.21.15.16:0/3206760072 >> v2:172.21.15.117:3300/0 conn(0x7f9c500cf970 0x7f9c5006a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:38.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c5511a700 1 --2- 172.21.15.16:0/3206760072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c38003c00 0x7f9c38004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c5591b700 1 --2- 172.21.15.16:0/3206760072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c38005210 0x7f9c3800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c54919700 1 --2- 172.21.15.16:0/3206760072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c38004850 0x7f9c38004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c54919700 1 -- 172.21.15.16:0/3206760072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c38003c00 msgr2=0x7f9c38004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:38.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c54919700 1 --2- 172.21.15.16:0/3206760072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c38003c00 0x7f9c38004000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c54919700 1 -- 172.21.15.16:0/3206760072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c38005210 msgr2=0x7f9c3800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:38.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c54919700 1 --2- 172.21.15.16:0/3206760072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c38005210 0x7f9c3800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c54919700 1 -- 172.21.15.16:0/3206760072 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c380035b0 con 0x7f9c38004850 2023-08-25T04:43:38.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c5591b700 1 -- 172.21.15.16:0/3206760072 reap_dead start 2023-08-25T04:43:38.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c54919700 1 --2- 172.21.15.16:0/3206760072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c38004850 0x7f9c38004cd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009ce0 tx=0x7f9c38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2976f679dc845b19 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:38.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44004030 con 0x7f9c38004850 2023-08-25T04:43:38.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c44004190 con 0x7f9c38004850 2023-08-25T04:43:38.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.138+0000 7f9c4ffff700 1 -- 172.21.15.16:0/3206760072 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44004520 con 0x7f9c38004850 2023-08-25T04:43:38.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.139+0000 7f9c5737e700 1 -- 172.21.15.16:0/3206760072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c38004850 msgr2=0x7f9c38004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.139+0000 7f9c5737e700 1 --2- 172.21.15.16:0/3206760072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c38004850 0x7f9c38004cd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009ce0 tx=0x7f9c38005880 comp rx=0 tx=0).stop 2023-08-25T04:43:38.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.139+0000 7f9c5737e700 1 -- 172.21.15.16:0/3206760072 shutdown_connections 2023-08-25T04:43:38.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.139+0000 7f9c5737e700 1 --2- 172.21.15.16:0/3206760072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c38004850 0x7f9c38004cd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.139+0000 7f9c5737e700 1 -- 172.21.15.16:0/3206760072 >> 172.21.15.16:0/3206760072 conn(0x7f9c500b1a10 msgr2=0x7f9c500b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:38.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.139+0000 7f9c5737e700 1 -- 172.21.15.16:0/3206760072 shutdown_connections 2023-08-25T04:43:38.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.139+0000 7f9c5737e700 1 -- 172.21.15.16:0/3206760072 wait complete. 2023-08-25T04:43:38.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.140+0000 7f9c5737e700 1 Processor -- start 2023-08-25T04:43:38.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.140+0000 7f9c5737e700 1 -- start start 2023-08-25T04:43:38.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.141+0000 7f9c5737e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c38004850 0x7f9c500b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.141+0000 7f9c5737e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c50155dc0 0x7f9c500b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.141+0000 7f9c5737e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c500b0f20 0x7f9c501551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.141+0000 7f9c5737e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500b2e00 con 0x7f9c38004850 2023-08-25T04:43:38.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.141+0000 7f9c5737e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500b57b0 con 0x7f9c500b0f20 2023-08-25T04:43:38.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.141+0000 7f9c5737e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500b4750 con 0x7f9c50155dc0 2023-08-25T04:43:38.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.141+0000 7f9c5511a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c38004850 0x7f9c500b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.141+0000 7f9c5511a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c38004850 0x7f9c500b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48864/0 (socket says 172.21.15.16:48864) 2023-08-25T04:43:38.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.141+0000 7f9c5511a700 1 -- 172.21.15.16:0/2397645519 learned_addr learned my addr 172.21.15.16:0/2397645519 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:38.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.141+0000 7f9c54919700 1 --2- 172.21.15.16:0/2397645519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c50155dc0 0x7f9c500b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.141+0000 7f9c5591b700 1 --2- 172.21.15.16:0/2397645519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c500b0f20 0x7f9c501551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.142+0000 7f9c5511a700 1 -- 172.21.15.16:0/2397645519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c50155dc0 msgr2=0x7f9c500b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.142+0000 7f9c5511a700 1 --2- 172.21.15.16:0/2397645519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c50155dc0 0x7f9c500b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.142+0000 7f9c5511a700 1 -- 172.21.15.16:0/2397645519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c500b0f20 msgr2=0x7f9c501551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.142+0000 7f9c5511a700 1 --2- 172.21.15.16:0/2397645519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c500b0f20 0x7f9c501551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.142+0000 7f9c5511a700 1 -- 172.21.15.16:0/2397645519 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c500b4a20 con 0x7f9c38004850 2023-08-25T04:43:38.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.142+0000 7f9c5511a700 1 --2- 172.21.15.16:0/2397645519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c38004850 0x7f9c500b4210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9c48007310 tx=0x7f9c48007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:38.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.142+0000 7f9c4dffb700 1 -- 172.21.15.16:0/2397645519 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48012560 con 0x7f9c38004850 2023-08-25T04:43:38.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.142+0000 7f9c4dffb700 1 -- 172.21.15.16:0/2397645519 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c48012700 con 0x7f9c38004850 2023-08-25T04:43:38.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.142+0000 7f9c5737e700 1 -- 172.21.15.16:0/2397645519 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c500b4d00 con 0x7f9c38004850 2023-08-25T04:43:38.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.142+0000 7f9c4dffb700 1 -- 172.21.15.16:0/2397645519 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48012ab0 con 0x7f9c38004850 2023-08-25T04:43:38.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.142+0000 7f9c5737e700 1 -- 172.21.15.16:0/2397645519 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c500b3760 con 0x7f9c38004850 2023-08-25T04:43:38.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.143+0000 7f9c5737e700 1 -- 172.21.15.16:0/2397645519 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c500b3920 con 0x7f9c38004850 2023-08-25T04:43:38.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.144+0000 7f9c4dffb700 1 -- 172.21.15.16:0/2397645519 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9c48012c10 con 0x7f9c38004850 2023-08-25T04:43:38.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.144+0000 7f9c4dffb700 1 --2- 172.21.15.16:0/2397645519 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f9c3c06a0e0 0x7f9c3c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.144+0000 7f9c4dffb700 1 -- 172.21.15.16:0/2397645519 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9c48088090 con 0x7f9c38004850 2023-08-25T04:43:38.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.144+0000 7f9c54919700 1 --2- 172.21.15.16:0/2397645519 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f9c3c06a0e0 0x7f9c3c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.145+0000 7f9c54919700 1 --2- 172.21.15.16:0/2397645519 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f9c3c06a0e0 0x7f9c3c06c5a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9c440090b0 tx=0x7f9c4401e040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:38.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.149+0000 7f9c4dffb700 1 -- 172.21.15.16:0/2397645519 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9c48053ad0 con 0x7f9c38004850 2023-08-25T04:43:38.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.393+0000 7f9c5737e700 1 -- 172.21.15.16:0/2397645519 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c5004ee70 con 0x7f9c38004850 2023-08-25T04:43:38.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.394+0000 7f9c4dffb700 1 -- 172.21.15.16:0/2397645519 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3688 (secure 0 0 0) 0x7f9c480570f0 con 0x7f9c38004850 2023-08-25T04:43:38.395 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:38.395 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/397913125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":397913125},{"type":"v1","addr":"172.21.15.16:6834","nonce":397913125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1401503507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1401503507},{"type":"v1","addr":"172.21.15.117:6835","nonce":1401503507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/899398848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":899398848},{"type":"v1","addr":"172.21.15.16:6835","nonce":899398848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/36836471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":36836471},{"type":"v1","addr":"172.21.15.117:6837","nonce":36836471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-08-25T04:43:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.396+0000 7f9c5737e700 1 -- 172.21.15.16:0/2397645519 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f9c3c06a0e0 msgr2=0x7f9c3c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.396+0000 7f9c5737e700 1 --2- 172.21.15.16:0/2397645519 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f9c3c06a0e0 0x7f9c3c06c5a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9c440090b0 tx=0x7f9c4401e040 comp rx=0 tx=0).stop 2023-08-25T04:43:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.396+0000 7f9c5737e700 1 -- 172.21.15.16:0/2397645519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c38004850 msgr2=0x7f9c500b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.396+0000 7f9c5737e700 1 --2- 172.21.15.16:0/2397645519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c38004850 0x7f9c500b4210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9c48007310 tx=0x7f9c48007620 comp rx=0 tx=0).stop 2023-08-25T04:43:38.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.396+0000 7f9c5737e700 1 -- 172.21.15.16:0/2397645519 shutdown_connections 2023-08-25T04:43:38.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.396+0000 7f9c5737e700 1 --2- 172.21.15.16:0/2397645519 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f9c3c06a0e0 0x7f9c3c06c5a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.396+0000 7f9c5737e700 1 --2- 172.21.15.16:0/2397645519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c500b0f20 0x7f9c501551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.396+0000 7f9c5737e700 1 --2- 172.21.15.16:0/2397645519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c38004850 0x7f9c500b4210 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.396+0000 7f9c5737e700 1 --2- 172.21.15.16:0/2397645519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c50155dc0 0x7f9c500b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.396+0000 7f9c5737e700 1 -- 172.21.15.16:0/2397645519 >> 172.21.15.16:0/2397645519 conn(0x7f9c500b1a10 msgr2=0x7f9c500ad5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:38.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.396+0000 7f9c5737e700 1 -- 172.21.15.16:0/2397645519 shutdown_connections 2023-08-25T04:43:38.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.396+0000 7f9c5737e700 1 -- 172.21.15.16:0/2397645519 wait complete. 2023-08-25T04:43:38.399 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 3 2023-08-25T04:43:38.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:43:38.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.532+0000 7fb0a9b88700 1 Processor -- start 2023-08-25T04:43:38.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.532+0000 7fb0a9b88700 1 -- start start 2023-08-25T04:43:38.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.533+0000 7fb0a9b88700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb0a40cc830 0x7fb0a40ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a9b88700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40cedc0 0x7fb0a406d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a9b88700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a40cbfe0 con 0x7fb0a40caf10 2023-08-25T04:43:38.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a9b88700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a40cd150 con 0x7fb0a40cc830 2023-08-25T04:43:38.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a9b88700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40cb3d0 con 0x7fb0a40cedc0 2023-08-25T04:43:38.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a2ffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb0a40caf10 0x7fb0a406ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39288/0 (socket says 172.21.15.16:39288) 2023-08-25T04:43:38.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a2ffd700 1 -- 172.21.15.16:0/1487099610 learned_addr learned my addr 172.21.15.16:0/1487099610 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:38.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a3fff700 1 --2- 172.21.15.16:0/1487099610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40cedc0 0x7fb0a406d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a37fe700 1 --2- 172.21.15.16:0/1487099610 >> v2:172.21.15.117:3300/0 conn(0x7fb0a40cc830 0x7fb0a40ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a27fc700 1 -- 172.21.15.16:0/1487099610 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962496784 0 0) 0x7fb0a40cbfe0 con 0x7fb0a40caf10 2023-08-25T04:43:38.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a27fc700 1 -- 172.21.15.16:0/1487099610 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0900057c0 con 0x7fb0a40caf10 2023-08-25T04:43:38.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a3fff700 1 -- 172.21.15.16:0/1487099610 >> v2:172.21.15.117:3300/0 conn(0x7fb0a40cc830 msgr2=0x7fb0a40ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:38.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a3fff700 1 --2- 172.21.15.16:0/1487099610 >> v2:172.21.15.117:3300/0 conn(0x7fb0a40cc830 0x7fb0a40ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a3fff700 1 -- 172.21.15.16:0/1487099610 >> v1:172.21.15.16:6789/0 conn(0x7fb0a40caf10 legacy=0x7fb0a406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a3fff700 1 -- 172.21.15.16:0/1487099610 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a40cb6b0 con 0x7fb0a40cedc0 2023-08-25T04:43:38.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a3fff700 1 --2- 172.21.15.16:0/1487099610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40cedc0 0x7fb0a406d5e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009d90 tx=0x7fb09c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8397812010e105c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:38.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.534+0000 7fb0a27fc700 1 -- 172.21.15.16:0/1487099610 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00e070 con 0x7fb0a40cedc0 2023-08-25T04:43:38.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.535+0000 7fb0a27fc700 1 -- 172.21.15.16:0/1487099610 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c00bb20 con 0x7fb0a40cedc0 2023-08-25T04:43:38.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.535+0000 7fb0a27fc700 1 -- 172.21.15.16:0/1487099610 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c012430 con 0x7fb0a40cedc0 2023-08-25T04:43:38.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.535+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1487099610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40cedc0 msgr2=0x7fb0a406d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.535+0000 7fb0a9b88700 1 --2- 172.21.15.16:0/1487099610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40cedc0 0x7fb0a406d5e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009d90 tx=0x7fb09c00b330 comp rx=0 tx=0).stop 2023-08-25T04:43:38.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.535+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1487099610 shutdown_connections 2023-08-25T04:43:38.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.535+0000 7fb0a9b88700 1 --2- 172.21.15.16:0/1487099610 >> v2:172.21.15.117:3300/0 conn(0x7fb0a40cc830 0x7fb0a40ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.535+0000 7fb0a9b88700 1 --2- 172.21.15.16:0/1487099610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40cedc0 0x7fb0a406d5e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.535+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1487099610 >> 172.21.15.16:0/1487099610 conn(0x7fb0a40b1a10 msgr2=0x7fb0a40b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:38.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.535+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1487099610 shutdown_connections 2023-08-25T04:43:38.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.535+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1487099610 wait complete. 2023-08-25T04:43:38.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.537+0000 7fb0a9b88700 1 Processor -- start 2023-08-25T04:43:38.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.537+0000 7fb0a9b88700 1 -- start start 2023-08-25T04:43:38.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a9b88700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0a40caf10 0x7fb0a414dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a9b88700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0a40cc830 0x7fb0a415acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a9b88700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40cedc0 0x7fb0a415b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a9b88700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40c3c10 con 0x7fb0a40cc830 2023-08-25T04:43:38.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a9b88700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a414eb40 con 0x7fb0a40caf10 2023-08-25T04:43:38.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a9b88700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40af2f0 con 0x7fb0a40cedc0 2023-08-25T04:43:38.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0a40cc830 0x7fb0a415acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0a40cc830 0x7fb0a415acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48880/0 (socket says 172.21.15.16:48880) 2023-08-25T04:43:38.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a2ffd700 1 -- 172.21.15.16:0/1674631021 learned_addr learned my addr 172.21.15.16:0/1674631021 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:38.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a3fff700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40cedc0 0x7fb0a415b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a37fe700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0a40caf10 0x7fb0a414dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a2ffd700 1 -- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40cedc0 msgr2=0x7fb0a415b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a2ffd700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40cedc0 0x7fb0a415b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a2ffd700 1 -- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0a40caf10 msgr2=0x7fb0a414dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a2ffd700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0a40caf10 0x7fb0a414dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a2ffd700 1 -- 172.21.15.16:0/1674631021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c009a70 con 0x7fb0a40cc830 2023-08-25T04:43:38.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a3fff700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40cedc0 0x7fb0a415b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:38.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.538+0000 7fb0a2ffd700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0a40cc830 0x7fb0a415acb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb094001eb0 tx=0x7fb09400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:38.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.539+0000 7fb09bfff700 1 -- 172.21.15.16:0/1674631021 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094005d70 con 0x7fb0a40cc830 2023-08-25T04:43:38.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.539+0000 7fb09bfff700 1 -- 172.21.15.16:0/1674631021 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0940070d0 con 0x7fb0a40cc830 2023-08-25T04:43:38.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.539+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1674631021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a40ce0a0 con 0x7fb0a40cc830 2023-08-25T04:43:38.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.539+0000 7fb09bfff700 1 -- 172.21.15.16:0/1674631021 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094007460 con 0x7fb0a40cc830 2023-08-25T04:43:38.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.539+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1674631021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a40cdae0 con 0x7fb0a40cc830 2023-08-25T04:43:38.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.540+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1674631021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a40c3970 con 0x7fb0a40cc830 2023-08-25T04:43:38.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.540+0000 7fb09bfff700 1 -- 172.21.15.16:0/1674631021 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb0940075c0 con 0x7fb0a40cc830 2023-08-25T04:43:38.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.540+0000 7fb09bfff700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb08406a0e0 0x7fb08406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.540+0000 7fb09bfff700 1 -- 172.21.15.16:0/1674631021 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb0940876e0 con 0x7fb0a40cc830 2023-08-25T04:43:38.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.541+0000 7fb0a37fe700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb08406a0e0 0x7fb08406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.541+0000 7fb0a37fe700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb08406a0e0 0x7fb08406c5a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009a10 tx=0x7fb08c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:38.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.545+0000 7fb09bfff700 1 -- 172.21.15.16:0/1674631021 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb0a40c3970 con 0x7fb0a40cc830 2023-08-25T04:43:38.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.746+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1674631021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0a40c3d50 con 0x7fb0a40cc830 2023-08-25T04:43:38.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.747+0000 7fb09bfff700 1 -- 172.21.15.16:0/1674631021 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14591 (secure 0 0 0) 0x7fb0a40c3d50 con 0x7fb0a40cc830 2023-08-25T04:43:38.748 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:38.749 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:43:37.782846+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:43:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.749+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb08406a0e0 msgr2=0x7fb08406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.749+0000 7fb0a9b88700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb08406a0e0 0x7fb08406c5a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009a10 tx=0x7fb08c008040 comp rx=0 tx=0).stop 2023-08-25T04:43:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.749+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1674631021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0a40cc830 msgr2=0x7fb0a415acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.749+0000 7fb0a9b88700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0a40cc830 0x7fb0a415acb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb094001eb0 tx=0x7fb09400c860 comp rx=0 tx=0).stop 2023-08-25T04:43:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.749+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1674631021 shutdown_connections 2023-08-25T04:43:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.749+0000 7fb0a9b88700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb08406a0e0 0x7fb08406c5a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.749+0000 7fb0a9b88700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40cedc0 0x7fb0a415b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.749+0000 7fb0a9b88700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0a40caf10 0x7fb0a414dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.749+0000 7fb0a9b88700 1 --2- 172.21.15.16:0/1674631021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0a40cc830 0x7fb0a415acb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.749+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1674631021 >> 172.21.15.16:0/1674631021 conn(0x7fb0a40b1a10 msgr2=0x7fb0a4154e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:38.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.749+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1674631021 shutdown_connections 2023-08-25T04:43:38.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.749+0000 7fb0a9b88700 1 -- 172.21.15.16:0/1674631021 wait complete. 2023-08-25T04:43:38.763 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:43:34.951742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:43:35.360236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:43:38.764 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:43:38.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.891+0000 7f679fa0f700 1 Processor -- start 2023-08-25T04:43:38.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.892+0000 7f679fa0f700 1 -- start start 2023-08-25T04:43:38.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.892+0000 7f679fa0f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f679815d510 0x7f679806c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.892+0000 7f679fa0f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679806ac80 0x7f67980ac140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.892+0000 7f679fa0f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679806da30 con 0x7f6798161900 2023-08-25T04:43:38.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.892+0000 7f679fa0f700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679806ce20 con 0x7f679815d510 2023-08-25T04:43:38.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.892+0000 7f679fa0f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679806d100 con 0x7f679806ac80 2023-08-25T04:43:38.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.893+0000 7f679d7ab700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f679815d510 0x7f679806c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.893+0000 7f679d7ab700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f679815d510 0x7f679806c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48886/0 (socket says 172.21.15.16:48886) 2023-08-25T04:43:38.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.893+0000 7f679d7ab700 1 -- 172.21.15.16:0/3295824016 learned_addr learned my addr 172.21.15.16:0/3295824016 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:38.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.893+0000 7f679dfac700 1 --2- 172.21.15.16:0/3295824016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679806ac80 0x7f67980ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.893+0000 7f679d7ab700 1 -- 172.21.15.16:0/3295824016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679806ac80 msgr2=0x7f67980ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:38.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.893+0000 7f679d7ab700 1 --2- 172.21.15.16:0/3295824016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679806ac80 0x7f67980ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.893+0000 7f679d7ab700 1 -- 172.21.15.16:0/3295824016 >> v1:172.21.15.117:6789/0 conn(0x7f6798161900 legacy=0x7f679806a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:38.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.893+0000 7f679d7ab700 1 -- 172.21.15.16:0/3295824016 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679806d3e0 con 0x7f679815d510 2023-08-25T04:43:38.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.893+0000 7f679d7ab700 1 --2- 172.21.15.16:0/3295824016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f679815d510 0x7f679806c7e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6788006fd0 tx=0x7f6788009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb75656de3048ea server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:38.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.893+0000 7f678ffff700 1 -- 172.21.15.16:0/3295824016 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788005e30 con 0x7f679815d510 2023-08-25T04:43:38.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.893+0000 7f678ffff700 1 -- 172.21.15.16:0/3295824016 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6788006030 con 0x7f679815d510 2023-08-25T04:43:38.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.893+0000 7f678ffff700 1 -- 172.21.15.16:0/3295824016 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880063c0 con 0x7f679815d510 2023-08-25T04:43:38.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.894+0000 7f679fa0f700 1 -- 172.21.15.16:0/3295824016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f679815d510 msgr2=0x7f679806c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.894+0000 7f679fa0f700 1 --2- 172.21.15.16:0/3295824016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f679815d510 0x7f679806c7e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6788006fd0 tx=0x7f6788009bd0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.894+0000 7f679fa0f700 1 -- 172.21.15.16:0/3295824016 shutdown_connections 2023-08-25T04:43:38.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.894+0000 7f679fa0f700 1 --2- 172.21.15.16:0/3295824016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679806ac80 0x7f67980ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.894+0000 7f679fa0f700 1 --2- 172.21.15.16:0/3295824016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f679815d510 0x7f679806c7e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.894+0000 7f679fa0f700 1 -- 172.21.15.16:0/3295824016 >> 172.21.15.16:0/3295824016 conn(0x7f67980b2440 msgr2=0x7f67980b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:38.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.894+0000 7f679fa0f700 1 -- 172.21.15.16:0/3295824016 shutdown_connections 2023-08-25T04:43:38.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.894+0000 7f679fa0f700 1 -- 172.21.15.16:0/3295824016 wait complete. 2023-08-25T04:43:38.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.895+0000 7f679fa0f700 1 Processor -- start 2023-08-25T04:43:38.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.896+0000 7f679fa0f700 1 -- start start 2023-08-25T04:43:38.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.896+0000 7f679fa0f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679806ac80 0x7f67981f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679fa0f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6798161900 0x7f6798099250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679fa0f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6798099790 0x7f679815ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679fa0f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6798099bf0 con 0x7f6798099790 2023-08-25T04:43:38.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679fa0f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679815f920 con 0x7f6798161900 2023-08-25T04:43:38.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679fa0f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679815fc00 con 0x7f679806ac80 2023-08-25T04:43:38.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679dfac700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6798099790 0x7f679815ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679dfac700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6798099790 0x7f679815ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48896/0 (socket says 172.21.15.16:48896) 2023-08-25T04:43:38.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679dfac700 1 -- 172.21.15.16:0/2616861497 learned_addr learned my addr 172.21.15.16:0/2616861497 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:38.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679d7ab700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679806ac80 0x7f67981f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679cfaa700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6798161900 0x7f6798099250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679dfac700 1 -- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679806ac80 msgr2=0x7f67981f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679dfac700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679806ac80 0x7f67981f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679dfac700 1 -- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6798161900 msgr2=0x7f6798099250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:38.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679dfac700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6798161900 0x7f6798099250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:38.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679dfac700 1 -- 172.21.15.16:0/2616861497 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6788009500 con 0x7f6798099790 2023-08-25T04:43:38.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679cfaa700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6798161900 0x7f6798099250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:38.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679dfac700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6798099790 0x7f679815ebf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6790007e40 tx=0x7f679000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:38.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f678dffb700 1 -- 172.21.15.16:0/2616861497 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679000ede0 con 0x7f6798099790 2023-08-25T04:43:38.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f678dffb700 1 -- 172.21.15.16:0/2616861497 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6790014420 con 0x7f6798099790 2023-08-25T04:43:38.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679fa0f700 1 -- 172.21.15.16:0/2616861497 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679815fee0 con 0x7f6798099790 2023-08-25T04:43:38.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f678dffb700 1 -- 172.21.15.16:0/2616861497 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67900147d0 con 0x7f6798099790 2023-08-25T04:43:38.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.897+0000 7f679fa0f700 1 -- 172.21.15.16:0/2616861497 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679809b350 con 0x7f6798099790 2023-08-25T04:43:38.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.898+0000 7f679fa0f700 1 -- 172.21.15.16:0/2616861497 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679806dea0 con 0x7f6798099790 2023-08-25T04:43:38.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.899+0000 7f678dffb700 1 -- 172.21.15.16:0/2616861497 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6790014930 con 0x7f6798099790 2023-08-25T04:43:38.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.899+0000 7f678dffb700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f677c06a0e0 0x7f677c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:38.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.899+0000 7f678dffb700 1 -- 172.21.15.16:0/2616861497 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f67900889d0 con 0x7f6798099790 2023-08-25T04:43:38.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.899+0000 7f679d7ab700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f677c06a0e0 0x7f677c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:38.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.900+0000 7f679d7ab700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f677c06a0e0 0x7f677c06c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6788013040 tx=0x7f6788008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:38.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:38.903+0000 7f678dffb700 1 -- 172.21.15.16:0/2616861497 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f679806dea0 con 0x7f6798099790 2023-08-25T04:43:39.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.103+0000 7f679fa0f700 1 -- 172.21.15.16:0/2616861497 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f679806dea0 con 0x7f6798099790 2023-08-25T04:43:39.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.104+0000 7f678dffb700 1 -- 172.21.15.16:0/2616861497 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f679806dea0 con 0x7f6798099790 2023-08-25T04:43:39.106 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-08-25T04:43:39.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.106+0000 7f679fa0f700 1 -- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f677c06a0e0 msgr2=0x7f677c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.106+0000 7f679fa0f700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f677c06a0e0 0x7f677c06c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6788013040 tx=0x7f6788008070 comp rx=0 tx=0).stop 2023-08-25T04:43:39.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.106+0000 7f679fa0f700 1 -- 172.21.15.16:0/2616861497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6798099790 msgr2=0x7f679815ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.106+0000 7f679fa0f700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6798099790 0x7f679815ebf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6790007e40 tx=0x7f679000e3c0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.106+0000 7f679fa0f700 1 -- 172.21.15.16:0/2616861497 shutdown_connections 2023-08-25T04:43:39.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.106+0000 7f679fa0f700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f677c06a0e0 0x7f677c06c5a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.106+0000 7f679fa0f700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6798099790 0x7f679815ebf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.106+0000 7f679fa0f700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679806ac80 0x7f67981f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.106+0000 7f679fa0f700 1 --2- 172.21.15.16:0/2616861497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6798161900 0x7f6798099250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.106+0000 7f679fa0f700 1 -- 172.21.15.16:0/2616861497 >> 172.21.15.16:0/2616861497 conn(0x7f67980b2440 msgr2=0x7f67980ae290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:39.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.106+0000 7f679fa0f700 1 -- 172.21.15.16:0/2616861497 shutdown_connections 2023-08-25T04:43:39.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.106+0000 7f679fa0f700 1 -- 172.21.15.16:0/2616861497 wait complete. 2023-08-25T04:43:39.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:43:39.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.245+0000 7f321f2da700 1 Processor -- start 2023-08-25T04:43:39.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.246+0000 7f321f2da700 1 -- start start 2023-08-25T04:43:39.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f321f2da700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3218071c00 0x7f32180cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f321f2da700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321815b0b0 con 0x7f3218143420 2023-08-25T04:43:39.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f321f2da700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3218072090 con 0x7f3218070eb0 2023-08-25T04:43:39.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f321f2da700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321815a4c0 con 0x7f3218071c00 2023-08-25T04:43:39.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f321c875700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3218143420 0x7f32180ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39316/0 (socket says 172.21.15.16:39316) 2023-08-25T04:43:39.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f321c875700 1 -- 172.21.15.16:0/1404969188 learned_addr learned my addr 172.21.15.16:0/1404969188 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:39.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f321d877700 1 --2- 172.21.15.16:0/1404969188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3218071c00 0x7f32180cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 -- 172.21.15.16:0/1404969188 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509651787 0 0) 0x7f321815b0b0 con 0x7f3218143420 2023-08-25T04:43:39.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 -- 172.21.15.16:0/1404969188 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32040035b0 con 0x7f3218143420 2023-08-25T04:43:39.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 -- 172.21.15.16:0/1404969188 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3897884064 0 0) 0x7f32040035b0 con 0x7f3218143420 2023-08-25T04:43:39.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 -- 172.21.15.16:0/1404969188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3218071c00 msgr2=0x7f32180cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:39.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 --2- 172.21.15.16:0/1404969188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3218071c00 0x7f32180cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 -- 172.21.15.16:0/1404969188 >> v1:172.21.15.117:6789/0 conn(0x7f3218070eb0 legacy=0x7f3218071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 -- 172.21.15.16:0/1404969188 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321815a780 con 0x7f3218143420 2023-08-25T04:43:39.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 -- 172.21.15.16:0/1404969188 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f3214001670 con 0x7f3218143420 2023-08-25T04:43:39.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 -- 172.21.15.16:0/1404969188 >> v1:172.21.15.16:6789/0 conn(0x7f3218143420 legacy=0x7f32180ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 --2- 172.21.15.16:0/1404969188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3204003a30 0x7f3204003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 --2- 172.21.15.16:0/1404969188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3218071c00 0x7f3204004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 --2- 172.21.15.16:0/1404969188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3204004d90 0x7f3204005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 -- 172.21.15.16:0/1404969188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321815a4c0 con 0x7f3204003a30 2023-08-25T04:43:39.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 -- 172.21.15.16:0/1404969188 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320400bac0 con 0x7f3204004d90 2023-08-25T04:43:39.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.247+0000 7f320ffff700 1 -- 172.21.15.16:0/1404969188 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320400bc80 con 0x7f3218071c00 2023-08-25T04:43:39.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.248+0000 7f321d076700 1 --2- 172.21.15.16:0/1404969188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3204003a30 0x7f3204003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.248+0000 7f321c875700 1 --2- 172.21.15.16:0/1404969188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3218071c00 0x7f3204004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.248+0000 7f321d877700 1 --2- 172.21.15.16:0/1404969188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3204004d90 0x7f3204005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.248+0000 7f321d076700 1 -- 172.21.15.16:0/1404969188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3218071c00 msgr2=0x7f3204004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.248+0000 7f321d076700 1 --2- 172.21.15.16:0/1404969188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3218071c00 0x7f3204004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.248+0000 7f321d076700 1 -- 172.21.15.16:0/1404969188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3204004d90 msgr2=0x7f3204005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.248+0000 7f321d076700 1 --2- 172.21.15.16:0/1404969188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3204004d90 0x7f3204005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.248+0000 7f321d076700 1 -- 172.21.15.16:0/1404969188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040035b0 con 0x7f3204003a30 2023-08-25T04:43:39.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.248+0000 7f321d877700 1 --2- 172.21.15.16:0/1404969188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3204004d90 0x7f3204005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:39.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.248+0000 7f321d076700 1 --2- 172.21.15.16:0/1404969188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3204003a30 0x7f3204003e50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3208007fd0 tx=0x7f3204005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bece30c4aa96569 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:39.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.248+0000 7f320ffff700 1 -- 172.21.15.16:0/1404969188 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32080052d0 con 0x7f3204003a30 2023-08-25T04:43:39.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.248+0000 7f320ffff700 1 -- 172.21.15.16:0/1404969188 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3208005470 con 0x7f3204003a30 2023-08-25T04:43:39.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.248+0000 7f320ffff700 1 -- 172.21.15.16:0/1404969188 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32080038c0 con 0x7f3204003a30 2023-08-25T04:43:39.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.249+0000 7f321f2da700 1 -- 172.21.15.16:0/1404969188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3204003a30 msgr2=0x7f3204003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.249+0000 7f321f2da700 1 --2- 172.21.15.16:0/1404969188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3204003a30 0x7f3204003e50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3208007fd0 tx=0x7f3204005880 comp rx=0 tx=0).stop 2023-08-25T04:43:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.249+0000 7f321d877700 1 -- 172.21.15.16:0/1404969188 reap_dead start 2023-08-25T04:43:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.249+0000 7f321f2da700 1 -- 172.21.15.16:0/1404969188 shutdown_connections 2023-08-25T04:43:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.249+0000 7f321f2da700 1 -- 172.21.15.16:0/1404969188 >> 172.21.15.16:0/1404969188 conn(0x7f32180cfe00 msgr2=0x7f32180d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.249+0000 7f321f2da700 1 -- 172.21.15.16:0/1404969188 shutdown_connections 2023-08-25T04:43:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.249+0000 7f321f2da700 1 -- 172.21.15.16:0/1404969188 wait complete. 2023-08-25T04:43:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.250+0000 7f321f2da700 1 Processor -- start 2023-08-25T04:43:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.250+0000 7f321f2da700 1 -- start start 2023-08-25T04:43:39.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321f2da700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3204003a30 0x7f3218159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321f2da700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3218159a00 0x7f3218141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321f2da700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32180c85d0 0x7f32180c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321f2da700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3218159760 con 0x7f3204003a30 2023-08-25T04:43:39.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321f2da700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32180c8f90 con 0x7f32180c85d0 2023-08-25T04:43:39.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321f2da700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32180cb160 con 0x7f3218159a00 2023-08-25T04:43:39.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321d076700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3204003a30 0x7f3218159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321d076700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3204003a30 0x7f3218159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48912/0 (socket says 172.21.15.16:48912) 2023-08-25T04:43:39.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321d076700 1 -- 172.21.15.16:0/3615496933 learned_addr learned my addr 172.21.15.16:0/3615496933 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:39.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321d076700 1 -- 172.21.15.16:0/3615496933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3218159a00 msgr2=0x7f3218141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321d076700 1 --2- 172.21.15.16:0/3615496933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3218159a00 0x7f3218141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321d076700 1 -- 172.21.15.16:0/3615496933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32180c85d0 msgr2=0x7f32180c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321d076700 1 --2- 172.21.15.16:0/3615496933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32180c85d0 0x7f32180c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321d076700 1 -- 172.21.15.16:0/3615496933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32180cb3b0 con 0x7f3204003a30 2023-08-25T04:43:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321d076700 1 --2- 172.21.15.16:0/3615496933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3204003a30 0x7f3218159220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3208004000 tx=0x7f3208001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f320dffb700 1 -- 172.21.15.16:0/3615496933 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320801f070 con 0x7f3204003a30 2023-08-25T04:43:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f320dffb700 1 -- 172.21.15.16:0/3615496933 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3208001290 con 0x7f3204003a30 2023-08-25T04:43:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f321f2da700 1 -- 172.21.15.16:0/3615496933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32180cb690 con 0x7f3204003a30 2023-08-25T04:43:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.251+0000 7f320dffb700 1 -- 172.21.15.16:0/3615496933 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3208007490 con 0x7f3204003a30 2023-08-25T04:43:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.252+0000 7f321f2da700 1 -- 172.21.15.16:0/3615496933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32180cbc50 con 0x7f3204003a30 2023-08-25T04:43:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.252+0000 7f321f2da700 1 -- 172.21.15.16:0/3615496933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32180d0dc0 con 0x7f3204003a30 2023-08-25T04:43:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.253+0000 7f320dffb700 1 -- 172.21.15.16:0/3615496933 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f32080075f0 con 0x7f3204003a30 2023-08-25T04:43:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.253+0000 7f320dffb700 1 --2- 172.21.15.16:0/3615496933 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f31fc06a0e0 0x7f31fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.253+0000 7f320dffb700 1 -- 172.21.15.16:0/3615496933 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f320808a200 con 0x7f3204003a30 2023-08-25T04:43:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.254+0000 7f321c875700 1 --2- 172.21.15.16:0/3615496933 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f31fc06a0e0 0x7f31fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.254+0000 7f321c875700 1 --2- 172.21.15.16:0/3615496933 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f31fc06a0e0 0x7f31fc06c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f32140017a0 tx=0x7f3214001450 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:39.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.258+0000 7f320dffb700 1 -- 172.21.15.16:0/3615496933 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3208055cd0 con 0x7f3204003a30 2023-08-25T04:43:39.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.458+0000 7f321f2da700 1 -- 172.21.15.16:0/3615496933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f321813f2f0 con 0x7f3204003a30 2023-08-25T04:43:39.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.458+0000 7f320dffb700 1 -- 172.21.15.16:0/3615496933 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3208017030 con 0x7f3204003a30 2023-08-25T04:43:39.460 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-08-25T04:43:39.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.461+0000 7f321f2da700 1 -- 172.21.15.16:0/3615496933 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f31fc06a0e0 msgr2=0x7f31fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.461+0000 7f321f2da700 1 --2- 172.21.15.16:0/3615496933 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f31fc06a0e0 0x7f31fc06c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f32140017a0 tx=0x7f3214001450 comp rx=0 tx=0).stop 2023-08-25T04:43:39.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.461+0000 7f321f2da700 1 -- 172.21.15.16:0/3615496933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3204003a30 msgr2=0x7f3218159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.461+0000 7f321f2da700 1 --2- 172.21.15.16:0/3615496933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3204003a30 0x7f3218159220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3208004000 tx=0x7f3208001120 comp rx=0 tx=0).stop 2023-08-25T04:43:39.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.461+0000 7f321f2da700 1 -- 172.21.15.16:0/3615496933 shutdown_connections 2023-08-25T04:43:39.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.461+0000 7f321f2da700 1 --2- 172.21.15.16:0/3615496933 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f31fc06a0e0 0x7f31fc06c5a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.461+0000 7f321f2da700 1 --2- 172.21.15.16:0/3615496933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32180c85d0 0x7f32180c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.461+0000 7f321f2da700 1 --2- 172.21.15.16:0/3615496933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3204003a30 0x7f3218159220 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.461+0000 7f321f2da700 1 --2- 172.21.15.16:0/3615496933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3218159a00 0x7f3218141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.461+0000 7f321f2da700 1 -- 172.21.15.16:0/3615496933 >> 172.21.15.16:0/3615496933 conn(0x7f32180cfe00 msgr2=0x7f32180c5720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:39.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.461+0000 7f321f2da700 1 -- 172.21.15.16:0/3615496933 shutdown_connections 2023-08-25T04:43:39.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.461+0000 7f321f2da700 1 -- 172.21.15.16:0/3615496933 wait complete. 2023-08-25T04:43:39.474 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T04:43:39.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.598+0000 7ff519f77700 1 Processor -- start 2023-08-25T04:43:39.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.598+0000 7ff519f77700 1 -- start start 2023-08-25T04:43:39.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.599+0000 7ff519f77700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff51415d3e0 0x7ff5140ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.599+0000 7ff519f77700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff5140b36e0 0x7ff5140cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.599+0000 7ff519f77700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff514161080 0x7ff514161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.599+0000 7ff519f77700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5140d0e50 con 0x7ff5140b36e0 2023-08-25T04:43:39.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.599+0000 7ff519f77700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff514161fe0 con 0x7ff51415d3e0 2023-08-25T04:43:39.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.599+0000 7ff519f77700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff514161a50 con 0x7ff514161080 2023-08-25T04:43:39.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.599+0000 7ff512ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff5140b36e0 0x7ff5140cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.599+0000 7ff512ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff5140b36e0 0x7ff5140cf060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48922/0 (socket says 172.21.15.16:48922) 2023-08-25T04:43:39.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.599+0000 7ff512ffd700 1 -- 172.21.15.16:0/2442367415 learned_addr learned my addr 172.21.15.16:0/2442367415 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:39.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.600+0000 7ff513fff700 1 --2- 172.21.15.16:0/2442367415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff514161080 0x7ff514161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.600+0000 7ff5137fe700 1 --2- 172.21.15.16:0/2442367415 >> v2:172.21.15.117:3300/0 conn(0x7ff51415d3e0 0x7ff5140ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.600+0000 7ff512ffd700 1 -- 172.21.15.16:0/2442367415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff514161080 msgr2=0x7ff514161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:39.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.600+0000 7ff512ffd700 1 --2- 172.21.15.16:0/2442367415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff514161080 0x7ff514161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.600+0000 7ff512ffd700 1 -- 172.21.15.16:0/2442367415 >> v2:172.21.15.117:3300/0 conn(0x7ff51415d3e0 msgr2=0x7ff5140ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:39.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.600+0000 7ff512ffd700 1 --2- 172.21.15.16:0/2442367415 >> v2:172.21.15.117:3300/0 conn(0x7ff51415d3e0 0x7ff5140ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.600+0000 7ff512ffd700 1 -- 172.21.15.16:0/2442367415 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff514161d00 con 0x7ff5140b36e0 2023-08-25T04:43:39.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.600+0000 7ff512ffd700 1 --2- 172.21.15.16:0/2442367415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5140b36e0 0x7ff5140cf060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5040098f0 tx=0x7ff504009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cdd9132f97271c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:39.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.600+0000 7ff5127fc700 1 -- 172.21.15.16:0/2442367415 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504011830 con 0x7ff5140b36e0 2023-08-25T04:43:39.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.600+0000 7ff5127fc700 1 -- 172.21.15.16:0/2442367415 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff504011990 con 0x7ff5140b36e0 2023-08-25T04:43:39.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.600+0000 7ff5127fc700 1 -- 172.21.15.16:0/2442367415 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504011d20 con 0x7ff5140b36e0 2023-08-25T04:43:39.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.601+0000 7ff519f77700 1 -- 172.21.15.16:0/2442367415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5140b36e0 msgr2=0x7ff5140cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.601+0000 7ff519f77700 1 --2- 172.21.15.16:0/2442367415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5140b36e0 0x7ff5140cf060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5040098f0 tx=0x7ff504009c00 comp rx=0 tx=0).stop 2023-08-25T04:43:39.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.601+0000 7ff519f77700 1 -- 172.21.15.16:0/2442367415 shutdown_connections 2023-08-25T04:43:39.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.601+0000 7ff519f77700 1 --2- 172.21.15.16:0/2442367415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff514161080 0x7ff514161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.601+0000 7ff519f77700 1 --2- 172.21.15.16:0/2442367415 >> v2:172.21.15.117:3300/0 conn(0x7ff51415d3e0 0x7ff5140ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.601+0000 7ff519f77700 1 --2- 172.21.15.16:0/2442367415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5140b36e0 0x7ff5140cf060 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.601+0000 7ff519f77700 1 -- 172.21.15.16:0/2442367415 >> 172.21.15.16:0/2442367415 conn(0x7ff5140d0fe0 msgr2=0x7ff5140d13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:39.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.601+0000 7ff519f77700 1 -- 172.21.15.16:0/2442367415 shutdown_connections 2023-08-25T04:43:39.608 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.601+0000 7ff519f77700 1 -- 172.21.15.16:0/2442367415 wait complete. 2023-08-25T04:43:39.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.602+0000 7ff519f77700 1 Processor -- start 2023-08-25T04:43:39.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.602+0000 7ff519f77700 1 -- start start 2023-08-25T04:43:39.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff519f77700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5140b36e0 0x7ff5140b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff519f77700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff51415d3e0 0x7ff514159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff519f77700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff514161080 0x7ff514159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff519f77700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51415f2c0 con 0x7ff51415d3e0 2023-08-25T04:43:39.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff519f77700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51415e6b0 con 0x7ff514161080 2023-08-25T04:43:39.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff519f77700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51415e990 con 0x7ff5140b36e0 2023-08-25T04:43:39.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff512ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff51415d3e0 0x7ff514159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff512ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff51415d3e0 0x7ff514159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48928/0 (socket says 172.21.15.16:48928) 2023-08-25T04:43:39.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff512ffd700 1 -- 172.21.15.16:0/2237343345 learned_addr learned my addr 172.21.15.16:0/2237343345 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:39.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff513fff700 1 --2- 172.21.15.16:0/2237343345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff514161080 0x7ff514159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff512ffd700 1 -- 172.21.15.16:0/2237343345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5140b36e0 msgr2=0x7ff5140b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff5137fe700 1 --2- 172.21.15.16:0/2237343345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5140b36e0 0x7ff5140b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff512ffd700 1 --2- 172.21.15.16:0/2237343345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5140b36e0 0x7ff5140b5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff512ffd700 1 -- 172.21.15.16:0/2237343345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff514161080 msgr2=0x7ff514159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff512ffd700 1 --2- 172.21.15.16:0/2237343345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff514161080 0x7ff514159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff512ffd700 1 -- 172.21.15.16:0/2237343345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff504009550 con 0x7ff51415d3e0 2023-08-25T04:43:39.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff512ffd700 1 --2- 172.21.15.16:0/2237343345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff51415d3e0 0x7ff514159620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff504009c40 tx=0x7ff504004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:39.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff50bfff700 1 -- 172.21.15.16:0/2237343345 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040036a0 con 0x7ff51415d3e0 2023-08-25T04:43:39.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff50bfff700 1 -- 172.21.15.16:0/2237343345 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50401e070 con 0x7ff51415d3e0 2023-08-25T04:43:39.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.603+0000 7ff519f77700 1 -- 172.21.15.16:0/2237343345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51415ec70 con 0x7ff51415d3e0 2023-08-25T04:43:39.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.604+0000 7ff50bfff700 1 -- 172.21.15.16:0/2237343345 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504003a00 con 0x7ff51415d3e0 2023-08-25T04:43:39.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.604+0000 7ff519f77700 1 -- 172.21.15.16:0/2237343345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5140b5a70 con 0x7ff51415d3e0 2023-08-25T04:43:39.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.604+0000 7ff519f77700 1 -- 172.21.15.16:0/2237343345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51404ee70 con 0x7ff51415d3e0 2023-08-25T04:43:39.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.605+0000 7ff50bfff700 1 -- 172.21.15.16:0/2237343345 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff504003b60 con 0x7ff51415d3e0 2023-08-25T04:43:39.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.605+0000 7ff50bfff700 1 --2- 172.21.15.16:0/2237343345 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7ff4f406a0e0 0x7ff4f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.605+0000 7ff50bfff700 1 -- 172.21.15.16:0/2237343345 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff504089100 con 0x7ff51415d3e0 2023-08-25T04:43:39.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.605+0000 7ff5137fe700 1 --2- 172.21.15.16:0/2237343345 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7ff4f406a0e0 0x7ff4f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.606+0000 7ff5137fe700 1 --2- 172.21.15.16:0/2237343345 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7ff4f406a0e0 0x7ff4f406c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff51406cee0 tx=0x7ff4fc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.610+0000 7ff50bfff700 1 -- 172.21.15.16:0/2237343345 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff504054bd0 con 0x7ff51415d3e0 2023-08-25T04:43:39.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.810+0000 7ff519f77700 1 -- 172.21.15.16:0/2237343345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff51406c950 con 0x7ff51415d3e0 2023-08-25T04:43:39.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.811+0000 7ff50bfff700 1 -- 172.21.15.16:0/2237343345 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff504006d80 con 0x7ff51415d3e0 2023-08-25T04:43:39.812 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:39.813 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2023-08-25T04:43:39.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-08-25T04:43:39.813 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2023-08-25T04:43:39.813 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": "rbd" 2023-08-25T04:43:39.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-08-25T04:43:39.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-08-25T04:43:39.813 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 2, 2023-08-25T04:43:39.814 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2023-08-25T04:43:39.814 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-08-25T04:43:39.814 INFO:teuthology.orchestra.run.smithi016.stdout:] 2023-08-25T04:43:39.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.813+0000 7ff519f77700 1 -- 172.21.15.16:0/2237343345 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7ff4f406a0e0 msgr2=0x7ff4f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.813+0000 7ff519f77700 1 --2- 172.21.15.16:0/2237343345 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7ff4f406a0e0 0x7ff4f406c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff51406cee0 tx=0x7ff4fc008040 comp rx=0 tx=0).stop 2023-08-25T04:43:39.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.813+0000 7ff519f77700 1 -- 172.21.15.16:0/2237343345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff51415d3e0 msgr2=0x7ff514159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.813+0000 7ff519f77700 1 --2- 172.21.15.16:0/2237343345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff51415d3e0 0x7ff514159620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff504009c40 tx=0x7ff504004750 comp rx=0 tx=0).stop 2023-08-25T04:43:39.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.813+0000 7ff519f77700 1 -- 172.21.15.16:0/2237343345 shutdown_connections 2023-08-25T04:43:39.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.813+0000 7ff519f77700 1 --2- 172.21.15.16:0/2237343345 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7ff4f406a0e0 0x7ff4f406c5a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.813+0000 7ff519f77700 1 --2- 172.21.15.16:0/2237343345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff514161080 0x7ff514159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.813+0000 7ff519f77700 1 --2- 172.21.15.16:0/2237343345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5140b36e0 0x7ff5140b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.813+0000 7ff519f77700 1 --2- 172.21.15.16:0/2237343345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff51415d3e0 0x7ff514159620 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.813+0000 7ff519f77700 1 -- 172.21.15.16:0/2237343345 >> 172.21.15.16:0/2237343345 conn(0x7ff5140d0fe0 msgr2=0x7ff51415ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:39.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.813+0000 7ff519f77700 1 -- 172.21.15.16:0/2237343345 shutdown_connections 2023-08-25T04:43:39.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.813+0000 7ff519f77700 1 -- 172.21.15.16:0/2237343345 wait complete. 2023-08-25T04:43:39.826 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T04:43:39.826 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T04:43:39.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.955+0000 7f58e963f700 1 Processor -- start 2023-08-25T04:43:39.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.955+0000 7f58e963f700 1 -- start start 2023-08-25T04:43:39.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.956+0000 7f58e963f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58e415d440 0x7f58e40cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.956+0000 7f58e963f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f58e40d07c0 0x7f58e40d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.956+0000 7f58e963f700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e40cdc70 con 0x7f58e40d1780 2023-08-25T04:43:39.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.956+0000 7f58e963f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e40d15a0 con 0x7f58e40d07c0 2023-08-25T04:43:39.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.956+0000 7f58e963f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40cf1a0 con 0x7f58e415d440 2023-08-25T04:43:39.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e37fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f58e40d1780 0x7f58e40d1c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39352/0 (socket says 172.21.15.16:39352) 2023-08-25T04:43:39.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e37fe700 1 -- 172.21.15.16:0/2016710414 learned_addr learned my addr 172.21.15.16:0/2016710414 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:39.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e2ffd700 1 --2- 172.21.15.16:0/2016710414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58e415d440 0x7f58e40cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e27fc700 1 --2- 172.21.15.16:0/2016710414 >> v2:172.21.15.117:3300/0 conn(0x7f58e40d07c0 0x7f58e40d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 -- 172.21.15.16:0/2016710414 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379639903 0 0) 0x7f58e40cdc70 con 0x7f58e40d1780 2023-08-25T04:43:39.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 -- 172.21.15.16:0/2016710414 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58cc0035b0 con 0x7f58e40d1780 2023-08-25T04:43:39.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 -- 172.21.15.16:0/2016710414 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3803541288 0 0) 0x7f58cc0035b0 con 0x7f58e40d1780 2023-08-25T04:43:39.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 -- 172.21.15.16:0/2016710414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58e415d440 msgr2=0x7f58e40cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:39.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 --2- 172.21.15.16:0/2016710414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58e415d440 0x7f58e40cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 -- 172.21.15.16:0/2016710414 >> v2:172.21.15.117:3300/0 conn(0x7f58e40d07c0 msgr2=0x7f58e40d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:39.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 --2- 172.21.15.16:0/2016710414 >> v2:172.21.15.117:3300/0 conn(0x7f58e40d07c0 0x7f58e40d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 -- 172.21.15.16:0/2016710414 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e40cdea0 con 0x7f58e40d1780 2023-08-25T04:43:39.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 -- 172.21.15.16:0/2016710414 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f58dc0019f0 con 0x7f58e40d1780 2023-08-25T04:43:39.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 -- 172.21.15.16:0/2016710414 >> v1:172.21.15.16:6789/0 conn(0x7f58e40d1780 legacy=0x7f58e40d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 --2- 172.21.15.16:0/2016710414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc003a00 0x7f58cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 --2- 172.21.15.16:0/2016710414 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58cc004850 0x7f58cc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 --2- 172.21.15.16:0/2016710414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58e415d440 0x7f58cc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 -- 172.21.15.16:0/2016710414 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40d15a0 con 0x7f58cc004850 2023-08-25T04:43:39.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 -- 172.21.15.16:0/2016710414 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40cf1a0 con 0x7f58cc003a00 2023-08-25T04:43:39.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e1ffb700 1 -- 172.21.15.16:0/2016710414 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc00ba10 con 0x7f58e415d440 2023-08-25T04:43:39.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e27fc700 1 --2- 172.21.15.16:0/2016710414 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58cc004850 0x7f58cc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e37fe700 1 --2- 172.21.15.16:0/2016710414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58e415d440 0x7f58cc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.957+0000 7f58e2ffd700 1 --2- 172.21.15.16:0/2016710414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc003a00 0x7f58cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e27fc700 1 -- 172.21.15.16:0/2016710414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58e415d440 msgr2=0x7f58cc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:39.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e27fc700 1 --2- 172.21.15.16:0/2016710414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58e415d440 0x7f58cc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e27fc700 1 -- 172.21.15.16:0/2016710414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc003a00 msgr2=0x7f58cc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:39.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e27fc700 1 --2- 172.21.15.16:0/2016710414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc003a00 0x7f58cc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e27fc700 1 -- 172.21.15.16:0/2016710414 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc0035b0 con 0x7f58cc004850 2023-08-25T04:43:39.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e27fc700 1 --2- 172.21.15.16:0/2016710414 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58cc004850 0x7f58cc004cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009b60 tx=0x7f58cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10677b9fb269322 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:39.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e1ffb700 1 -- 172.21.15.16:0/2016710414 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d400e6c0 con 0x7f58cc004850 2023-08-25T04:43:39.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e1ffb700 1 -- 172.21.15.16:0/2016710414 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d400e820 con 0x7f58cc004850 2023-08-25T04:43:39.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e1ffb700 1 -- 172.21.15.16:0/2016710414 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d400eb90 con 0x7f58cc004850 2023-08-25T04:43:39.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e963f700 1 -- 172.21.15.16:0/2016710414 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58cc004850 msgr2=0x7f58cc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e963f700 1 --2- 172.21.15.16:0/2016710414 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58cc004850 0x7f58cc004cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009b60 tx=0x7f58cc005880 comp rx=0 tx=0).stop 2023-08-25T04:43:39.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e37fe700 1 -- 172.21.15.16:0/2016710414 reap_dead start 2023-08-25T04:43:39.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e963f700 1 -- 172.21.15.16:0/2016710414 shutdown_connections 2023-08-25T04:43:39.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e963f700 1 -- 172.21.15.16:0/2016710414 >> 172.21.15.16:0/2016710414 conn(0x7f58e40d31a0 msgr2=0x7f58e40d35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:39.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e963f700 1 -- 172.21.15.16:0/2016710414 shutdown_connections 2023-08-25T04:43:39.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.958+0000 7f58e963f700 1 -- 172.21.15.16:0/2016710414 wait complete. 2023-08-25T04:43:39.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.960+0000 7f58e963f700 1 Processor -- start 2023-08-25T04:43:39.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.960+0000 7f58e963f700 1 -- start start 2023-08-25T04:43:39.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.961+0000 7f58e963f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc004850 0x7f58e4157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.961+0000 7f58e963f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58e40c6b00 0x7f58e40b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.961+0000 7f58e963f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e40c6f80 0x7f58e40b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.961+0000 7f58e963f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40c8100 con 0x7f58e40c6f80 2023-08-25T04:43:39.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.961+0000 7f58e963f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e4157f70 con 0x7f58cc004850 2023-08-25T04:43:39.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.961+0000 7f58e963f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40c7530 con 0x7f58e40c6b00 2023-08-25T04:43:39.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.961+0000 7f58e37fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e40c6f80 0x7f58e40b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.961+0000 7f58e37fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e40c6f80 0x7f58e40b6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48950/0 (socket says 172.21.15.16:48950) 2023-08-25T04:43:39.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.961+0000 7f58e37fe700 1 -- 172.21.15.16:0/3363119033 learned_addr learned my addr 172.21.15.16:0/3363119033 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:39.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.961+0000 7f58e2ffd700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc004850 0x7f58e4157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.961+0000 7f58e27fc700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58e40c6b00 0x7f58e40b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.962+0000 7f58e37fe700 1 -- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58e40c6b00 msgr2=0x7f58e40b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.962+0000 7f58e37fe700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58e40c6b00 0x7f58e40b67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.962+0000 7f58e37fe700 1 -- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc004850 msgr2=0x7f58e4157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:39.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.962+0000 7f58e37fe700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc004850 0x7f58e4157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:39.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.962+0000 7f58e37fe700 1 -- 172.21.15.16:0/3363119033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e40c7810 con 0x7f58e40c6f80 2023-08-25T04:43:39.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.962+0000 7f58e27fc700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58e40c6b00 0x7f58e40b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:39.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.962+0000 7f58e37fe700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e40c6f80 0x7f58e40b6cf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f58e40b4c60 tx=0x7f58dc00a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:39.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.962+0000 7f58cb7fe700 1 -- 172.21.15.16:0/3363119033 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00ae10 con 0x7f58e40c6f80 2023-08-25T04:43:39.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.962+0000 7f58cb7fe700 1 -- 172.21.15.16:0/3363119033 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc0133f0 con 0x7f58e40c6f80 2023-08-25T04:43:39.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.962+0000 7f58e963f700 1 -- 172.21.15.16:0/3363119033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e40c7af0 con 0x7f58e40c6f80 2023-08-25T04:43:39.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.962+0000 7f58cb7fe700 1 -- 172.21.15.16:0/3363119033 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0137a0 con 0x7f58e40c6f80 2023-08-25T04:43:39.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.962+0000 7f58e963f700 1 -- 172.21.15.16:0/3363119033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e40b8b80 con 0x7f58e40c6f80 2023-08-25T04:43:39.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.963+0000 7f58e963f700 1 -- 172.21.15.16:0/3363119033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e40b8d10 con 0x7f58e40c6f80 2023-08-25T04:43:39.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.963+0000 7f58cb7fe700 1 -- 172.21.15.16:0/3363119033 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f58dc013900 con 0x7f58e40c6f80 2023-08-25T04:43:39.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.964+0000 7f58cb7fe700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f58d006a110 0x7f58d006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:39.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.964+0000 7f58cb7fe700 1 -- 172.21.15.16:0/3363119033 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f58dc088dd0 con 0x7f58e40c6f80 2023-08-25T04:43:39.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.964+0000 7f58e2ffd700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f58d006a110 0x7f58d006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:39.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.964+0000 7f58e2ffd700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f58d006a110 0x7f58d006c5d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009a40 tx=0x7f58d8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:39.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:39.968+0000 7f58cb7fe700 1 -- 172.21.15.16:0/3363119033 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f58dc0548a0 con 0x7f58e40c6f80 2023-08-25T04:43:40.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:40.166+0000 7f58e963f700 1 -- 172.21.15.16:0/3363119033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f58e40c8540 con 0x7f58e40c6f80 2023-08-25T04:43:40.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:40.864+0000 7f58cb7fe700 1 -- 172.21.15.16:0/3363119033 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f58e40c8540 con 0x7f58e40c6f80 2023-08-25T04:43:40.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:40.869+0000 7f58e963f700 1 -- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f58d006a110 msgr2=0x7f58d006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:40.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:40.869+0000 7f58e963f700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f58d006a110 0x7f58d006c5d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009a40 tx=0x7f58d8008040 comp rx=0 tx=0).stop 2023-08-25T04:43:40.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:40.869+0000 7f58e963f700 1 -- 172.21.15.16:0/3363119033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e40c6f80 msgr2=0x7f58e40b6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:40.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:40.869+0000 7f58e963f700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e40c6f80 0x7f58e40b6cf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f58e40b4c60 tx=0x7f58dc00a640 comp rx=0 tx=0).stop 2023-08-25T04:43:40.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:40.871+0000 7f58e963f700 1 -- 172.21.15.16:0/3363119033 shutdown_connections 2023-08-25T04:43:40.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:40.871+0000 7f58e963f700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f58d006a110 0x7f58d006c5d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:40.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:40.871+0000 7f58e963f700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e40c6f80 0x7f58e40b6cf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:40.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:40.871+0000 7f58e963f700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58cc004850 0x7f58e4157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:40.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:40.871+0000 7f58e963f700 1 --2- 172.21.15.16:0/3363119033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58e40c6b00 0x7f58e40b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:40.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:40.871+0000 7f58e963f700 1 -- 172.21.15.16:0/3363119033 >> 172.21.15.16:0/3363119033 conn(0x7f58e40d31a0 msgr2=0x7f58e40d35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:40.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:40.871+0000 7f58e963f700 1 -- 172.21.15.16:0/3363119033 shutdown_connections 2023-08-25T04:43:40.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:40.871+0000 7f58e963f700 1 -- 172.21.15.16:0/3363119033 wait complete. 2023-08-25T04:43:40.874 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2023-08-25T04:43:40.887 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T04:43:41.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.027+0000 7fb598701700 1 Processor -- start 2023-08-25T04:43:41.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.027+0000 7fb598701700 1 -- start start 2023-08-25T04:43:41.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb598701700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb590070eb0 0x7fb590071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:41.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb598701700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb590143420 0x7fb590071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:41.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb598701700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59015dab0 0x7fb59015df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:41.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb598701700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59015b0b0 con 0x7fb590143420 2023-08-25T04:43:41.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb598701700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5900717d0 con 0x7fb590070eb0 2023-08-25T04:43:41.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb598701700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59015a4c0 con 0x7fb59015dab0 2023-08-25T04:43:41.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb595c9c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb590143420 0x7fb590071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:41.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb595c9c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb590143420 0x7fb590071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48956/0 (socket says 172.21.15.16:48956) 2023-08-25T04:43:41.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb595c9c700 1 -- 172.21.15.16:0/1958415902 learned_addr learned my addr 172.21.15.16:0/1958415902 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:41.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb59649d700 1 --2- 172.21.15.16:0/1958415902 >> v2:172.21.15.117:3300/0 conn(0x7fb590070eb0 0x7fb590071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:41.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb596c9e700 1 --2- 172.21.15.16:0/1958415902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59015dab0 0x7fb59015df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:41.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb595c9c700 1 -- 172.21.15.16:0/1958415902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59015dab0 msgr2=0x7fb59015df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:41.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb595c9c700 1 --2- 172.21.15.16:0/1958415902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59015dab0 0x7fb59015df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:41.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb595c9c700 1 -- 172.21.15.16:0/1958415902 >> v2:172.21.15.117:3300/0 conn(0x7fb590070eb0 msgr2=0x7fb590071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:41.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb595c9c700 1 --2- 172.21.15.16:0/1958415902 >> v2:172.21.15.117:3300/0 conn(0x7fb590070eb0 0x7fb590071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:41.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb595c9c700 1 -- 172.21.15.16:0/1958415902 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59015a780 con 0x7fb590143420 2023-08-25T04:43:41.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb595c9c700 1 --2- 172.21.15.16:0/1958415902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb590143420 0x7fb590071290 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb5900cda80 tx=0x7fb58000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa33a87f422bc623 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:41.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb59549b700 1 -- 172.21.15.16:0/1958415902 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58000dc70 con 0x7fb590143420 2023-08-25T04:43:41.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.028+0000 7fb59549b700 1 -- 172.21.15.16:0/1958415902 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58000ddd0 con 0x7fb590143420 2023-08-25T04:43:41.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.029+0000 7fb59549b700 1 -- 172.21.15.16:0/1958415902 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580010690 con 0x7fb590143420 2023-08-25T04:43:41.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.029+0000 7fb598701700 1 -- 172.21.15.16:0/1958415902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb590143420 msgr2=0x7fb590071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:41.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.029+0000 7fb598701700 1 --2- 172.21.15.16:0/1958415902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb590143420 0x7fb590071290 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb5900cda80 tx=0x7fb58000be70 comp rx=0 tx=0).stop 2023-08-25T04:43:41.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.029+0000 7fb598701700 1 -- 172.21.15.16:0/1958415902 shutdown_connections 2023-08-25T04:43:41.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.029+0000 7fb598701700 1 --2- 172.21.15.16:0/1958415902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb59015dab0 0x7fb59015df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:41.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.029+0000 7fb598701700 1 --2- 172.21.15.16:0/1958415902 >> v2:172.21.15.117:3300/0 conn(0x7fb590070eb0 0x7fb590071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:41.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.029+0000 7fb598701700 1 --2- 172.21.15.16:0/1958415902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb590143420 0x7fb590071290 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:41.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.029+0000 7fb598701700 1 -- 172.21.15.16:0/1958415902 >> 172.21.15.16:0/1958415902 conn(0x7fb5900cfe00 msgr2=0x7fb5900d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:41.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.029+0000 7fb598701700 1 -- 172.21.15.16:0/1958415902 shutdown_connections 2023-08-25T04:43:41.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.029+0000 7fb598701700 1 -- 172.21.15.16:0/1958415902 wait complete. 2023-08-25T04:43:41.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.030+0000 7fb598701700 1 Processor -- start 2023-08-25T04:43:41.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.030+0000 7fb598701700 1 -- start start 2023-08-25T04:43:41.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.031+0000 7fb598701700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb590070eb0 0x7fb5901f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:41.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.031+0000 7fb598701700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb590143420 0x7fb5900b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:41.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.031+0000 7fb598701700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb59015dab0 0x7fb59013c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:41.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.031+0000 7fb598701700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5900b4270 con 0x7fb59015dab0 2023-08-25T04:43:41.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.031+0000 7fb598701700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5900b5b70 con 0x7fb590143420 2023-08-25T04:43:41.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.031+0000 7fb598701700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5901f19c0 con 0x7fb590070eb0 2023-08-25T04:43:41.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.031+0000 7fb596c9e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb59015dab0 0x7fb59013c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:41.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.031+0000 7fb596c9e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb59015dab0 0x7fb59013c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48964/0 (socket says 172.21.15.16:48964) 2023-08-25T04:43:41.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.031+0000 7fb596c9e700 1 -- 172.21.15.16:0/715862310 learned_addr learned my addr 172.21.15.16:0/715862310 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:41.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.031+0000 7fb595c9c700 1 --2- 172.21.15.16:0/715862310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb590143420 0x7fb5900b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:41.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.031+0000 7fb59649d700 1 --2- 172.21.15.16:0/715862310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb590070eb0 0x7fb5901f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:41.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.032+0000 7fb596c9e700 1 -- 172.21.15.16:0/715862310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb590070eb0 msgr2=0x7fb5901f2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:41.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.032+0000 7fb596c9e700 1 --2- 172.21.15.16:0/715862310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb590070eb0 0x7fb5901f2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:41.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.032+0000 7fb596c9e700 1 -- 172.21.15.16:0/715862310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb590143420 msgr2=0x7fb5900b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:41.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.032+0000 7fb596c9e700 1 --2- 172.21.15.16:0/715862310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb590143420 0x7fb5900b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:41.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.032+0000 7fb596c9e700 1 -- 172.21.15.16:0/715862310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58000b7f0 con 0x7fb59015dab0 2023-08-25T04:43:41.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.032+0000 7fb596c9e700 1 --2- 172.21.15.16:0/715862310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb59015dab0 0x7fb59013c8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb58800efc0 tx=0x7fb58800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:41.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.032+0000 7fb586ffd700 1 -- 172.21.15.16:0/715862310 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800cad0 con 0x7fb59015dab0 2023-08-25T04:43:41.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.032+0000 7fb586ffd700 1 -- 172.21.15.16:0/715862310 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58800f040 con 0x7fb59015dab0 2023-08-25T04:43:41.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.032+0000 7fb598701700 1 -- 172.21.15.16:0/715862310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5901f1f80 con 0x7fb59015dab0 2023-08-25T04:43:41.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.032+0000 7fb586ffd700 1 -- 172.21.15.16:0/715862310 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800ce70 con 0x7fb59015dab0 2023-08-25T04:43:41.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.032+0000 7fb598701700 1 -- 172.21.15.16:0/715862310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb590140110 con 0x7fb59015dab0 2023-08-25T04:43:41.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.033+0000 7fb598701700 1 -- 172.21.15.16:0/715862310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5901f2110 con 0x7fb59015dab0 2023-08-25T04:43:41.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.033+0000 7fb586ffd700 1 -- 172.21.15.16:0/715862310 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb588014480 con 0x7fb59015dab0 2023-08-25T04:43:41.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.034+0000 7fb586ffd700 1 --2- 172.21.15.16:0/715862310 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb57406a0e0 0x7fb57406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:41.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.034+0000 7fb586ffd700 1 -- 172.21.15.16:0/715862310 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb588088da0 con 0x7fb59015dab0 2023-08-25T04:43:41.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.034+0000 7fb59649d700 1 --2- 172.21.15.16:0/715862310 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb57406a0e0 0x7fb57406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:41.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.034+0000 7fb59649d700 1 --2- 172.21.15.16:0/715862310 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb57406a0e0 0x7fb57406c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009be0 tx=0x7fb58c009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:41.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.038+0000 7fb586ffd700 1 -- 172.21.15.16:0/715862310 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb5880545f0 con 0x7fb59015dab0 2023-08-25T04:43:41.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.237+0000 7fb598701700 1 -- 172.21.15.16:0/715862310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb59004ee70 con 0x7fb59015dab0 2023-08-25T04:43:41.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.869+0000 7fb586ffd700 1 -- 172.21.15.16:0/715862310 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb588057c10 con 0x7fb59015dab0 2023-08-25T04:43:41.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.878+0000 7fb598701700 1 -- 172.21.15.16:0/715862310 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb57406a0e0 msgr2=0x7fb57406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:41.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.878+0000 7fb598701700 1 --2- 172.21.15.16:0/715862310 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb57406a0e0 0x7fb57406c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009be0 tx=0x7fb58c009210 comp rx=0 tx=0).stop 2023-08-25T04:43:41.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.878+0000 7fb598701700 1 -- 172.21.15.16:0/715862310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb59015dab0 msgr2=0x7fb59013c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:41.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.878+0000 7fb598701700 1 --2- 172.21.15.16:0/715862310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb59015dab0 0x7fb59013c8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb58800efc0 tx=0x7fb58800c0c0 comp rx=0 tx=0).stop 2023-08-25T04:43:41.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.879+0000 7fb598701700 1 -- 172.21.15.16:0/715862310 shutdown_connections 2023-08-25T04:43:41.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.879+0000 7fb598701700 1 --2- 172.21.15.16:0/715862310 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb57406a0e0 0x7fb57406c5a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:41.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.879+0000 7fb598701700 1 --2- 172.21.15.16:0/715862310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb59015dab0 0x7fb59013c8f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:41.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.879+0000 7fb598701700 1 --2- 172.21.15.16:0/715862310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb590070eb0 0x7fb5901f2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:41.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.879+0000 7fb598701700 1 --2- 172.21.15.16:0/715862310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb590143420 0x7fb5900b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:41.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.879+0000 7fb598701700 1 -- 172.21.15.16:0/715862310 >> 172.21.15.16:0/715862310 conn(0x7fb5900cfe00 msgr2=0x7fb5900d0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:41.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.881+0000 7fb598701700 1 -- 172.21.15.16:0/715862310 shutdown_connections 2023-08-25T04:43:41.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:41.884+0000 7fb598701700 1 -- 172.21.15.16:0/715862310 wait complete. 2023-08-25T04:43:41.891 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2023-08-25T04:43:41.905 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T04:43:42.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.037+0000 7f25bdb82700 1 Processor -- start 2023-08-25T04:43:42.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.037+0000 7f25bdb82700 1 -- start start 2023-08-25T04:43:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.038+0000 7f25bdb82700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f25b81437f0 0x7f25b80c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.038+0000 7f25bdb82700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b806e9a0 con 0x7f25b8146630 2023-08-25T04:43:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.038+0000 7f25bdb82700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b806ebf0 con 0x7f25b806aa50 2023-08-25T04:43:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.038+0000 7f25bdb82700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b80718e0 con 0x7f25b81437f0 2023-08-25T04:43:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.038+0000 7f25b77fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f25b81437f0 0x7f25b80c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.038+0000 7f25b6ffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f25b8146630 0x7f25b806a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39384/0 (socket says 172.21.15.16:39384) 2023-08-25T04:43:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.038+0000 7f25b6ffd700 1 -- 172.21.15.16:0/3961628828 learned_addr learned my addr 172.21.15.16:0/3961628828 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.039+0000 7f25b77fe700 1 -- 172.21.15.16:0/3961628828 >> v1:172.21.15.117:6789/0 conn(0x7f25b806aa50 legacy=0x7f25b806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.039+0000 7f25b77fe700 1 -- 172.21.15.16:0/3961628828 >> v1:172.21.15.16:6789/0 conn(0x7f25b8146630 legacy=0x7f25b806a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.039+0000 7f25b77fe700 1 -- 172.21.15.16:0/3961628828 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b8071af0 con 0x7f25b81437f0 2023-08-25T04:43:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.039+0000 7f25b67fc700 1 -- 172.21.15.16:0/3961628828 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586122485 0 0) 0x7f25b806e9a0 con 0x7f25b8146630 2023-08-25T04:43:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.039+0000 7f25b77fe700 1 --2- 172.21.15.16:0/3961628828 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25b81437f0 0x7f25b80c68f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009840 tx=0x7f25a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d95e954c3bd582a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.039+0000 7f25b67fc700 1 -- 172.21.15.16:0/3961628828 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0004230 con 0x7f25b81437f0 2023-08-25T04:43:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.039+0000 7f25b67fc700 1 -- 172.21.15.16:0/3961628828 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a0004390 con 0x7f25b81437f0 2023-08-25T04:43:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.039+0000 7f25b67fc700 1 -- 172.21.15.16:0/3961628828 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a00036a0 con 0x7f25b81437f0 2023-08-25T04:43:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.040+0000 7f25bdb82700 1 -- 172.21.15.16:0/3961628828 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25b81437f0 msgr2=0x7f25b80c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.040+0000 7f25bdb82700 1 --2- 172.21.15.16:0/3961628828 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25b81437f0 0x7f25b80c68f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009840 tx=0x7f25a0009b50 comp rx=0 tx=0).stop 2023-08-25T04:43:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.040+0000 7f25bdb82700 1 -- 172.21.15.16:0/3961628828 shutdown_connections 2023-08-25T04:43:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.040+0000 7f25bdb82700 1 --2- 172.21.15.16:0/3961628828 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25b81437f0 0x7f25b80c68f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.040+0000 7f25bdb82700 1 -- 172.21.15.16:0/3961628828 >> 172.21.15.16:0/3961628828 conn(0x7f25b80cfe00 msgr2=0x7f25b80d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.040+0000 7f25bdb82700 1 -- 172.21.15.16:0/3961628828 shutdown_connections 2023-08-25T04:43:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.040+0000 7f25bdb82700 1 -- 172.21.15.16:0/3961628828 wait complete. 2023-08-25T04:43:42.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.041+0000 7f25bdb82700 1 Processor -- start 2023-08-25T04:43:42.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.041+0000 7f25bdb82700 1 -- start start 2023-08-25T04:43:42.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25bdb82700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25b806aa50 0x7f25b80b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25bdb82700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b81437f0 0x7f25b8141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25bdb82700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25b8146630 0x7f25b80af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25bdb82700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b8142460 con 0x7f25b806aa50 2023-08-25T04:43:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25bdb82700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80b0fa0 con 0x7f25b81437f0 2023-08-25T04:43:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25bdb82700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80b0390 con 0x7f25b8146630 2023-08-25T04:43:42.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25b77fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25b806aa50 0x7f25b80b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:42.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25b77fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25b806aa50 0x7f25b80b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48974/0 (socket says 172.21.15.16:48974) 2023-08-25T04:43:42.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25b77fe700 1 -- 172.21.15.16:0/2095193682 learned_addr learned my addr 172.21.15.16:0/2095193682 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:42.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25b77fe700 1 -- 172.21.15.16:0/2095193682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25b8146630 msgr2=0x7f25b80af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:42.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25b77fe700 1 --2- 172.21.15.16:0/2095193682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25b8146630 0x7f25b80af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:42.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25b77fe700 1 -- 172.21.15.16:0/2095193682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b81437f0 msgr2=0x7f25b8141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:42.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25b6ffd700 1 --2- 172.21.15.16:0/2095193682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b81437f0 0x7f25b8141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:42.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25b77fe700 1 --2- 172.21.15.16:0/2095193682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b81437f0 0x7f25b8141f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:42.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25b77fe700 1 -- 172.21.15.16:0/2095193682 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a00094a0 con 0x7f25b806aa50 2023-08-25T04:43:42.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25b77fe700 1 --2- 172.21.15.16:0/2095193682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25b806aa50 0x7f25b80b1430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f25b80cd980 tx=0x7f25a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:42.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.042+0000 7f25affff700 1 -- 172.21.15.16:0/2095193682 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0011630 con 0x7f25b806aa50 2023-08-25T04:43:42.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.043+0000 7f25affff700 1 -- 172.21.15.16:0/2095193682 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a001e070 con 0x7f25b806aa50 2023-08-25T04:43:42.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.043+0000 7f25affff700 1 -- 172.21.15.16:0/2095193682 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a00119b0 con 0x7f25b806aa50 2023-08-25T04:43:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.043+0000 7f25bdb82700 1 -- 172.21.15.16:0/2095193682 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b80b0670 con 0x7f25b806aa50 2023-08-25T04:43:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.043+0000 7f25bdb82700 1 -- 172.21.15.16:0/2095193682 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b80b0c30 con 0x7f25b806aa50 2023-08-25T04:43:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.043+0000 7f25bdb82700 1 -- 172.21.15.16:0/2095193682 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b80b1280 con 0x7f25b806aa50 2023-08-25T04:43:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.044+0000 7f25affff700 1 -- 172.21.15.16:0/2095193682 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f25a0011b10 con 0x7f25b806aa50 2023-08-25T04:43:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.044+0000 7f25affff700 1 --2- 172.21.15.16:0/2095193682 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f259806a0e0 0x7f259806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.044+0000 7f25affff700 1 -- 172.21.15.16:0/2095193682 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f25a0089910 con 0x7f25b806aa50 2023-08-25T04:43:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.045+0000 7f25b6ffd700 1 --2- 172.21.15.16:0/2095193682 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f259806a0e0 0x7f259806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:42.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.045+0000 7f25b6ffd700 1 --2- 172.21.15.16:0/2095193682 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f259806a0e0 0x7f259806c5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f25b80ae9c0 tx=0x7f25a8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:42.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.049+0000 7f25affff700 1 -- 172.21.15.16:0/2095193682 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f25a0055050 con 0x7f25b806aa50 2023-08-25T04:43:42.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.295+0000 7f25bdb82700 1 -- 172.21.15.16:0/2095193682 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f25b804ee70 con 0x7f25b806aa50 2023-08-25T04:43:42.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.873+0000 7f25affff700 1 -- 172.21.15.16:0/2095193682 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f25a0020020 con 0x7f25b806aa50 2023-08-25T04:43:42.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.881+0000 7f25bdb82700 1 -- 172.21.15.16:0/2095193682 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f259806a0e0 msgr2=0x7f259806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:42.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.881+0000 7f25bdb82700 1 --2- 172.21.15.16:0/2095193682 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f259806a0e0 0x7f259806c5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f25b80ae9c0 tx=0x7f25a8009040 comp rx=0 tx=0).stop 2023-08-25T04:43:42.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.881+0000 7f25bdb82700 1 -- 172.21.15.16:0/2095193682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25b806aa50 msgr2=0x7f25b80b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:42.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.881+0000 7f25bdb82700 1 --2- 172.21.15.16:0/2095193682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25b806aa50 0x7f25b80b1430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f25b80cd980 tx=0x7f25a0004750 comp rx=0 tx=0).stop 2023-08-25T04:43:42.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.881+0000 7f25bdb82700 1 -- 172.21.15.16:0/2095193682 shutdown_connections 2023-08-25T04:43:42.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.881+0000 7f25bdb82700 1 --2- 172.21.15.16:0/2095193682 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f259806a0e0 0x7f259806c5a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:42.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.881+0000 7f25bdb82700 1 --2- 172.21.15.16:0/2095193682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25b8146630 0x7f25b80af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:42.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.881+0000 7f25bdb82700 1 --2- 172.21.15.16:0/2095193682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25b806aa50 0x7f25b80b1430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:42.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.881+0000 7f25bdb82700 1 --2- 172.21.15.16:0/2095193682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b81437f0 0x7f25b8141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:42.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.881+0000 7f25bdb82700 1 -- 172.21.15.16:0/2095193682 >> 172.21.15.16:0/2095193682 conn(0x7f25b80cfe00 msgr2=0x7f25b806a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:42.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.881+0000 7f25bdb82700 1 -- 172.21.15.16:0/2095193682 shutdown_connections 2023-08-25T04:43:42.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:42.881+0000 7f25bdb82700 1 -- 172.21.15.16:0/2095193682 wait complete. 2023-08-25T04:43:42.888 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 3 and data pool 4 2023-08-25T04:43:42.912 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:43:43.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.041+0000 7f386fe69700 1 Processor -- start 2023-08-25T04:43:43.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.041+0000 7f386fe69700 1 -- start start 2023-08-25T04:43:43.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386fe69700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f386815cf40 0x7f38680cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386fe69700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38680cf970 0x7f386806a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386fe69700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386815d320 0x7f386806a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386fe69700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38680ac850 con 0x7f386815cf40 2023-08-25T04:43:43.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386fe69700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38680ce240 con 0x7f38680cf970 2023-08-25T04:43:43.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386fe69700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3868071a60 con 0x7f386815d320 2023-08-25T04:43:43.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386dc05700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f386815cf40 0x7f38680cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386dc05700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f386815cf40 0x7f38680cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48982/0 (socket says 172.21.15.16:48982) 2023-08-25T04:43:43.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386dc05700 1 -- 172.21.15.16:0/3177212579 learned_addr learned my addr 172.21.15.16:0/3177212579 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:43.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386d404700 1 --2- 172.21.15.16:0/3177212579 >> v2:172.21.15.117:3300/0 conn(0x7f38680cf970 0x7f386806a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386e406700 1 --2- 172.21.15.16:0/3177212579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386815d320 0x7f386806a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386dc05700 1 -- 172.21.15.16:0/3177212579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386815d320 msgr2=0x7f386806a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:43.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386dc05700 1 --2- 172.21.15.16:0/3177212579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386815d320 0x7f386806a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386dc05700 1 -- 172.21.15.16:0/3177212579 >> v2:172.21.15.117:3300/0 conn(0x7f38680cf970 msgr2=0x7f386806a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:43.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386dc05700 1 --2- 172.21.15.16:0/3177212579 >> v2:172.21.15.117:3300/0 conn(0x7f38680cf970 0x7f386806a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386dc05700 1 -- 172.21.15.16:0/3177212579 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3868071d40 con 0x7f386815cf40 2023-08-25T04:43:43.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.042+0000 7f386dc05700 1 --2- 172.21.15.16:0/3177212579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f386815cf40 0x7f38680cda10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f386806c9c0 tx=0x7f3864009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0e2e3eb1c564c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:43.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.043+0000 7f386cc03700 1 -- 172.21.15.16:0/3177212579 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386400b870 con 0x7f386815cf40 2023-08-25T04:43:43.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.043+0000 7f386cc03700 1 -- 172.21.15.16:0/3177212579 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386400b9d0 con 0x7f386815cf40 2023-08-25T04:43:43.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.043+0000 7f386cc03700 1 -- 172.21.15.16:0/3177212579 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386400bd60 con 0x7f386815cf40 2023-08-25T04:43:43.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.043+0000 7f386fe69700 1 -- 172.21.15.16:0/3177212579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f386815cf40 msgr2=0x7f38680cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.043+0000 7f386fe69700 1 --2- 172.21.15.16:0/3177212579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f386815cf40 0x7f38680cda10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f386806c9c0 tx=0x7f3864009bd0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.043+0000 7f386fe69700 1 -- 172.21.15.16:0/3177212579 shutdown_connections 2023-08-25T04:43:43.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.043+0000 7f386fe69700 1 --2- 172.21.15.16:0/3177212579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386815d320 0x7f386806a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.043+0000 7f386fe69700 1 --2- 172.21.15.16:0/3177212579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f386815cf40 0x7f38680cda10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.043+0000 7f386fe69700 1 --2- 172.21.15.16:0/3177212579 >> v2:172.21.15.117:3300/0 conn(0x7f38680cf970 0x7f386806a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.043+0000 7f386fe69700 1 -- 172.21.15.16:0/3177212579 >> 172.21.15.16:0/3177212579 conn(0x7f38680b1a10 msgr2=0x7f38680b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:43.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.043+0000 7f386fe69700 1 -- 172.21.15.16:0/3177212579 shutdown_connections 2023-08-25T04:43:43.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.043+0000 7f386fe69700 1 -- 172.21.15.16:0/3177212579 wait complete. 2023-08-25T04:43:43.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.045+0000 7f386fe69700 1 Processor -- start 2023-08-25T04:43:43.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.045+0000 7f386fe69700 1 -- start start 2023-08-25T04:43:43.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.045+0000 7f386fe69700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38680cf970 0x7f3868152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.045+0000 7f386fe69700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f386815cf40 0x7f3868152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.045+0000 7f386fe69700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386815d320 0x7f38680c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.045+0000 7f386fe69700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38680b3a40 con 0x7f386815cf40 2023-08-25T04:43:43.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.045+0000 7f386fe69700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38680c3e80 con 0x7f38680cf970 2023-08-25T04:43:43.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.045+0000 7f386fe69700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38681527b0 con 0x7f386815d320 2023-08-25T04:43:43.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.045+0000 7f386d404700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f386815cf40 0x7f3868152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.045+0000 7f386d404700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f386815cf40 0x7f3868152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48990/0 (socket says 172.21.15.16:48990) 2023-08-25T04:43:43.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.045+0000 7f386d404700 1 -- 172.21.15.16:0/175192516 learned_addr learned my addr 172.21.15.16:0/175192516 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:43.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.046+0000 7f386dc05700 1 --2- 172.21.15.16:0/175192516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38680cf970 0x7f3868152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.046+0000 7f386e406700 1 --2- 172.21.15.16:0/175192516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386815d320 0x7f38680c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.046+0000 7f386d404700 1 -- 172.21.15.16:0/175192516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386815d320 msgr2=0x7f38680c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.046+0000 7f386d404700 1 --2- 172.21.15.16:0/175192516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386815d320 0x7f38680c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.046+0000 7f386d404700 1 -- 172.21.15.16:0/175192516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38680cf970 msgr2=0x7f3868152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.046+0000 7f386d404700 1 --2- 172.21.15.16:0/175192516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38680cf970 0x7f3868152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.046+0000 7f386d404700 1 -- 172.21.15.16:0/175192516 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3864009550 con 0x7f386815cf40 2023-08-25T04:43:43.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.046+0000 7f386d404700 1 --2- 172.21.15.16:0/175192516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f386815cf40 0x7f3868152de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f385800c7f0 tx=0x7f385800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:43.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.046+0000 7f385e7fc700 1 -- 172.21.15.16:0/175192516 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3858011800 con 0x7f386815cf40 2023-08-25T04:43:43.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.046+0000 7f385e7fc700 1 -- 172.21.15.16:0/175192516 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3858011960 con 0x7f386815cf40 2023-08-25T04:43:43.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.046+0000 7f386fe69700 1 -- 172.21.15.16:0/175192516 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38680b3c50 con 0x7f386815cf40 2023-08-25T04:43:43.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.046+0000 7f385e7fc700 1 -- 172.21.15.16:0/175192516 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3858011cf0 con 0x7f386815cf40 2023-08-25T04:43:43.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.046+0000 7f386fe69700 1 -- 172.21.15.16:0/175192516 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38680b4210 con 0x7f386815cf40 2023-08-25T04:43:43.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.047+0000 7f386fe69700 1 -- 172.21.15.16:0/175192516 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386815caf0 con 0x7f386815cf40 2023-08-25T04:43:43.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.047+0000 7f385e7fc700 1 -- 172.21.15.16:0/175192516 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3858018360 con 0x7f386815cf40 2023-08-25T04:43:43.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.048+0000 7f385e7fc700 1 --2- 172.21.15.16:0/175192516 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f384c06a0e0 0x7f384c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.048+0000 7f385e7fc700 1 -- 172.21.15.16:0/175192516 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38580885b0 con 0x7f386815cf40 2023-08-25T04:43:43.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.048+0000 7f386dc05700 1 --2- 172.21.15.16:0/175192516 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f384c06a0e0 0x7f384c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.049+0000 7f386dc05700 1 --2- 172.21.15.16:0/175192516 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f384c06a0e0 0x7f384c06c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3864000c00 tx=0x7f3864008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:43.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.053+0000 7f385e7fc700 1 -- 172.21.15.16:0/175192516 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3858053c10 con 0x7f386815cf40 2023-08-25T04:43:43.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.254+0000 7f386fe69700 1 -- 172.21.15.16:0/175192516 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f386804ee70 con 0x7f386815cf40 2023-08-25T04:43:43.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.256+0000 7f385e7fc700 1 -- 172.21.15.16:0/175192516 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18246 (secure 0 0 0) 0x7f3858057230 con 0x7f386815cf40 2023-08-25T04:43:43.257 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:43.257 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:43:42.297281+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:43:40.197381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:43:41.268759+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:43:43.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.258+0000 7f386fe69700 1 -- 172.21.15.16:0/175192516 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f384c06a0e0 msgr2=0x7f384c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.258+0000 7f386fe69700 1 --2- 172.21.15.16:0/175192516 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f384c06a0e0 0x7f384c06c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3864000c00 tx=0x7f3864008030 comp rx=0 tx=0).stop 2023-08-25T04:43:43.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.258+0000 7f386fe69700 1 -- 172.21.15.16:0/175192516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f386815cf40 msgr2=0x7f3868152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.258+0000 7f386fe69700 1 --2- 172.21.15.16:0/175192516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f386815cf40 0x7f3868152de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f385800c7f0 tx=0x7f385800cbb0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.258+0000 7f386fe69700 1 -- 172.21.15.16:0/175192516 shutdown_connections 2023-08-25T04:43:43.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.258+0000 7f386fe69700 1 --2- 172.21.15.16:0/175192516 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f384c06a0e0 0x7f384c06c5a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.258+0000 7f386fe69700 1 --2- 172.21.15.16:0/175192516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f386815d320 0x7f38680c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.258+0000 7f386fe69700 1 --2- 172.21.15.16:0/175192516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38680cf970 0x7f3868152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.258+0000 7f386fe69700 1 --2- 172.21.15.16:0/175192516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f386815cf40 0x7f3868152de0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.258+0000 7f386fe69700 1 -- 172.21.15.16:0/175192516 >> 172.21.15.16:0/175192516 conn(0x7f38680b1a10 msgr2=0x7f38680adca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:43.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.258+0000 7f386fe69700 1 -- 172.21.15.16:0/175192516 shutdown_connections 2023-08-25T04:43:43.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.258+0000 7f386fe69700 1 -- 172.21.15.16:0/175192516 wait complete. 2023-08-25T04:43:43.272 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:43:43.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.397+0000 7f9bc1dac700 1 Processor -- start 2023-08-25T04:43:43.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.397+0000 7f9bc1dac700 1 -- start start 2023-08-25T04:43:43.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bc1dac700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9bbc15d520 0x7f9bbc0d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bc1dac700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc0b2be0 con 0x7f9bbc0b3070 2023-08-25T04:43:43.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bc1dac700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc0d0a40 con 0x7f9bbc0d3dc0 2023-08-25T04:43:43.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bc1dac700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc0ce6f0 con 0x7f9bbc15d520 2023-08-25T04:43:43.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bbbfff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9bbc0b3070 0x7f9bbc0b3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39414/0 (socket says 172.21.15.16:39414) 2023-08-25T04:43:43.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bbbfff700 1 -- 172.21.15.16:0/187984820 learned_addr learned my addr 172.21.15.16:0/187984820 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:43.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bbb7fe700 1 --2- 172.21.15.16:0/187984820 >> v2:172.21.15.117:3300/0 conn(0x7f9bbc15d520 0x7f9bbc0d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bba7fc700 1 -- 172.21.15.16:0/187984820 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839685573 0 0) 0x7f9bbc0b2be0 con 0x7f9bbc0b3070 2023-08-25T04:43:43.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bba7fc700 1 -- 172.21.15.16:0/187984820 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba40035b0 con 0x7f9bbc0b3070 2023-08-25T04:43:43.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bba7fc700 1 -- 172.21.15.16:0/187984820 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 141685448 0 0) 0x7f9ba40035b0 con 0x7f9bbc0b3070 2023-08-25T04:43:43.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bba7fc700 1 -- 172.21.15.16:0/187984820 >> v2:172.21.15.117:3300/0 conn(0x7f9bbc15d520 msgr2=0x7f9bbc0d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:43.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bba7fc700 1 --2- 172.21.15.16:0/187984820 >> v2:172.21.15.117:3300/0 conn(0x7f9bbc15d520 0x7f9bbc0d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bba7fc700 1 -- 172.21.15.16:0/187984820 >> v1:172.21.15.117:6789/0 conn(0x7f9bbc0d3dc0 legacy=0x7f9bbc0d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bba7fc700 1 -- 172.21.15.16:0/187984820 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0ce900 con 0x7f9bbc0b3070 2023-08-25T04:43:43.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bba7fc700 1 -- 172.21.15.16:0/187984820 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f9bb40019f0 con 0x7f9bbc0b3070 2023-08-25T04:43:43.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.398+0000 7f9bba7fc700 1 -- 172.21.15.16:0/187984820 >> v1:172.21.15.16:6789/0 conn(0x7f9bbc0b3070 legacy=0x7f9bbc0b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bba7fc700 1 --2- 172.21.15.16:0/187984820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba4003a70 0x7f9ba4003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bba7fc700 1 --2- 172.21.15.16:0/187984820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ba4004850 0x7f9ba4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bba7fc700 1 --2- 172.21.15.16:0/187984820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba4005210 0x7f9ba400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bba7fc700 1 -- 172.21.15.16:0/187984820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc0ce6f0 con 0x7f9ba4003a70 2023-08-25T04:43:43.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bba7fc700 1 -- 172.21.15.16:0/187984820 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba400c140 con 0x7f9ba4005210 2023-08-25T04:43:43.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bba7fc700 1 -- 172.21.15.16:0/187984820 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba400c300 con 0x7f9ba4004850 2023-08-25T04:43:43.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bbb7fe700 1 --2- 172.21.15.16:0/187984820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba4003a70 0x7f9ba4003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bbbfff700 1 --2- 172.21.15.16:0/187984820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba4005210 0x7f9ba400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bbaffd700 1 --2- 172.21.15.16:0/187984820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ba4004850 0x7f9ba4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bbb7fe700 1 -- 172.21.15.16:0/187984820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ba4004850 msgr2=0x7f9ba4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:43.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bbb7fe700 1 --2- 172.21.15.16:0/187984820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ba4004850 0x7f9ba4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bbb7fe700 1 -- 172.21.15.16:0/187984820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba4005210 msgr2=0x7f9ba400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:43.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bbb7fe700 1 --2- 172.21.15.16:0/187984820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba4005210 0x7f9ba400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bbbfff700 1 -- 172.21.15.16:0/187984820 reap_dead start 2023-08-25T04:43:43.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bbb7fe700 1 -- 172.21.15.16:0/187984820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40035b0 con 0x7f9ba4003a70 2023-08-25T04:43:43.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bbb7fe700 1 --2- 172.21.15.16:0/187984820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba4003a70 0x7f9ba4003e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009b60 tx=0x7f9ba4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d85f94017502cc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:43.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bba7fc700 1 -- 172.21.15.16:0/187984820 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00e6c0 con 0x7f9ba4003a70 2023-08-25T04:43:43.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bba7fc700 1 -- 172.21.15.16:0/187984820 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00e820 con 0x7f9ba4003a70 2023-08-25T04:43:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.399+0000 7f9bba7fc700 1 -- 172.21.15.16:0/187984820 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00eb90 con 0x7f9ba4003a70 2023-08-25T04:43:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.400+0000 7f9bc1dac700 1 -- 172.21.15.16:0/187984820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba4003a70 msgr2=0x7f9ba4003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.400+0000 7f9bc1dac700 1 --2- 172.21.15.16:0/187984820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba4003a70 0x7f9ba4003e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009b60 tx=0x7f9ba4005880 comp rx=0 tx=0).stop 2023-08-25T04:43:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.400+0000 7f9bc1dac700 1 -- 172.21.15.16:0/187984820 shutdown_connections 2023-08-25T04:43:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.400+0000 7f9bc1dac700 1 --2- 172.21.15.16:0/187984820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba4003a70 0x7f9ba4003e90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.400+0000 7f9bc1dac700 1 -- 172.21.15.16:0/187984820 >> 172.21.15.16:0/187984820 conn(0x7f9bbc0d3110 msgr2=0x7f9bbc0d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.400+0000 7f9bc1dac700 1 -- 172.21.15.16:0/187984820 shutdown_connections 2023-08-25T04:43:43.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.400+0000 7f9bc1dac700 1 -- 172.21.15.16:0/187984820 wait complete. 2023-08-25T04:43:43.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.401+0000 7f9bc1dac700 1 Processor -- start 2023-08-25T04:43:43.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.402+0000 7f9bc1dac700 1 -- start start 2023-08-25T04:43:43.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bc1dac700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba4003a70 0x7f9bbc0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bc1dac700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bbc1f24a0 0x7f9bbc0c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bc1dac700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc159990 0x7f9bbc159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bc1dac700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc14f040 con 0x7f9ba4003a70 2023-08-25T04:43:43.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bc1dac700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc15a350 con 0x7f9bbc1f24a0 2023-08-25T04:43:43.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bc1dac700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc14f1d0 con 0x7f9bbc159990 2023-08-25T04:43:43.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bbb7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba4003a70 0x7f9bbc0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bbb7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba4003a70 0x7f9bbc0ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49008/0 (socket says 172.21.15.16:49008) 2023-08-25T04:43:43.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bbb7fe700 1 -- 172.21.15.16:0/1419499886 learned_addr learned my addr 172.21.15.16:0/1419499886 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:43.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bbaffd700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bbc1f24a0 0x7f9bbc0c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bbbfff700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc159990 0x7f9bbc159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bbb7fe700 1 -- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc159990 msgr2=0x7f9bbc159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bbb7fe700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc159990 0x7f9bbc159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bbb7fe700 1 -- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bbc1f24a0 msgr2=0x7f9bbc0c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bbb7fe700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bbc1f24a0 0x7f9bbc0c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bbb7fe700 1 -- 172.21.15.16:0/1419499886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0ca7c0 con 0x7f9ba4003a70 2023-08-25T04:43:43.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bbbfff700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc159990 0x7f9bbc159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:43.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bbb7fe700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba4003a70 0x7f9bbc0ca1e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00e4b0 tx=0x7f9bac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:43.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9ba3fff700 1 -- 172.21.15.16:0/1419499886 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00e6c0 con 0x7f9ba4003a70 2023-08-25T04:43:43.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9ba3fff700 1 -- 172.21.15.16:0/1419499886 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac003ad0 con 0x7f9ba4003a70 2023-08-25T04:43:43.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9ba3fff700 1 -- 172.21.15.16:0/1419499886 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac003e80 con 0x7f9ba4003a70 2023-08-25T04:43:43.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bc1dac700 1 -- 172.21.15.16:0/1419499886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc0caaa0 con 0x7f9ba4003a70 2023-08-25T04:43:43.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.403+0000 7f9bc1dac700 1 -- 172.21.15.16:0/1419499886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc0cb060 con 0x7f9ba4003a70 2023-08-25T04:43:43.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.404+0000 7f9bc1dac700 1 -- 172.21.15.16:0/1419499886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc04ee70 con 0x7f9ba4003a70 2023-08-25T04:43:43.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.405+0000 7f9ba3fff700 1 -- 172.21.15.16:0/1419499886 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9bac013470 con 0x7f9ba4003a70 2023-08-25T04:43:43.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.405+0000 7f9ba3fff700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f9ba806a0e0 0x7f9ba806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.405+0000 7f9ba3fff700 1 -- 172.21.15.16:0/1419499886 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9bac089e50 con 0x7f9ba4003a70 2023-08-25T04:43:43.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.405+0000 7f9bbaffd700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f9ba806a0e0 0x7f9ba806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.406+0000 7f9bbaffd700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f9ba806a0e0 0x7f9ba806c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0b0490 tx=0x7f9bb0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:43.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.410+0000 7f9ba3fff700 1 -- 172.21.15.16:0/1419499886 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9bac0555d0 con 0x7f9ba4003a70 2023-08-25T04:43:43.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.613+0000 7f9bc1dac700 1 -- 172.21.15.16:0/1419499886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bbc0b1dc0 con 0x7f9ba4003a70 2023-08-25T04:43:43.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.614+0000 7f9ba3fff700 1 -- 172.21.15.16:0/1419499886 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18246 (secure 0 0 0) 0x7f9bac017090 con 0x7f9ba4003a70 2023-08-25T04:43:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:43.616 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:43:42.297281+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:43:40.197381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:43:41.268759+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:43:43.617 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:43:43.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.617+0000 7f9bc1dac700 1 -- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f9ba806a0e0 msgr2=0x7f9ba806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.617+0000 7f9bc1dac700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f9ba806a0e0 0x7f9ba806c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0b0490 tx=0x7f9bb0009040 comp rx=0 tx=0).stop 2023-08-25T04:43:43.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.617+0000 7f9bc1dac700 1 -- 172.21.15.16:0/1419499886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba4003a70 msgr2=0x7f9bbc0ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.617+0000 7f9bc1dac700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba4003a70 0x7f9bbc0ca1e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00e4b0 tx=0x7f9bac0047c0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.617+0000 7f9bc1dac700 1 -- 172.21.15.16:0/1419499886 shutdown_connections 2023-08-25T04:43:43.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.617+0000 7f9bc1dac700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f9ba806a0e0 0x7f9ba806c5a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.617+0000 7f9bc1dac700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bbc159990 0x7f9bbc159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.617+0000 7f9bc1dac700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba4003a70 0x7f9bbc0ca1e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.617+0000 7f9bc1dac700 1 --2- 172.21.15.16:0/1419499886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bbc1f24a0 0x7f9bbc0c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.617+0000 7f9bc1dac700 1 -- 172.21.15.16:0/1419499886 >> 172.21.15.16:0/1419499886 conn(0x7f9bbc0d3110 msgr2=0x7f9bbc0afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:43.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.617+0000 7f9bc1dac700 1 -- 172.21.15.16:0/1419499886 shutdown_connections 2023-08-25T04:43:43.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.617+0000 7f9bc1dac700 1 -- 172.21.15.16:0/1419499886 wait complete. 2023-08-25T04:43:43.622 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:43:43.631 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T04:43:43.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.836+0000 7f6ef5247700 1 Processor -- start 2023-08-25T04:43:43.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.836+0000 7f6ef5247700 1 -- start start 2023-08-25T04:43:43.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.837+0000 7f6ef5247700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6ef006aa50 0x7f6ef00c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.837+0000 7f6ef5247700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef0146630 0x7f6ef006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.837+0000 7f6ef5247700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef006e9a0 con 0x7f6ef01437f0 2023-08-25T04:43:43.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.837+0000 7f6ef5247700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef00718e0 con 0x7f6ef006aa50 2023-08-25T04:43:43.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.837+0000 7f6ef5247700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef00c4db0 con 0x7f6ef0146630 2023-08-25T04:43:43.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.837+0000 7f6eee59c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6ef006aa50 0x7f6ef00c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.837+0000 7f6eeed9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6ef01437f0 0x7f6ef006a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39430/0 (socket says 172.21.15.16:39430) 2023-08-25T04:43:43.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.837+0000 7f6eeed9d700 1 -- 172.21.15.16:0/4151805264 learned_addr learned my addr 172.21.15.16:0/4151805264 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:43.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.838+0000 7f6eef59e700 1 --2- 172.21.15.16:0/4151805264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef0146630 0x7f6ef006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.838+0000 7f6eee59c700 1 -- 172.21.15.16:0/4151805264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef0146630 msgr2=0x7f6ef006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:43.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.838+0000 7f6eee59c700 1 --2- 172.21.15.16:0/4151805264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef0146630 0x7f6ef006cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.838+0000 7f6eee59c700 1 -- 172.21.15.16:0/4151805264 >> v1:172.21.15.16:6789/0 conn(0x7f6ef01437f0 legacy=0x7f6ef006a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.838+0000 7f6eee59c700 1 -- 172.21.15.16:0/4151805264 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef006ebf0 con 0x7f6ef006aa50 2023-08-25T04:43:43.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.838+0000 7f6eee59c700 1 --2- 172.21.15.16:0/4151805264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef006aa50 0x7f6ef00c68f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009840 tx=0x7f6ee0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23fc71fa954cca1f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:43.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.838+0000 7f6eedd9b700 1 -- 172.21.15.16:0/4151805264 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0011830 con 0x7f6ef006aa50 2023-08-25T04:43:43.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.838+0000 7f6eedd9b700 1 -- 172.21.15.16:0/4151805264 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee0011990 con 0x7f6ef006aa50 2023-08-25T04:43:43.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.838+0000 7f6eedd9b700 1 -- 172.21.15.16:0/4151805264 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0011d20 con 0x7f6ef006aa50 2023-08-25T04:43:43.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.838+0000 7f6ef5247700 1 -- 172.21.15.16:0/4151805264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef006aa50 msgr2=0x7f6ef00c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.838+0000 7f6ef5247700 1 --2- 172.21.15.16:0/4151805264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef006aa50 0x7f6ef00c68f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009840 tx=0x7f6ee0009b50 comp rx=0 tx=0).stop 2023-08-25T04:43:43.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.839+0000 7f6ef5247700 1 -- 172.21.15.16:0/4151805264 shutdown_connections 2023-08-25T04:43:43.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.839+0000 7f6ef5247700 1 --2- 172.21.15.16:0/4151805264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef0146630 0x7f6ef006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.839+0000 7f6ef5247700 1 --2- 172.21.15.16:0/4151805264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef006aa50 0x7f6ef00c68f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.839+0000 7f6ef5247700 1 -- 172.21.15.16:0/4151805264 >> 172.21.15.16:0/4151805264 conn(0x7f6ef00cfe00 msgr2=0x7f6ef00d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:43.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.839+0000 7f6ef5247700 1 -- 172.21.15.16:0/4151805264 shutdown_connections 2023-08-25T04:43:43.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.839+0000 7f6ef5247700 1 -- 172.21.15.16:0/4151805264 wait complete. 2023-08-25T04:43:43.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.840+0000 7f6ef5247700 1 Processor -- start 2023-08-25T04:43:43.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.840+0000 7f6ef5247700 1 -- start start 2023-08-25T04:43:43.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6ef5247700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef006aa50 0x7f6ef0142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6ef5247700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef01437f0 0x7f6ef00b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6ef5247700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef0146630 0x7f6ef00b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6ef5247700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef01594a0 con 0x7f6ef006aa50 2023-08-25T04:43:43.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6ef5247700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef0142c60 con 0x7f6ef0146630 2023-08-25T04:43:43.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6ef5247700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef0158ee0 con 0x7f6ef01437f0 2023-08-25T04:43:43.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6eeed9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef006aa50 0x7f6ef0142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6eeed9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef006aa50 0x7f6ef0142720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49022/0 (socket says 172.21.15.16:49022) 2023-08-25T04:43:43.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6eeed9d700 1 -- 172.21.15.16:0/324081934 learned_addr learned my addr 172.21.15.16:0/324081934 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:43.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6eee59c700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef01437f0 0x7f6ef00b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6eef59e700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef0146630 0x7f6ef00b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6eeed9d700 1 -- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef01437f0 msgr2=0x7f6ef00b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6eeed9d700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef01437f0 0x7f6ef00b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6eeed9d700 1 -- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef0146630 msgr2=0x7f6ef00b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:43.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6eeed9d700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef0146630 0x7f6ef00b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:43.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6eeed9d700 1 -- 172.21.15.16:0/324081934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee00094a0 con 0x7f6ef006aa50 2023-08-25T04:43:43.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6eee59c700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef01437f0 0x7f6ef00b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:43.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6eef59e700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef0146630 0x7f6ef00b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:43.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.841+0000 7f6eeed9d700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef006aa50 0x7f6ef0142720 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400c550 tx=0x7f6ee400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:43.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.842+0000 7f6ed77fe700 1 -- 172.21.15.16:0/324081934 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4005d70 con 0x7f6ef006aa50 2023-08-25T04:43:43.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.842+0000 7f6ed77fe700 1 -- 172.21.15.16:0/324081934 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee40070d0 con 0x7f6ef006aa50 2023-08-25T04:43:43.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.842+0000 7f6ef5247700 1 -- 172.21.15.16:0/324081934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef01591c0 con 0x7f6ef006aa50 2023-08-25T04:43:43.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.842+0000 7f6ed77fe700 1 -- 172.21.15.16:0/324081934 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4007440 con 0x7f6ef006aa50 2023-08-25T04:43:43.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.842+0000 7f6ef5247700 1 -- 172.21.15.16:0/324081934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef00b2d60 con 0x7f6ef006aa50 2023-08-25T04:43:43.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.843+0000 7f6ef5247700 1 -- 172.21.15.16:0/324081934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef004ee70 con 0x7f6ef006aa50 2023-08-25T04:43:43.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.843+0000 7f6ed77fe700 1 -- 172.21.15.16:0/324081934 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6ee40075a0 con 0x7f6ef006aa50 2023-08-25T04:43:43.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.843+0000 7f6ed77fe700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6edc06a0e0 0x7f6edc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:43.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.844+0000 7f6ed77fe700 1 -- 172.21.15.16:0/324081934 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ee40878b0 con 0x7f6ef006aa50 2023-08-25T04:43:43.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.844+0000 7f6eee59c700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6edc06a0e0 0x7f6edc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:43.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.844+0000 7f6eee59c700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6edc06a0e0 0x7f6edc06c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009840 tx=0x7f6ee0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:43.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:43.848+0000 7f6ed77fe700 1 -- 172.21.15.16:0/324081934 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6ee40530e0 con 0x7f6ef006aa50 2023-08-25T04:43:44.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:44.098+0000 7f6ef5247700 1 -- 172.21.15.16:0/324081934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6ef006f2d0 con 0x7f6ef006aa50 2023-08-25T04:43:44.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:44.899+0000 7f6ed77fe700 1 -- 172.21.15.16:0/324081934 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6ee4056700 con 0x7f6ef006aa50 2023-08-25T04:43:44.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:44.902+0000 7f6ef5247700 1 -- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6edc06a0e0 msgr2=0x7f6edc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:44.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:44.902+0000 7f6ef5247700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6edc06a0e0 0x7f6edc06c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009840 tx=0x7f6ee0008030 comp rx=0 tx=0).stop 2023-08-25T04:43:44.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:44.902+0000 7f6ef5247700 1 -- 172.21.15.16:0/324081934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef006aa50 msgr2=0x7f6ef0142720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:44.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:44.902+0000 7f6ef5247700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef006aa50 0x7f6ef0142720 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400c550 tx=0x7f6ee400c910 comp rx=0 tx=0).stop 2023-08-25T04:43:44.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:44.902+0000 7f6ef5247700 1 -- 172.21.15.16:0/324081934 shutdown_connections 2023-08-25T04:43:44.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:44.902+0000 7f6ef5247700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6edc06a0e0 0x7f6edc06c5a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:44.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:44.902+0000 7f6ef5247700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef0146630 0x7f6ef00b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:44.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:44.902+0000 7f6ef5247700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef006aa50 0x7f6ef0142720 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:44.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:44.902+0000 7f6ef5247700 1 --2- 172.21.15.16:0/324081934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef01437f0 0x7f6ef00b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:44.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:44.902+0000 7f6ef5247700 1 -- 172.21.15.16:0/324081934 >> 172.21.15.16:0/324081934 conn(0x7f6ef00cfe00 msgr2=0x7f6ef015fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:44.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:44.902+0000 7f6ef5247700 1 -- 172.21.15.16:0/324081934 shutdown_connections 2023-08-25T04:43:44.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:44.902+0000 7f6ef5247700 1 -- 172.21.15.16:0/324081934 wait complete. 2023-08-25T04:43:44.918 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T04:43:44.919 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T04:43:45.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.052+0000 7fdee8c21700 1 Processor -- start 2023-08-25T04:43:45.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.052+0000 7fdee8c21700 1 -- start start 2023-08-25T04:43:45.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee8c21700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee415b360 0x7fdee40b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:45.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee8c21700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdee40ae9d0 0x7fdee4065fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:45.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee8c21700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdee406a340 0x7fdee406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:45.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee8c21700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee406ad10 con 0x7fdee40ae9d0 2023-08-25T04:43:45.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee8c21700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee40b1010 con 0x7fdee406a340 2023-08-25T04:43:45.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee8c21700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee40cff60 con 0x7fdee415b360 2023-08-25T04:43:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee1d9b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdee40ae9d0 0x7fdee4065fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee1d9b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdee40ae9d0 0x7fdee4065fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49030/0 (socket says 172.21.15.16:49030) 2023-08-25T04:43:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee1d9b700 1 -- 172.21.15.16:0/1052493742 learned_addr learned my addr 172.21.15.16:0/1052493742 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee259c700 1 --2- 172.21.15.16:0/1052493742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee415b360 0x7fdee40b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee2d9d700 1 --2- 172.21.15.16:0/1052493742 >> v2:172.21.15.117:3300/0 conn(0x7fdee406a340 0x7fdee406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee1d9b700 1 -- 172.21.15.16:0/1052493742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee415b360 msgr2=0x7fdee40b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee1d9b700 1 --2- 172.21.15.16:0/1052493742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee415b360 0x7fdee40b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:45.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee1d9b700 1 -- 172.21.15.16:0/1052493742 >> v2:172.21.15.117:3300/0 conn(0x7fdee406a340 msgr2=0x7fdee406a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:45.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee1d9b700 1 --2- 172.21.15.16:0/1052493742 >> v2:172.21.15.117:3300/0 conn(0x7fdee406a340 0x7fdee406a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:45.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee1d9b700 1 -- 172.21.15.16:0/1052493742 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee415b740 con 0x7fdee40ae9d0 2023-08-25T04:43:45.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee2d9d700 1 --2- 172.21.15.16:0/1052493742 >> v2:172.21.15.117:3300/0 conn(0x7fdee406a340 0x7fdee406a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:45.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.053+0000 7fdee1d9b700 1 --2- 172.21.15.16:0/1052493742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee40ae9d0 0x7fdee4065fe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdee406b7d0 tx=0x7fded4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3be48bd543cc4d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:45.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.054+0000 7fdee159a700 1 -- 172.21.15.16:0/1052493742 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400b870 con 0x7fdee40ae9d0 2023-08-25T04:43:45.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.054+0000 7fdee159a700 1 -- 172.21.15.16:0/1052493742 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded400b9d0 con 0x7fdee40ae9d0 2023-08-25T04:43:45.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.054+0000 7fdee159a700 1 -- 172.21.15.16:0/1052493742 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400bd60 con 0x7fdee40ae9d0 2023-08-25T04:43:45.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.054+0000 7fdee8c21700 1 -- 172.21.15.16:0/1052493742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee40ae9d0 msgr2=0x7fdee4065fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:45.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.054+0000 7fdee8c21700 1 --2- 172.21.15.16:0/1052493742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee40ae9d0 0x7fdee4065fe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdee406b7d0 tx=0x7fded4009bd0 comp rx=0 tx=0).stop 2023-08-25T04:43:45.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.054+0000 7fdee8c21700 1 -- 172.21.15.16:0/1052493742 shutdown_connections 2023-08-25T04:43:45.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.054+0000 7fdee8c21700 1 --2- 172.21.15.16:0/1052493742 >> v2:172.21.15.117:3300/0 conn(0x7fdee406a340 0x7fdee406a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:45.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.054+0000 7fdee8c21700 1 --2- 172.21.15.16:0/1052493742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee415b360 0x7fdee40b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:45.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.054+0000 7fdee8c21700 1 --2- 172.21.15.16:0/1052493742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee40ae9d0 0x7fdee4065fe0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:45.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.054+0000 7fdee8c21700 1 -- 172.21.15.16:0/1052493742 >> 172.21.15.16:0/1052493742 conn(0x7fdee40b2440 msgr2=0x7fdee40b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:45.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.054+0000 7fdee8c21700 1 -- 172.21.15.16:0/1052493742 shutdown_connections 2023-08-25T04:43:45.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.054+0000 7fdee8c21700 1 -- 172.21.15.16:0/1052493742 wait complete. 2023-08-25T04:43:45.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.056+0000 7fdee8c21700 1 Processor -- start 2023-08-25T04:43:45.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.056+0000 7fdee8c21700 1 -- start start 2023-08-25T04:43:45.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.056+0000 7fdee8c21700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee406a340 0x7fdee41f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:45.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.056+0000 7fdee8c21700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdee40ae9d0 0x7fdee40ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:45.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.056+0000 7fdee8c21700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee415b360 0x7fdee40cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:45.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.056+0000 7fdee8c21700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee4157c40 con 0x7fdee415b360 2023-08-25T04:43:45.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.056+0000 7fdee8c21700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee415c650 con 0x7fdee40ae9d0 2023-08-25T04:43:45.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.056+0000 7fdee8c21700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee415bad0 con 0x7fdee406a340 2023-08-25T04:43:45.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.056+0000 7fdee2d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee415b360 0x7fdee40cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:45.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.056+0000 7fdee2d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee415b360 0x7fdee40cd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49038/0 (socket says 172.21.15.16:49038) 2023-08-25T04:43:45.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.056+0000 7fdee2d9d700 1 -- 172.21.15.16:0/974295444 learned_addr learned my addr 172.21.15.16:0/974295444 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:45.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.057+0000 7fdee1d9b700 1 --2- 172.21.15.16:0/974295444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdee40ae9d0 0x7fdee40ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:45.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.057+0000 7fdee259c700 1 --2- 172.21.15.16:0/974295444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee406a340 0x7fdee41f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:45.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.057+0000 7fdee2d9d700 1 -- 172.21.15.16:0/974295444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee406a340 msgr2=0x7fdee41f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:45.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.057+0000 7fdee2d9d700 1 --2- 172.21.15.16:0/974295444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee406a340 0x7fdee41f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:45.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.057+0000 7fdee2d9d700 1 -- 172.21.15.16:0/974295444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdee40ae9d0 msgr2=0x7fdee40ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:45.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.057+0000 7fdee2d9d700 1 --2- 172.21.15.16:0/974295444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdee40ae9d0 0x7fdee40ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:45.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.057+0000 7fdee2d9d700 1 -- 172.21.15.16:0/974295444 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded4009550 con 0x7fdee415b360 2023-08-25T04:43:45.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.057+0000 7fdee2d9d700 1 --2- 172.21.15.16:0/974295444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee415b360 0x7fdee40cd820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00cd10 tx=0x7fdedc00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:45.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.057+0000 7fded2ffd700 1 -- 172.21.15.16:0/974295444 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00ce60 con 0x7fdee415b360 2023-08-25T04:43:45.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.057+0000 7fded2ffd700 1 -- 172.21.15.16:0/974295444 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc00f480 con 0x7fdee415b360 2023-08-25T04:43:45.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.057+0000 7fdee8c21700 1 -- 172.21.15.16:0/974295444 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee415bdb0 con 0x7fdee415b360 2023-08-25T04:43:45.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.057+0000 7fded2ffd700 1 -- 172.21.15.16:0/974295444 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00f810 con 0x7fdee415b360 2023-08-25T04:43:45.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.057+0000 7fdee8c21700 1 -- 172.21.15.16:0/974295444 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee415c370 con 0x7fdee415b360 2023-08-25T04:43:45.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.058+0000 7fdee8c21700 1 -- 172.21.15.16:0/974295444 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee404ee70 con 0x7fdee415b360 2023-08-25T04:43:45.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.058+0000 7fded2ffd700 1 -- 172.21.15.16:0/974295444 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdedc00b040 con 0x7fdee415b360 2023-08-25T04:43:45.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.059+0000 7fded2ffd700 1 --2- 172.21.15.16:0/974295444 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fdec406a0e0 0x7fdec406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:45.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.059+0000 7fded2ffd700 1 -- 172.21.15.16:0/974295444 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdedc088c20 con 0x7fdee415b360 2023-08-25T04:43:45.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.059+0000 7fdee259c700 1 --2- 172.21.15.16:0/974295444 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fdec406a0e0 0x7fdec406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:45.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.059+0000 7fdee259c700 1 --2- 172.21.15.16:0/974295444 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fdec406a0e0 0x7fdec406c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdee40c9a00 tx=0x7fded8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:45.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.063+0000 7fded2ffd700 1 -- 172.21.15.16:0/974295444 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdedc054310 con 0x7fdee415b360 2023-08-25T04:43:45.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.308+0000 7fdee8c21700 1 -- 172.21.15.16:0/974295444 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdee40adb30 con 0x7fdee415b360 2023-08-25T04:43:45.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.905+0000 7fded2ffd700 1 -- 172.21.15.16:0/974295444 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdedc057930 con 0x7fdee415b360 2023-08-25T04:43:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.908+0000 7fdee8c21700 1 -- 172.21.15.16:0/974295444 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fdec406a0e0 msgr2=0x7fdec406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.908+0000 7fdee8c21700 1 --2- 172.21.15.16:0/974295444 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fdec406a0e0 0x7fdec406c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdee40c9a00 tx=0x7fded8008040 comp rx=0 tx=0).stop 2023-08-25T04:43:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.908+0000 7fdee8c21700 1 -- 172.21.15.16:0/974295444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee415b360 msgr2=0x7fdee40cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.908+0000 7fdee8c21700 1 --2- 172.21.15.16:0/974295444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee415b360 0x7fdee40cd820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00cd10 tx=0x7fdedc00a560 comp rx=0 tx=0).stop 2023-08-25T04:43:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.908+0000 7fdee8c21700 1 -- 172.21.15.16:0/974295444 shutdown_connections 2023-08-25T04:43:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.908+0000 7fdee8c21700 1 --2- 172.21.15.16:0/974295444 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fdec406a0e0 0x7fdec406c5a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.908+0000 7fdee8c21700 1 --2- 172.21.15.16:0/974295444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee415b360 0x7fdee40cd820 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.908+0000 7fdee8c21700 1 --2- 172.21.15.16:0/974295444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdee406a340 0x7fdee41f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.908+0000 7fdee8c21700 1 --2- 172.21.15.16:0/974295444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdee40ae9d0 0x7fdee40ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.908+0000 7fdee8c21700 1 -- 172.21.15.16:0/974295444 >> 172.21.15.16:0/974295444 conn(0x7fdee40b2440 msgr2=0x7fdee4065fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:45.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.908+0000 7fdee8c21700 1 -- 172.21.15.16:0/974295444 shutdown_connections 2023-08-25T04:43:45.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:45.908+0000 7fdee8c21700 1 -- 172.21.15.16:0/974295444 wait complete. 2023-08-25T04:43:45.925 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T04:43:45.926 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:43:46.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.060+0000 7f586f119700 1 Processor -- start 2023-08-25T04:43:46.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.061+0000 7f586f119700 1 -- start start 2023-08-25T04:43:46.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.061+0000 7f586f119700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f58681596e0 0x7f586806caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.061+0000 7f586f119700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5868159ac0 con 0x7f58680c9520 2023-08-25T04:43:46.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.061+0000 7f586f119700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58680cfb40 con 0x7f58680718e0 2023-08-25T04:43:46.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.061+0000 7f586f119700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5868070090 con 0x7f58681596e0 2023-08-25T04:43:46.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.061+0000 7f586d6b6700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f58680c9520 0x7f58680cc890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39456/0 (socket says 172.21.15.16:39456) 2023-08-25T04:43:46.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.061+0000 7f586d6b6700 1 -- 172.21.15.16:0/3661656433 learned_addr learned my addr 172.21.15.16:0/3661656433 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:46.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 -- 172.21.15.16:0/3661656433 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191223243 0 0) 0x7f5868159ac0 con 0x7f58680c9520 2023-08-25T04:43:46.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 -- 172.21.15.16:0/3661656433 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58580046c0 con 0x7f58680c9520 2023-08-25T04:43:46.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f586ceb5700 1 --2- 172.21.15.16:0/3661656433 >> v2:172.21.15.117:3300/0 conn(0x7f58681596e0 0x7f586806caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 -- 172.21.15.16:0/3661656433 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2523241028 0 0) 0x7f58580046c0 con 0x7f58680c9520 2023-08-25T04:43:46.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 -- 172.21.15.16:0/3661656433 >> v2:172.21.15.117:3300/0 conn(0x7f58681596e0 msgr2=0x7f586806caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:46.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 --2- 172.21.15.16:0/3661656433 >> v2:172.21.15.117:3300/0 conn(0x7f58681596e0 0x7f586806caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 -- 172.21.15.16:0/3661656433 >> v1:172.21.15.117:6789/0 conn(0x7f58680718e0 legacy=0x7f5868071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 -- 172.21.15.16:0/3661656433 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868070370 con 0x7f58680c9520 2023-08-25T04:43:46.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 -- 172.21.15.16:0/3661656433 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f58600019f0 con 0x7f58680c9520 2023-08-25T04:43:46.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 -- 172.21.15.16:0/3661656433 >> v1:172.21.15.16:6789/0 conn(0x7f58680c9520 legacy=0x7f58680cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 --2- 172.21.15.16:0/3661656433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5858004b80 0x7f5858004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 --2- 172.21.15.16:0/3661656433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5858005960 0x7f5858005de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 --2- 172.21.15.16:0/3661656433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5858006320 0x7f585800cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 -- 172.21.15.16:0/3661656433 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5868070090 con 0x7f5858006320 2023-08-25T04:43:46.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 -- 172.21.15.16:0/3661656433 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585800d250 con 0x7f5858004b80 2023-08-25T04:43:46.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f58677fe700 1 -- 172.21.15.16:0/3661656433 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585800d410 con 0x7f5858005960 2023-08-25T04:43:46.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f586d6b6700 1 --2- 172.21.15.16:0/3661656433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5858006320 0x7f585800cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f586ceb5700 1 --2- 172.21.15.16:0/3661656433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5858004b80 0x7f5858004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.062+0000 7f5867fff700 1 --2- 172.21.15.16:0/3661656433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5858005960 0x7f5858005de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f586d6b6700 1 -- 172.21.15.16:0/3661656433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5858005960 msgr2=0x7f5858005de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:46.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f586d6b6700 1 --2- 172.21.15.16:0/3661656433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5858005960 0x7f5858005de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f586d6b6700 1 -- 172.21.15.16:0/3661656433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5858004b80 msgr2=0x7f5858004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:46.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f586d6b6700 1 --2- 172.21.15.16:0/3661656433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5858004b80 0x7f5858004fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f586d6b6700 1 -- 172.21.15.16:0/3661656433 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58580046c0 con 0x7f5858006320 2023-08-25T04:43:46.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f586d6b6700 1 -- 172.21.15.16:0/3661656433 reap_dead start 2023-08-25T04:43:46.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f586d6b6700 1 --2- 172.21.15.16:0/3661656433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5858006320 0x7f585800cb20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f586000a830 tx=0x7f5858006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe5024d0863d977 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:46.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f58677fe700 1 -- 172.21.15.16:0/3661656433 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000a2f0 con 0x7f5858006320 2023-08-25T04:43:46.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f58677fe700 1 -- 172.21.15.16:0/3661656433 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5860012600 con 0x7f5858006320 2023-08-25T04:43:46.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f58677fe700 1 -- 172.21.15.16:0/3661656433 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58600129b0 con 0x7f5858006320 2023-08-25T04:43:46.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f586f119700 1 -- 172.21.15.16:0/3661656433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5858006320 msgr2=0x7f585800cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f586f119700 1 --2- 172.21.15.16:0/3661656433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5858006320 0x7f585800cb20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f586000a830 tx=0x7f5858006990 comp rx=0 tx=0).stop 2023-08-25T04:43:46.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f586f119700 1 -- 172.21.15.16:0/3661656433 shutdown_connections 2023-08-25T04:43:46.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f586f119700 1 --2- 172.21.15.16:0/3661656433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5858006320 0x7f585800cb20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f586f119700 1 -- 172.21.15.16:0/3661656433 >> 172.21.15.16:0/3661656433 conn(0x7f58680cecc0 msgr2=0x7f58680cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:46.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f586f119700 1 -- 172.21.15.16:0/3661656433 shutdown_connections 2023-08-25T04:43:46.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.063+0000 7f586f119700 1 -- 172.21.15.16:0/3661656433 wait complete. 2023-08-25T04:43:46.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.065+0000 7f586f119700 1 Processor -- start 2023-08-25T04:43:46.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.065+0000 7f586f119700 1 -- start start 2023-08-25T04:43:46.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586f119700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5858006320 0x7f58680c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586f119700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58680c5630 0x7f5868157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586f119700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5868157950 0x7f58680c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586f119700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58680b4080 con 0x7f5868157950 2023-08-25T04:43:46.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586f119700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58681edf20 con 0x7f5858006320 2023-08-25T04:43:46.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586f119700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58680b3470 con 0x7f58680c5630 2023-08-25T04:43:46.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586d6b6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5868157950 0x7f58680c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586d6b6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5868157950 0x7f58680c2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49056/0 (socket says 172.21.15.16:49056) 2023-08-25T04:43:46.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586d6b6700 1 -- 172.21.15.16:0/1722410337 learned_addr learned my addr 172.21.15.16:0/1722410337 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:46.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586d6b6700 1 -- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58680c5630 msgr2=0x7f5868157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586ceb5700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5858006320 0x7f58680c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f5867fff700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58680c5630 0x7f5868157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586d6b6700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58680c5630 0x7f5868157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586d6b6700 1 -- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5858006320 msgr2=0x7f58680c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586d6b6700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5858006320 0x7f58680c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586d6b6700 1 -- 172.21.15.16:0/1722410337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58680b3750 con 0x7f5868157950 2023-08-25T04:43:46.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.066+0000 7f586ceb5700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5858006320 0x7f58680c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:46.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.067+0000 7f586d6b6700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5868157950 0x7f58680c2980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5868071d60 tx=0x7f5860001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:46.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.067+0000 7f58657fa700 1 -- 172.21.15.16:0/1722410337 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58600019b0 con 0x7f5868157950 2023-08-25T04:43:46.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.067+0000 7f58657fa700 1 -- 172.21.15.16:0/1722410337 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586001d420 con 0x7f5868157950 2023-08-25T04:43:46.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.067+0000 7f58657fa700 1 -- 172.21.15.16:0/1722410337 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586001d7d0 con 0x7f5868157950 2023-08-25T04:43:46.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.067+0000 7f586f119700 1 -- 172.21.15.16:0/1722410337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58680b3a30 con 0x7f5868157950 2023-08-25T04:43:46.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.067+0000 7f586f119700 1 -- 172.21.15.16:0/1722410337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5868158360 con 0x7f5868157950 2023-08-25T04:43:46.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.068+0000 7f586f119700 1 -- 172.21.15.16:0/1722410337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586804ee70 con 0x7f5868157950 2023-08-25T04:43:46.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.068+0000 7f58657fa700 1 -- 172.21.15.16:0/1722410337 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f586001d930 con 0x7f5868157950 2023-08-25T04:43:46.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.068+0000 7f58657fa700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f584c06a0e0 0x7f584c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.068+0000 7f58657fa700 1 -- 172.21.15.16:0/1722410337 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58600899d0 con 0x7f5868157950 2023-08-25T04:43:46.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.069+0000 7f586ceb5700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f584c06a0e0 0x7f584c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.069+0000 7f586ceb5700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f584c06a0e0 0x7f584c06c5a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f585c009ae0 tx=0x7f585c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:46.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.073+0000 7f58657fa700 1 -- 172.21.15.16:0/1722410337 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5860055270 con 0x7f5868157950 2023-08-25T04:43:46.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.319+0000 7f586f119700 1 -- 172.21.15.16:0/1722410337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58680b4c40 con 0x7f5868157950 2023-08-25T04:43:46.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.319+0000 7f58657fa700 1 -- 172.21.15.16:0/1722410337 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4863 (secure 0 0 0) 0x7f5860026090 con 0x7f5868157950 2023-08-25T04:43:46.321 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:46.321 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/397913125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":397913125},{"type":"v1","addr":"172.21.15.16:6834","nonce":397913125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1401503507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1401503507},{"type":"v1","addr":"172.21.15.117:6835","nonce":1401503507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/899398848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":899398848},{"type":"v1","addr":"172.21.15.16:6835","nonce":899398848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:43:42.297594+0000","modified":"2023-08-25T04:43:45.899399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/36836471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":36836471},{"type":"v1","addr":"172.21.15.117:6837","nonce":36836471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:43:46.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.321+0000 7f586f119700 1 -- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f584c06a0e0 msgr2=0x7f584c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.321+0000 7f586f119700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f584c06a0e0 0x7f584c06c5a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f585c009ae0 tx=0x7f585c008040 comp rx=0 tx=0).stop 2023-08-25T04:43:46.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.321+0000 7f586f119700 1 -- 172.21.15.16:0/1722410337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5868157950 msgr2=0x7f58680c2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.321+0000 7f586f119700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5868157950 0x7f58680c2980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5868071d60 tx=0x7f5860001d80 comp rx=0 tx=0).stop 2023-08-25T04:43:46.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.322+0000 7f586f119700 1 -- 172.21.15.16:0/1722410337 shutdown_connections 2023-08-25T04:43:46.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.322+0000 7f586f119700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f584c06a0e0 0x7f584c06c5a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.322+0000 7f586f119700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5868157950 0x7f58680c2980 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.322+0000 7f586f119700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5858006320 0x7f58680c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.322+0000 7f586f119700 1 --2- 172.21.15.16:0/1722410337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58680c5630 0x7f5868157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.322+0000 7f586f119700 1 -- 172.21.15.16:0/1722410337 >> 172.21.15.16:0/1722410337 conn(0x7f58680cecc0 msgr2=0x7f58681550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:46.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.322+0000 7f586f119700 1 -- 172.21.15.16:0/1722410337 shutdown_connections 2023-08-25T04:43:46.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.322+0000 7f586f119700 1 -- 172.21.15.16:0/1722410337 wait complete. 2023-08-25T04:43:46.325 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2023-08-25T04:43:46.335 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:43:46.461 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.460+0000 7f720c1da700 1 Processor -- start 2023-08-25T04:43:46.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.460+0000 7f720c1da700 1 -- start start 2023-08-25T04:43:46.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.461+0000 7f720c1da700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72040cf970 0x7f720406a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.461+0000 7f720c1da700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f720415d320 0x7f720406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.461+0000 7f720c1da700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72040ac850 con 0x7f720415cf40 2023-08-25T04:43:46.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.461+0000 7f720c1da700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72040ce240 con 0x7f720415d320 2023-08-25T04:43:46.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.461+0000 7f720c1da700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7204071a60 con 0x7f72040cf970 2023-08-25T04:43:46.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.461+0000 7f720a777700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f720415d320 0x7f720406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.461+0000 7f720a777700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f720415d320 0x7f720406a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49064/0 (socket says 172.21.15.16:49064) 2023-08-25T04:43:46.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.461+0000 7f720a777700 1 -- 172.21.15.16:0/3822074939 learned_addr learned my addr 172.21.15.16:0/3822074939 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:46.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.461+0000 7f7209775700 1 --2- 172.21.15.16:0/3822074939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72040cf970 0x7f720406a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.461+0000 7f720a777700 1 -- 172.21.15.16:0/3822074939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72040cf970 msgr2=0x7f720406a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:46.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.461+0000 7f720a777700 1 --2- 172.21.15.16:0/3822074939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72040cf970 0x7f720406a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.461+0000 7f720a777700 1 -- 172.21.15.16:0/3822074939 >> v1:172.21.15.117:6789/0 conn(0x7f720415cf40 legacy=0x7f72040cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.462+0000 7f720a777700 1 -- 172.21.15.16:0/3822074939 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7204071d40 con 0x7f720415d320 2023-08-25T04:43:46.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.462+0000 7f720a777700 1 --2- 172.21.15.16:0/3822074939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f720415d320 0x7f720406a880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009e50 tx=0x7f71fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1813ff8931bfe4f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:46.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.462+0000 7f7208f74700 1 -- 172.21.15.16:0/3822074939 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc00e070 con 0x7f720415d320 2023-08-25T04:43:46.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.462+0000 7f7208f74700 1 -- 172.21.15.16:0/3822074939 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc00b910 con 0x7f720415d320 2023-08-25T04:43:46.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.462+0000 7f7208f74700 1 -- 172.21.15.16:0/3822074939 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc00bcc0 con 0x7f720415d320 2023-08-25T04:43:46.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.462+0000 7f720c1da700 1 -- 172.21.15.16:0/3822074939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f720415d320 msgr2=0x7f720406a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.462+0000 7f720c1da700 1 --2- 172.21.15.16:0/3822074939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f720415d320 0x7f720406a880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009e50 tx=0x7f71fc00b330 comp rx=0 tx=0).stop 2023-08-25T04:43:46.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.462+0000 7f720c1da700 1 -- 172.21.15.16:0/3822074939 shutdown_connections 2023-08-25T04:43:46.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.462+0000 7f720c1da700 1 --2- 172.21.15.16:0/3822074939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f720415d320 0x7f720406a880 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.462+0000 7f720c1da700 1 --2- 172.21.15.16:0/3822074939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72040cf970 0x7f720406a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.462+0000 7f720c1da700 1 -- 172.21.15.16:0/3822074939 >> 172.21.15.16:0/3822074939 conn(0x7f72040b1a10 msgr2=0x7f72040b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:46.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.462+0000 7f720c1da700 1 -- 172.21.15.16:0/3822074939 shutdown_connections 2023-08-25T04:43:46.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.462+0000 7f720c1da700 1 -- 172.21.15.16:0/3822074939 wait complete. 2023-08-25T04:43:46.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.464+0000 7f720c1da700 1 Processor -- start 2023-08-25T04:43:46.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.464+0000 7f720c1da700 1 -- start start 2023-08-25T04:43:46.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720c1da700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72040cf970 0x7f7204157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720c1da700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720415cf40 0x7f72041559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720c1da700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f720415d320 0x7f7204155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720c1da700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7204157d00 con 0x7f720415d320 2023-08-25T04:43:46.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720c1da700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7204157fe0 con 0x7f720415cf40 2023-08-25T04:43:46.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720c1da700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72041582c0 con 0x7f72040cf970 2023-08-25T04:43:46.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720a777700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f720415d320 0x7f7204155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720a777700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f720415d320 0x7f7204155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49070/0 (socket says 172.21.15.16:49070) 2023-08-25T04:43:46.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720a777700 1 -- 172.21.15.16:0/1437510753 learned_addr learned my addr 172.21.15.16:0/1437510753 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:46.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f7209775700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720415cf40 0x7f72041559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f7209f76700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72040cf970 0x7f7204157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720a777700 1 -- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72040cf970 msgr2=0x7f7204157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720a777700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72040cf970 0x7f7204157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720a777700 1 -- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720415cf40 msgr2=0x7f72041559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720a777700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720415cf40 0x7f72041559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720a777700 1 -- 172.21.15.16:0/1437510753 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc009b30 con 0x7f720415d320 2023-08-25T04:43:46.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f7209775700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720415cf40 0x7f72041559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:46.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f7209f76700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72040cf970 0x7f7204157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:46.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720a777700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f720415d320 0x7f7204155f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71fc012000 tx=0x7f71fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:46.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f71fa7fc700 1 -- 172.21.15.16:0/1437510753 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc004960 con 0x7f720415d320 2023-08-25T04:43:46.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f71fa7fc700 1 -- 172.21.15.16:0/1437510753 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc0099b0 con 0x7f720415d320 2023-08-25T04:43:46.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720c1da700 1 -- 172.21.15.16:0/1437510753 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72041585a0 con 0x7f720415d320 2023-08-25T04:43:46.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f71fa7fc700 1 -- 172.21.15.16:0/1437510753 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc01c680 con 0x7f720415d320 2023-08-25T04:43:46.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.465+0000 7f720c1da700 1 -- 172.21.15.16:0/1437510753 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7204156470 con 0x7f720415d320 2023-08-25T04:43:46.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.466+0000 7f720c1da700 1 -- 172.21.15.16:0/1437510753 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7204158a60 con 0x7f720415d320 2023-08-25T04:43:46.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.467+0000 7f71fa7fc700 1 -- 172.21.15.16:0/1437510753 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f71fc01c7e0 con 0x7f720415d320 2023-08-25T04:43:46.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.467+0000 7f71fa7fc700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f71e806a110 0x7f71e806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.467+0000 7f71fa7fc700 1 -- 172.21.15.16:0/1437510753 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f71fc089ee0 con 0x7f720415d320 2023-08-25T04:43:46.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.467+0000 7f7209f76700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f71e806a110 0x7f71e806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.468+0000 7f7209f76700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f71e806a110 0x7f71e806c5d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f71f4000f60 tx=0x7f71f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:46.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.472+0000 7f71fa7fc700 1 -- 172.21.15.16:0/1437510753 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f71fc0555c0 con 0x7f720415d320 2023-08-25T04:43:46.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.675+0000 7f720c1da700 1 -- 172.21.15.16:0/1437510753 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f720404ee70 con 0x7f720415d320 2023-08-25T04:43:46.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.676+0000 7f71fa7fc700 1 -- 172.21.15.16:0/1437510753 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18233 (secure 0 0 0) 0x7f71fc058be0 con 0x7f720415d320 2023-08-25T04:43:46.678 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:46.678 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:43:43.870075+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:43:40.197381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:43:41.268759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:43:46.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.678+0000 7f720c1da700 1 -- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f71e806a110 msgr2=0x7f71e806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.678+0000 7f720c1da700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f71e806a110 0x7f71e806c5d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f71f4000f60 tx=0x7f71f4009040 comp rx=0 tx=0).stop 2023-08-25T04:43:46.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.678+0000 7f720c1da700 1 -- 172.21.15.16:0/1437510753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f720415d320 msgr2=0x7f7204155f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.678+0000 7f720c1da700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f720415d320 0x7f7204155f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71fc012000 tx=0x7f71fc004ad0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.678+0000 7f720c1da700 1 -- 172.21.15.16:0/1437510753 shutdown_connections 2023-08-25T04:43:46.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.678+0000 7f720c1da700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f71e806a110 0x7f71e806c5d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.678+0000 7f720c1da700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f720415d320 0x7f7204155f30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.678+0000 7f720c1da700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72040cf970 0x7f7204157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.678+0000 7f720c1da700 1 --2- 172.21.15.16:0/1437510753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720415cf40 0x7f72041559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.678+0000 7f720c1da700 1 -- 172.21.15.16:0/1437510753 >> 172.21.15.16:0/1437510753 conn(0x7f72040b1a10 msgr2=0x7f72040b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:46.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.678+0000 7f720c1da700 1 -- 172.21.15.16:0/1437510753 shutdown_connections 2023-08-25T04:43:46.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.678+0000 7f720c1da700 1 -- 172.21.15.16:0/1437510753 wait complete. 2023-08-25T04:43:46.692 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T04:43:46.693 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:43:46.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.816+0000 7f12b5fad700 1 Processor -- start 2023-08-25T04:43:46.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.816+0000 7f12b5fad700 1 -- start start 2023-08-25T04:43:46.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.817+0000 7f12b5fad700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12b015cf40 0x7f12b00cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.817+0000 7f12b5fad700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b00ac850 con 0x7f12b006aa50 2023-08-25T04:43:46.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.817+0000 7f12b5fad700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b00ce240 con 0x7f12b00cf970 2023-08-25T04:43:46.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.817+0000 7f12b5fad700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b0071a60 con 0x7f12b015cf40 2023-08-25T04:43:46.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.817+0000 7f12af7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12b015cf40 0x7f12b00cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.817+0000 7f12affff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f12b006aa50 0x7f12b00acce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39492/0 (socket says 172.21.15.16:39492) 2023-08-25T04:43:46.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.817+0000 7f12affff700 1 -- 172.21.15.16:0/3273391475 learned_addr learned my addr 172.21.15.16:0/3273391475 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:46.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.818+0000 7f12af7fe700 1 -- 172.21.15.16:0/3273391475 >> v1:172.21.15.117:6789/0 conn(0x7f12b00cf970 legacy=0x7f12b006a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:46.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.818+0000 7f12af7fe700 1 -- 172.21.15.16:0/3273391475 >> v1:172.21.15.16:6789/0 conn(0x7f12b006aa50 legacy=0x7f12b00acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.818+0000 7f12af7fe700 1 -- 172.21.15.16:0/3273391475 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b0071d40 con 0x7f12b015cf40 2023-08-25T04:43:46.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.818+0000 7f12af7fe700 1 --2- 172.21.15.16:0/3273391475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b015cf40 0x7f12b00cda10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009840 tx=0x7f12a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5984cf77d68fc31c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:46.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.818+0000 7f12ae7fc700 1 -- 172.21.15.16:0/3273391475 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a0004230 con 0x7f12b015cf40 2023-08-25T04:43:46.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.818+0000 7f12ae7fc700 1 -- 172.21.15.16:0/3273391475 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a0004390 con 0x7f12b015cf40 2023-08-25T04:43:46.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.818+0000 7f12ae7fc700 1 -- 172.21.15.16:0/3273391475 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a00036a0 con 0x7f12b015cf40 2023-08-25T04:43:46.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.818+0000 7f12b5fad700 1 -- 172.21.15.16:0/3273391475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b015cf40 msgr2=0x7f12b00cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.818+0000 7f12b5fad700 1 --2- 172.21.15.16:0/3273391475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b015cf40 0x7f12b00cda10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009840 tx=0x7f12a0009b50 comp rx=0 tx=0).stop 2023-08-25T04:43:46.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.818+0000 7f12b5fad700 1 -- 172.21.15.16:0/3273391475 shutdown_connections 2023-08-25T04:43:46.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.818+0000 7f12b5fad700 1 --2- 172.21.15.16:0/3273391475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b015cf40 0x7f12b00cda10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.819+0000 7f12b5fad700 1 -- 172.21.15.16:0/3273391475 >> 172.21.15.16:0/3273391475 conn(0x7f12b00b1a10 msgr2=0x7f12b00b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:46.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.819+0000 7f12b5fad700 1 -- 172.21.15.16:0/3273391475 shutdown_connections 2023-08-25T04:43:46.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.819+0000 7f12b5fad700 1 -- 172.21.15.16:0/3273391475 wait complete. 2023-08-25T04:43:46.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.820+0000 7f12b5fad700 1 Processor -- start 2023-08-25T04:43:46.827 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.820+0000 7f12b5fad700 1 -- start start 2023-08-25T04:43:46.827 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12b5fad700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12b006aa50 0x7f12b006d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.827 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12b5fad700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b00cf970 0x7f12b0146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.827 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12b5fad700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12b015cf40 0x7f12b0146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.827 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12b5fad700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b014a360 con 0x7f12b00cf970 2023-08-25T04:43:46.827 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12b5fad700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b01470a0 con 0x7f12b015cf40 2023-08-25T04:43:46.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12b5fad700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b0147ad0 con 0x7f12b006aa50 2023-08-25T04:43:46.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12aeffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b00cf970 0x7f12b0146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12aeffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b00cf970 0x7f12b0146620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49082/0 (socket says 172.21.15.16:49082) 2023-08-25T04:43:46.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12aeffd700 1 -- 172.21.15.16:0/3069474168 learned_addr learned my addr 172.21.15.16:0/3069474168 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:46.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12af7fe700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12b006aa50 0x7f12b006d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12affff700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12b015cf40 0x7f12b0146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12aeffd700 1 -- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12b006aa50 msgr2=0x7f12b006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12aeffd700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12b006aa50 0x7f12b006d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12aeffd700 1 -- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12b015cf40 msgr2=0x7f12b0146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12aeffd700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12b015cf40 0x7f12b0146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12aeffd700 1 -- 172.21.15.16:0/3069474168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a00094a0 con 0x7f12b00cf970 2023-08-25T04:43:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12affff700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12b015cf40 0x7f12b0146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12aeffd700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b00cf970 0x7f12b0146620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f129800c4a0 tx=0x7f129800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12a7fff700 1 -- 172.21.15.16:0/3069474168 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298011790 con 0x7f12b00cf970 2023-08-25T04:43:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12a7fff700 1 -- 172.21.15.16:0/3069474168 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12980118f0 con 0x7f12b00cf970 2023-08-25T04:43:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12b5fad700 1 -- 172.21.15.16:0/3069474168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b014a080 con 0x7f12b00cf970 2023-08-25T04:43:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12a7fff700 1 -- 172.21.15.16:0/3069474168 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298011ca0 con 0x7f12b00cf970 2023-08-25T04:43:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.821+0000 7f12b5fad700 1 -- 172.21.15.16:0/3069474168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b0147760 con 0x7f12b00cf970 2023-08-25T04:43:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.822+0000 7f12b5fad700 1 -- 172.21.15.16:0/3069474168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b004ee70 con 0x7f12b00cf970 2023-08-25T04:43:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.823+0000 7f12a7fff700 1 -- 172.21.15.16:0/3069474168 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f129801c460 con 0x7f12b00cf970 2023-08-25T04:43:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.823+0000 7f12a7fff700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f129006a0e0 0x7f129006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.823+0000 7f12a7fff700 1 -- 172.21.15.16:0/3069474168 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1298088350 con 0x7f12b00cf970 2023-08-25T04:43:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.823+0000 7f12af7fe700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f129006a0e0 0x7f129006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.824+0000 7f12af7fe700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f129006a0e0 0x7f129006c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f12b01f64d0 tx=0x7f12a0013040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:46.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:46.828+0000 7f12a7fff700 1 -- 172.21.15.16:0/3069474168 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1298053a40 con 0x7f12b00cf970 2023-08-25T04:43:47.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.024+0000 7f12b5fad700 1 -- 172.21.15.16:0/3069474168 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12b00cdf50 con 0x7f129006a0e0 2023-08-25T04:43:47.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.033+0000 7f12a7fff700 1 -- 172.21.15.16:0/3069474168 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287034 (secure 0 0 0) 0x7f12a00040b0 con 0x7f129006a0e0 2023-08-25T04:43:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:47.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.036+0000 7f12b5fad700 1 -- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f129006a0e0 msgr2=0x7f129006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:47.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.036+0000 7f12b5fad700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f129006a0e0 0x7f129006c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f12b01f64d0 tx=0x7f12a0013040 comp rx=0 tx=0).stop 2023-08-25T04:43:47.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.036+0000 7f12b5fad700 1 -- 172.21.15.16:0/3069474168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b00cf970 msgr2=0x7f12b0146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:47.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.036+0000 7f12b5fad700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b00cf970 0x7f12b0146620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f129800c4a0 tx=0x7f129800c860 comp rx=0 tx=0).stop 2023-08-25T04:43:47.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.036+0000 7f12b5fad700 1 -- 172.21.15.16:0/3069474168 shutdown_connections 2023-08-25T04:43:47.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.036+0000 7f12b5fad700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f129006a0e0 0x7f129006c5a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.036+0000 7f12b5fad700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12b015cf40 0x7f12b0146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.036+0000 7f12b5fad700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12b006aa50 0x7f12b006d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.036+0000 7f12b5fad700 1 --2- 172.21.15.16:0/3069474168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b00cf970 0x7f12b0146620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.036+0000 7f12b5fad700 1 -- 172.21.15.16:0/3069474168 >> 172.21.15.16:0/3069474168 conn(0x7f12b00b1a10 msgr2=0x7f12b00b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:47.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.036+0000 7f12b5fad700 1 -- 172.21.15.16:0/3069474168 shutdown_connections 2023-08-25T04:43:47.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.036+0000 7f12b5fad700 1 -- 172.21.15.16:0/3069474168 wait complete. 2023-08-25T04:43:47.041 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-08-25T04:43:47.050 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-08-25T04:43:45.306238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219076,"kb_used_data":2868,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755644,"statfs":{"total":773094113280,"available":772869779456,"internally_reserved":0,"allocated":2936832,"data_stored":1790775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.442033"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327803+0000","last_change":"2023-08-25T04:43:42.895145+0000","last_active":"2023-08-25T04:43:44.327803+0000","last_peered":"2023-08-25T04:43:44.327803+0000","last_clean":"2023-08-25T04:43:44.327803+0000","last_became_active":"2023-08-25T04:43:42.894831+0000","last_became_peered":"2023-08-25T04:43:42.894831+0000","last_unstale":"2023-08-25T04:43:44.327803+0000","last_undegraded":"2023-08-25T04:43:44.327803+0000","last_fullsized":"2023-08-25T04:43:44.327803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:14:14.705163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874604+0000","last_change":"2023-08-25T04:43:42.895503+0000","last_active":"2023-08-25T04:43:43.874604+0000","last_peered":"2023-08-25T04:43:43.874604+0000","last_clean":"2023-08-25T04:43:43.874604+0000","last_became_active":"2023-08-25T04:43:42.895245+0000","last_became_peered":"2023-08-25T04:43:42.895245+0000","last_unstale":"2023-08-25T04:43:43.874604+0000","last_undegraded":"2023-08-25T04:43:43.874604+0000","last_fullsized":"2023-08-25T04:43:43.874604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:15.216169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327984+0000","last_change":"2023-08-25T04:43:42.888920+0000","last_active":"2023-08-25T04:43:44.327984+0000","last_peered":"2023-08-25T04:43:44.327984+0000","last_clean":"2023-08-25T04:43:44.327984+0000","last_became_active":"2023-08-25T04:43:42.888568+0000","last_became_peered":"2023-08-25T04:43:42.888568+0000","last_unstale":"2023-08-25T04:43:44.327984+0000","last_undegraded":"2023-08-25T04:43:44.327984+0000","last_fullsized":"2023-08-25T04:43:44.327984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:16.589145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328061+0000","last_change":"2023-08-25T04:43:42.893868+0000","last_active":"2023-08-25T04:43:44.328061+0000","last_peered":"2023-08-25T04:43:44.328061+0000","last_clean":"2023-08-25T04:43:44.328061+0000","last_became_active":"2023-08-25T04:43:42.893534+0000","last_became_peered":"2023-08-25T04:43:42.893534+0000","last_unstale":"2023-08-25T04:43:44.328061+0000","last_undegraded":"2023-08-25T04:43:44.328061+0000","last_fullsized":"2023-08-25T04:43:44.328061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:31.303608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328282+0000","last_change":"2023-08-25T04:43:42.902297+0000","last_active":"2023-08-25T04:43:44.328282+0000","last_peered":"2023-08-25T04:43:44.328282+0000","last_clean":"2023-08-25T04:43:44.328282+0000","last_became_active":"2023-08-25T04:43:42.901963+0000","last_became_peered":"2023-08-25T04:43:42.901963+0000","last_unstale":"2023-08-25T04:43:44.328282+0000","last_undegraded":"2023-08-25T04:43:44.328282+0000","last_fullsized":"2023-08-25T04:43:44.328282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328304+0000","last_change":"2023-08-25T04:43:42.888877+0000","last_active":"2023-08-25T04:43:44.328304+0000","last_peered":"2023-08-25T04:43:44.328304+0000","last_clean":"2023-08-25T04:43:44.328304+0000","last_became_active":"2023-08-25T04:43:42.888567+0000","last_became_peered":"2023-08-25T04:43:42.888567+0000","last_unstale":"2023-08-25T04:43:44.328304+0000","last_undegraded":"2023-08-25T04:43:44.328304+0000","last_fullsized":"2023-08-25T04:43:44.328304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:32:00.413218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032871+0000","last_change":"2023-08-25T04:43:42.902469+0000","last_active":"2023-08-25T04:43:44.032871+0000","last_peered":"2023-08-25T04:43:44.032871+0000","last_clean":"2023-08-25T04:43:44.032871+0000","last_became_active":"2023-08-25T04:43:42.902156+0000","last_became_peered":"2023-08-25T04:43:42.902156+0000","last_unstale":"2023-08-25T04:43:44.032871+0000","last_undegraded":"2023-08-25T04:43:44.032871+0000","last_fullsized":"2023-08-25T04:43:44.032871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874207+0000","last_change":"2023-08-25T04:43:42.895697+0000","last_active":"2023-08-25T04:43:43.874207+0000","last_peered":"2023-08-25T04:43:43.874207+0000","last_clean":"2023-08-25T04:43:43.874207+0000","last_became_active":"2023-08-25T04:43:42.895410+0000","last_became_peered":"2023-08-25T04:43:42.895410+0000","last_unstale":"2023-08-25T04:43:43.874207+0000","last_undegraded":"2023-08-25T04:43:43.874207+0000","last_fullsized":"2023-08-25T04:43:43.874207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:31.303608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327641+0000","last_change":"2023-08-25T04:43:42.897483+0000","last_active":"2023-08-25T04:43:44.327641+0000","last_peered":"2023-08-25T04:43:44.327641+0000","last_clean":"2023-08-25T04:43:44.327641+0000","last_became_active":"2023-08-25T04:43:42.896949+0000","last_became_peered":"2023-08-25T04:43:42.896949+0000","last_unstale":"2023-08-25T04:43:44.327641+0000","last_undegraded":"2023-08-25T04:43:44.327641+0000","last_fullsized":"2023-08-25T04:43:44.327641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:31:35.265544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874624+0000","last_change":"2023-08-25T04:43:42.895115+0000","last_active":"2023-08-25T04:43:43.874624+0000","last_peered":"2023-08-25T04:43:43.874624+0000","last_clean":"2023-08-25T04:43:43.874624+0000","last_became_active":"2023-08-25T04:43:42.894786+0000","last_became_peered":"2023-08-25T04:43:42.894786+0000","last_unstale":"2023-08-25T04:43:43.874624+0000","last_undegraded":"2023-08-25T04:43:43.874624+0000","last_fullsized":"2023-08-25T04:43:43.874624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:25.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328212+0000","last_change":"2023-08-25T04:43:42.892793+0000","last_active":"2023-08-25T04:43:44.328212+0000","last_peered":"2023-08-25T04:43:44.328212+0000","last_clean":"2023-08-25T04:43:44.328212+0000","last_became_active":"2023-08-25T04:43:42.892558+0000","last_became_peered":"2023-08-25T04:43:42.892558+0000","last_unstale":"2023-08-25T04:43:44.328212+0000","last_undegraded":"2023-08-25T04:43:44.328212+0000","last_fullsized":"2023-08-25T04:43:44.328212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:03.096619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327734+0000","last_change":"2023-08-25T04:43:42.892113+0000","last_active":"2023-08-25T04:43:44.327734+0000","last_peered":"2023-08-25T04:43:44.327734+0000","last_clean":"2023-08-25T04:43:44.327734+0000","last_became_active":"2023-08-25T04:43:42.891782+0000","last_became_peered":"2023-08-25T04:43:42.891782+0000","last_unstale":"2023-08-25T04:43:44.327734+0000","last_undegraded":"2023-08-25T04:43:44.327734+0000","last_fullsized":"2023-08-25T04:43:44.327734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:24:49.974531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327765+0000","last_change":"2023-08-25T04:43:42.896635+0000","last_active":"2023-08-25T04:43:44.327765+0000","last_peered":"2023-08-25T04:43:44.327765+0000","last_clean":"2023-08-25T04:43:44.327765+0000","last_became_active":"2023-08-25T04:43:42.896334+0000","last_became_peered":"2023-08-25T04:43:42.896334+0000","last_unstale":"2023-08-25T04:43:44.327765+0000","last_undegraded":"2023-08-25T04:43:44.327765+0000","last_fullsized":"2023-08-25T04:43:44.327765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:56:24.754587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874371+0000","last_change":"2023-08-25T04:43:42.894765+0000","last_active":"2023-08-25T04:43:43.874371+0000","last_peered":"2023-08-25T04:43:43.874371+0000","last_clean":"2023-08-25T04:43:43.874371+0000","last_became_active":"2023-08-25T04:43:42.894472+0000","last_became_peered":"2023-08-25T04:43:42.894472+0000","last_unstale":"2023-08-25T04:43:43.874371+0000","last_undegraded":"2023-08-25T04:43:43.874371+0000","last_fullsized":"2023-08-25T04:43:43.874371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:10.669970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033055+0000","last_change":"2023-08-25T04:43:42.902458+0000","last_active":"2023-08-25T04:43:44.033055+0000","last_peered":"2023-08-25T04:43:44.033055+0000","last_clean":"2023-08-25T04:43:44.033055+0000","last_became_active":"2023-08-25T04:43:42.902184+0000","last_became_peered":"2023-08-25T04:43:42.902184+0000","last_unstale":"2023-08-25T04:43:44.033055+0000","last_undegraded":"2023-08-25T04:43:44.033055+0000","last_fullsized":"2023-08-25T04:43:44.033055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:14.283818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327581+0000","last_change":"2023-08-25T04:43:42.889087+0000","last_active":"2023-08-25T04:43:44.327581+0000","last_peered":"2023-08-25T04:43:44.327581+0000","last_clean":"2023-08-25T04:43:44.327581+0000","last_became_active":"2023-08-25T04:43:42.888730+0000","last_became_peered":"2023-08-25T04:43:42.888730+0000","last_unstale":"2023-08-25T04:43:44.327581+0000","last_undegraded":"2023-08-25T04:43:44.327581+0000","last_fullsized":"2023-08-25T04:43:44.327581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327697+0000","last_change":"2023-08-25T04:43:42.898466+0000","last_active":"2023-08-25T04:43:44.327697+0000","last_peered":"2023-08-25T04:43:44.327697+0000","last_clean":"2023-08-25T04:43:44.327697+0000","last_became_active":"2023-08-25T04:43:42.898103+0000","last_became_peered":"2023-08-25T04:43:42.898103+0000","last_unstale":"2023-08-25T04:43:44.327697+0000","last_undegraded":"2023-08-25T04:43:44.327697+0000","last_fullsized":"2023-08-25T04:43:44.327697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.713590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328356+0000","last_change":"2023-08-25T04:43:42.892153+0000","last_active":"2023-08-25T04:43:44.328356+0000","last_peered":"2023-08-25T04:43:44.328356+0000","last_clean":"2023-08-25T04:43:44.328356+0000","last_became_active":"2023-08-25T04:43:42.891874+0000","last_became_peered":"2023-08-25T04:43:42.891874+0000","last_unstale":"2023-08-25T04:43:44.328356+0000","last_undegraded":"2023-08-25T04:43:44.328356+0000","last_fullsized":"2023-08-25T04:43:44.328356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:23:15.219642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327457+0000","last_change":"2023-08-25T04:43:42.895594+0000","last_active":"2023-08-25T04:43:44.327457+0000","last_peered":"2023-08-25T04:43:44.327457+0000","last_clean":"2023-08-25T04:43:44.327457+0000","last_became_active":"2023-08-25T04:43:42.895114+0000","last_became_peered":"2023-08-25T04:43:42.895114+0000","last_unstale":"2023-08-25T04:43:44.327457+0000","last_undegraded":"2023-08-25T04:43:44.327457+0000","last_fullsized":"2023-08-25T04:43:44.327457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:16:14.273348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328271+0000","last_change":"2023-08-25T04:43:42.896149+0000","last_active":"2023-08-25T04:43:44.328271+0000","last_peered":"2023-08-25T04:43:44.328271+0000","last_clean":"2023-08-25T04:43:44.328271+0000","last_became_active":"2023-08-25T04:43:42.895893+0000","last_became_peered":"2023-08-25T04:43:42.895893+0000","last_unstale":"2023-08-25T04:43:44.328271+0000","last_undegraded":"2023-08-25T04:43:44.328271+0000","last_fullsized":"2023-08-25T04:43:44.328271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:40.101990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033178+0000","last_change":"2023-08-25T04:43:42.905467+0000","last_active":"2023-08-25T04:43:44.033178+0000","last_peered":"2023-08-25T04:43:44.033178+0000","last_clean":"2023-08-25T04:43:44.033178+0000","last_became_active":"2023-08-25T04:43:42.905157+0000","last_became_peered":"2023-08-25T04:43:42.905157+0000","last_unstale":"2023-08-25T04:43:44.033178+0000","last_undegraded":"2023-08-25T04:43:44.033178+0000","last_fullsized":"2023-08-25T04:43:44.033178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:27.309119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327693+0000","last_change":"2023-08-25T04:43:42.881107+0000","last_active":"2023-08-25T04:43:44.327693+0000","last_peered":"2023-08-25T04:43:44.327693+0000","last_clean":"2023-08-25T04:43:44.327693+0000","last_became_active":"2023-08-25T04:43:42.879881+0000","last_became_peered":"2023-08-25T04:43:42.879881+0000","last_unstale":"2023-08-25T04:43:44.327693+0000","last_undegraded":"2023-08-25T04:43:44.327693+0000","last_fullsized":"2023-08-25T04:43:44.327693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:31.030985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874763+0000","last_change":"2023-08-25T04:43:42.899035+0000","last_active":"2023-08-25T04:43:43.874763+0000","last_peered":"2023-08-25T04:43:43.874763+0000","last_clean":"2023-08-25T04:43:43.874763+0000","last_became_active":"2023-08-25T04:43:42.898723+0000","last_became_peered":"2023-08-25T04:43:42.898723+0000","last_unstale":"2023-08-25T04:43:43.874763+0000","last_undegraded":"2023-08-25T04:43:43.874763+0000","last_fullsized":"2023-08-25T04:43:43.874763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:15.216169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032883+0000","last_change":"2023-08-25T04:43:42.897136+0000","last_active":"2023-08-25T04:43:44.032883+0000","last_peered":"2023-08-25T04:43:44.032883+0000","last_clean":"2023-08-25T04:43:44.032883+0000","last_became_active":"2023-08-25T04:43:42.896869+0000","last_became_peered":"2023-08-25T04:43:42.896869+0000","last_unstale":"2023-08-25T04:43:44.032883+0000","last_undegraded":"2023-08-25T04:43:44.032883+0000","last_fullsized":"2023-08-25T04:43:44.032883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873831+0000","last_change":"2023-08-25T04:43:42.893954+0000","last_active":"2023-08-25T04:43:43.873831+0000","last_peered":"2023-08-25T04:43:43.873831+0000","last_clean":"2023-08-25T04:43:43.873831+0000","last_became_active":"2023-08-25T04:43:42.893673+0000","last_became_peered":"2023-08-25T04:43:42.893673+0000","last_unstale":"2023-08-25T04:43:43.873831+0000","last_undegraded":"2023-08-25T04:43:43.873831+0000","last_fullsized":"2023-08-25T04:43:43.873831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:10.669970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873872+0000","last_change":"2023-08-25T04:43:42.888116+0000","last_active":"2023-08-25T04:43:43.873872+0000","last_peered":"2023-08-25T04:43:43.873872+0000","last_clean":"2023-08-25T04:43:43.873872+0000","last_became_active":"2023-08-25T04:43:42.887831+0000","last_became_peered":"2023-08-25T04:43:42.887831+0000","last_unstale":"2023-08-25T04:43:43.873872+0000","last_undegraded":"2023-08-25T04:43:43.873872+0000","last_fullsized":"2023-08-25T04:43:43.873872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:38.406155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874487+0000","last_change":"2023-08-25T04:43:42.894954+0000","last_active":"2023-08-25T04:43:43.874487+0000","last_peered":"2023-08-25T04:43:43.874487+0000","last_clean":"2023-08-25T04:43:43.874487+0000","last_became_active":"2023-08-25T04:43:42.894302+0000","last_became_peered":"2023-08-25T04:43:42.894302+0000","last_unstale":"2023-08-25T04:43:43.874487+0000","last_undegraded":"2023-08-25T04:43:43.874487+0000","last_fullsized":"2023-08-25T04:43:43.874487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:49.188528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328143+0000","last_change":"2023-08-25T04:43:41.888584+0000","last_active":"2023-08-25T04:43:44.328143+0000","last_peered":"2023-08-25T04:43:44.328143+0000","last_clean":"2023-08-25T04:43:44.328143+0000","last_became_active":"2023-08-25T04:43:41.888339+0000","last_became_peered":"2023-08-25T04:43:41.888339+0000","last_unstale":"2023-08-25T04:43:44.328143+0000","last_undegraded":"2023-08-25T04:43:44.328143+0000","last_fullsized":"2023-08-25T04:43:44.328143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:17.587860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874994+0000","last_change":"2023-08-25T04:43:42.897739+0000","last_active":"2023-08-25T04:43:43.874994+0000","last_peered":"2023-08-25T04:43:43.874994+0000","last_clean":"2023-08-25T04:43:43.874994+0000","last_became_active":"2023-08-25T04:43:42.897425+0000","last_became_peered":"2023-08-25T04:43:42.897425+0000","last_unstale":"2023-08-25T04:43:43.874994+0000","last_undegraded":"2023-08-25T04:43:43.874994+0000","last_fullsized":"2023-08-25T04:43:43.874994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873410+0000","last_change":"2023-08-25T04:43:41.886122+0000","last_active":"2023-08-25T04:43:43.873410+0000","last_peered":"2023-08-25T04:43:43.873410+0000","last_clean":"2023-08-25T04:43:43.873410+0000","last_became_active":"2023-08-25T04:43:41.885184+0000","last_became_peered":"2023-08-25T04:43:41.885184+0000","last_unstale":"2023-08-25T04:43:43.873410+0000","last_undegraded":"2023-08-25T04:43:43.873410+0000","last_fullsized":"2023-08-25T04:43:43.873410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:30.025865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328069+0000","last_change":"2023-08-25T04:43:42.890854+0000","last_active":"2023-08-25T04:43:44.328069+0000","last_peered":"2023-08-25T04:43:44.328069+0000","last_clean":"2023-08-25T04:43:44.328069+0000","last_became_active":"2023-08-25T04:43:42.890575+0000","last_became_peered":"2023-08-25T04:43:42.890575+0000","last_unstale":"2023-08-25T04:43:44.328069+0000","last_undegraded":"2023-08-25T04:43:44.328069+0000","last_fullsized":"2023-08-25T04:43:44.328069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:49.188528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874877+0000","last_change":"2023-08-25T04:43:41.885567+0000","last_active":"2023-08-25T04:43:43.874877+0000","last_peered":"2023-08-25T04:43:43.874877+0000","last_clean":"2023-08-25T04:43:43.874877+0000","last_became_active":"2023-08-25T04:43:41.885299+0000","last_became_peered":"2023-08-25T04:43:41.885299+0000","last_unstale":"2023-08-25T04:43:43.874877+0000","last_undegraded":"2023-08-25T04:43:43.874877+0000","last_fullsized":"2023-08-25T04:43:43.874877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:19.036840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328008+0000","last_change":"2023-08-25T04:43:42.899190+0000","last_active":"2023-08-25T04:43:44.328008+0000","last_peered":"2023-08-25T04:43:44.328008+0000","last_clean":"2023-08-25T04:43:44.328008+0000","last_became_active":"2023-08-25T04:43:42.898874+0000","last_became_peered":"2023-08-25T04:43:42.898874+0000","last_unstale":"2023-08-25T04:43:44.328008+0000","last_undegraded":"2023-08-25T04:43:44.328008+0000","last_fullsized":"2023-08-25T04:43:44.328008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.713590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327795+0000","last_change":"2023-08-25T04:43:41.883055+0000","last_active":"2023-08-25T04:43:44.327795+0000","last_peered":"2023-08-25T04:43:44.327795+0000","last_clean":"2023-08-25T04:43:44.327795+0000","last_became_active":"2023-08-25T04:43:41.882381+0000","last_became_peered":"2023-08-25T04:43:41.882381+0000","last_unstale":"2023-08-25T04:43:44.327795+0000","last_undegraded":"2023-08-25T04:43:44.327795+0000","last_fullsized":"2023-08-25T04:43:44.327795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:30.298488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874811+0000","last_change":"2023-08-25T04:43:42.897118+0000","last_active":"2023-08-25T04:43:43.874811+0000","last_peered":"2023-08-25T04:43:43.874811+0000","last_clean":"2023-08-25T04:43:43.874811+0000","last_became_active":"2023-08-25T04:43:42.896817+0000","last_became_peered":"2023-08-25T04:43:42.896817+0000","last_unstale":"2023-08-25T04:43:43.874811+0000","last_undegraded":"2023-08-25T04:43:43.874811+0000","last_fullsized":"2023-08-25T04:43:43.874811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874464+0000","last_change":"2023-08-25T04:43:41.882339+0000","last_active":"2023-08-25T04:43:43.874464+0000","last_peered":"2023-08-25T04:43:43.874464+0000","last_clean":"2023-08-25T04:43:43.874464+0000","last_became_active":"2023-08-25T04:43:41.882055+0000","last_became_peered":"2023-08-25T04:43:41.882055+0000","last_unstale":"2023-08-25T04:43:43.874464+0000","last_undegraded":"2023-08-25T04:43:43.874464+0000","last_fullsized":"2023-08-25T04:43:43.874464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:58:07.396227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875270+0000","last_change":"2023-08-25T04:43:42.891741+0000","last_active":"2023-08-25T04:43:43.875270+0000","last_peered":"2023-08-25T04:43:43.875270+0000","last_clean":"2023-08-25T04:43:43.875270+0000","last_became_active":"2023-08-25T04:43:42.890100+0000","last_became_peered":"2023-08-25T04:43:42.890100+0000","last_unstale":"2023-08-25T04:43:43.875270+0000","last_undegraded":"2023-08-25T04:43:43.875270+0000","last_fullsized":"2023-08-25T04:43:43.875270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:03.096619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033307+0000","last_change":"2023-08-25T04:43:41.887924+0000","last_active":"2023-08-25T04:43:44.033307+0000","last_peered":"2023-08-25T04:43:44.033307+0000","last_clean":"2023-08-25T04:43:44.033307+0000","last_became_active":"2023-08-25T04:43:41.887622+0000","last_became_peered":"2023-08-25T04:43:41.887622+0000","last_unstale":"2023-08-25T04:43:44.033307+0000","last_undegraded":"2023-08-25T04:43:44.033307+0000","last_fullsized":"2023-08-25T04:43:44.033307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:26.261202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873335+0000","last_change":"2023-08-25T04:43:42.891006+0000","last_active":"2023-08-25T04:43:43.873335+0000","last_peered":"2023-08-25T04:43:43.873335+0000","last_clean":"2023-08-25T04:43:43.873335+0000","last_became_active":"2023-08-25T04:43:42.890648+0000","last_became_peered":"2023-08-25T04:43:42.890648+0000","last_unstale":"2023-08-25T04:43:43.873335+0000","last_undegraded":"2023-08-25T04:43:43.873335+0000","last_fullsized":"2023-08-25T04:43:43.873335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:03.819785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328264+0000","last_change":"2023-08-25T04:43:41.887033+0000","last_active":"2023-08-25T04:43:44.328264+0000","last_peered":"2023-08-25T04:43:44.328264+0000","last_clean":"2023-08-25T04:43:44.328264+0000","last_became_active":"2023-08-25T04:43:41.886491+0000","last_became_peered":"2023-08-25T04:43:41.886491+0000","last_unstale":"2023-08-25T04:43:44.328264+0000","last_undegraded":"2023-08-25T04:43:44.328264+0000","last_fullsized":"2023-08-25T04:43:44.328264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:58:33.572888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328258+0000","last_change":"2023-08-25T04:43:42.893709+0000","last_active":"2023-08-25T04:43:44.328258+0000","last_peered":"2023-08-25T04:43:44.328258+0000","last_clean":"2023-08-25T04:43:44.328258+0000","last_became_active":"2023-08-25T04:43:42.893525+0000","last_became_peered":"2023-08-25T04:43:42.893525+0000","last_unstale":"2023-08-25T04:43:44.328258+0000","last_undegraded":"2023-08-25T04:43:44.328258+0000","last_fullsized":"2023-08-25T04:43:44.328258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:58:52.209554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033093+0000","last_change":"2023-08-25T04:43:41.890946+0000","last_active":"2023-08-25T04:43:44.033093+0000","last_peered":"2023-08-25T04:43:44.033093+0000","last_clean":"2023-08-25T04:43:44.033093+0000","last_became_active":"2023-08-25T04:43:41.890673+0000","last_became_peered":"2023-08-25T04:43:41.890673+0000","last_unstale":"2023-08-25T04:43:44.033093+0000","last_undegraded":"2023-08-25T04:43:44.033093+0000","last_fullsized":"2023-08-25T04:43:44.033093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:38.571968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875163+0000","last_change":"2023-08-25T04:43:42.897809+0000","last_active":"2023-08-25T04:43:43.875163+0000","last_peered":"2023-08-25T04:43:43.875163+0000","last_clean":"2023-08-25T04:43:43.875163+0000","last_became_active":"2023-08-25T04:43:42.897204+0000","last_became_peered":"2023-08-25T04:43:42.897204+0000","last_unstale":"2023-08-25T04:43:43.875163+0000","last_undegraded":"2023-08-25T04:43:43.875163+0000","last_fullsized":"2023-08-25T04:43:43.875163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:27.309119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327671+0000","last_change":"2023-08-25T04:43:41.881387+0000","last_active":"2023-08-25T04:43:44.327671+0000","last_peered":"2023-08-25T04:43:44.327671+0000","last_clean":"2023-08-25T04:43:44.327671+0000","last_became_active":"2023-08-25T04:43:41.881067+0000","last_became_peered":"2023-08-25T04:43:41.881067+0000","last_unstale":"2023-08-25T04:43:44.327671+0000","last_undegraded":"2023-08-25T04:43:44.327671+0000","last_fullsized":"2023-08-25T04:43:44.327671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:34:36.120848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874683+0000","last_change":"2023-08-25T04:43:42.895088+0000","last_active":"2023-08-25T04:43:43.874683+0000","last_peered":"2023-08-25T04:43:43.874683+0000","last_clean":"2023-08-25T04:43:43.874683+0000","last_became_active":"2023-08-25T04:43:42.894807+0000","last_became_peered":"2023-08-25T04:43:42.894807+0000","last_unstale":"2023-08-25T04:43:43.874683+0000","last_undegraded":"2023-08-25T04:43:43.874683+0000","last_fullsized":"2023-08-25T04:43:43.874683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032938+0000","last_change":"2023-08-25T04:43:41.890995+0000","last_active":"2023-08-25T04:43:44.032938+0000","last_peered":"2023-08-25T04:43:44.032938+0000","last_clean":"2023-08-25T04:43:44.032938+0000","last_became_active":"2023-08-25T04:43:41.890706+0000","last_became_peered":"2023-08-25T04:43:41.890706+0000","last_unstale":"2023-08-25T04:43:44.032938+0000","last_undegraded":"2023-08-25T04:43:44.032938+0000","last_fullsized":"2023-08-25T04:43:44.032938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327738+0000","last_change":"2023-08-25T04:43:42.897775+0000","last_active":"2023-08-25T04:43:44.327738+0000","last_peered":"2023-08-25T04:43:44.327738+0000","last_clean":"2023-08-25T04:43:44.327738+0000","last_became_active":"2023-08-25T04:43:42.897476+0000","last_became_peered":"2023-08-25T04:43:42.897476+0000","last_unstale":"2023-08-25T04:43:44.327738+0000","last_undegraded":"2023-08-25T04:43:44.327738+0000","last_fullsized":"2023-08-25T04:43:44.327738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:03.819785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327483+0000","last_change":"2023-08-25T04:43:41.892829+0000","last_active":"2023-08-25T04:43:44.327483+0000","last_peered":"2023-08-25T04:43:44.327483+0000","last_clean":"2023-08-25T04:43:44.327483+0000","last_became_active":"2023-08-25T04:43:41.892517+0000","last_became_peered":"2023-08-25T04:43:41.892517+0000","last_unstale":"2023-08-25T04:43:44.327483+0000","last_undegraded":"2023-08-25T04:43:44.327483+0000","last_fullsized":"2023-08-25T04:43:44.327483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:40:01.170031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875239+0000","last_change":"2023-08-25T04:43:42.905276+0000","last_active":"2023-08-25T04:43:43.875239+0000","last_peered":"2023-08-25T04:43:43.875239+0000","last_clean":"2023-08-25T04:43:43.875239+0000","last_became_active":"2023-08-25T04:43:42.904736+0000","last_became_peered":"2023-08-25T04:43:42.904736+0000","last_unstale":"2023-08-25T04:43:43.875239+0000","last_undegraded":"2023-08-25T04:43:43.875239+0000","last_fullsized":"2023-08-25T04:43:43.875239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:18.592980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033419+0000","last_change":"2023-08-25T04:43:41.891246+0000","last_active":"2023-08-25T04:43:44.033419+0000","last_peered":"2023-08-25T04:43:44.033419+0000","last_clean":"2023-08-25T04:43:44.033419+0000","last_became_active":"2023-08-25T04:43:41.890942+0000","last_became_peered":"2023-08-25T04:43:41.890942+0000","last_unstale":"2023-08-25T04:43:44.033419+0000","last_undegraded":"2023-08-25T04:43:44.033419+0000","last_fullsized":"2023-08-25T04:43:44.033419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:39.096870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874433+0000","last_change":"2023-08-25T04:43:42.895071+0000","last_active":"2023-08-25T04:43:43.874433+0000","last_peered":"2023-08-25T04:43:43.874433+0000","last_clean":"2023-08-25T04:43:43.874433+0000","last_became_active":"2023-08-25T04:43:42.894285+0000","last_became_peered":"2023-08-25T04:43:42.894285+0000","last_unstale":"2023-08-25T04:43:43.874433+0000","last_undegraded":"2023-08-25T04:43:43.874433+0000","last_fullsized":"2023-08-25T04:43:43.874433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:49.534369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033324+0000","last_change":"2023-08-25T04:43:41.891175+0000","last_active":"2023-08-25T04:43:44.033324+0000","last_peered":"2023-08-25T04:43:44.033324+0000","last_clean":"2023-08-25T04:43:44.033324+0000","last_became_active":"2023-08-25T04:43:41.890883+0000","last_became_peered":"2023-08-25T04:43:41.890883+0000","last_unstale":"2023-08-25T04:43:44.033324+0000","last_undegraded":"2023-08-25T04:43:44.033324+0000","last_fullsized":"2023-08-25T04:43:44.033324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:02.091499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327753+0000","last_change":"2023-08-25T04:43:42.891686+0000","last_active":"2023-08-25T04:43:44.327753+0000","last_peered":"2023-08-25T04:43:44.327753+0000","last_clean":"2023-08-25T04:43:44.327753+0000","last_became_active":"2023-08-25T04:43:42.891443+0000","last_became_peered":"2023-08-25T04:43:42.891443+0000","last_unstale":"2023-08-25T04:43:44.327753+0000","last_undegraded":"2023-08-25T04:43:44.327753+0000","last_fullsized":"2023-08-25T04:43:44.327753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033233+0000","last_change":"2023-08-25T04:43:41.888723+0000","last_active":"2023-08-25T04:43:44.033233+0000","last_peered":"2023-08-25T04:43:44.033233+0000","last_clean":"2023-08-25T04:43:44.033233+0000","last_became_active":"2023-08-25T04:43:41.888447+0000","last_became_peered":"2023-08-25T04:43:41.888447+0000","last_unstale":"2023-08-25T04:43:44.033233+0000","last_undegraded":"2023-08-25T04:43:44.033233+0000","last_fullsized":"2023-08-25T04:43:44.033233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:17.587860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328252+0000","last_change":"2023-08-25T04:43:42.892447+0000","last_active":"2023-08-25T04:43:44.328252+0000","last_peered":"2023-08-25T04:43:44.328252+0000","last_clean":"2023-08-25T04:43:44.328252+0000","last_became_active":"2023-08-25T04:43:42.892191+0000","last_became_peered":"2023-08-25T04:43:42.892191+0000","last_unstale":"2023-08-25T04:43:44.328252+0000","last_undegraded":"2023-08-25T04:43:44.328252+0000","last_fullsized":"2023-08-25T04:43:44.328252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:26.162949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874646+0000","last_change":"2023-08-25T04:43:41.884395+0000","last_active":"2023-08-25T04:43:43.874646+0000","last_peered":"2023-08-25T04:43:43.874646+0000","last_clean":"2023-08-25T04:43:43.874646+0000","last_became_active":"2023-08-25T04:43:41.884098+0000","last_became_peered":"2023-08-25T04:43:41.884098+0000","last_unstale":"2023-08-25T04:43:43.874646+0000","last_undegraded":"2023-08-25T04:43:43.874646+0000","last_fullsized":"2023-08-25T04:43:43.874646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:26.896561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328035+0000","last_change":"2023-08-25T04:43:42.881050+0000","last_active":"2023-08-25T04:43:44.328035+0000","last_peered":"2023-08-25T04:43:44.328035+0000","last_clean":"2023-08-25T04:43:44.328035+0000","last_became_active":"2023-08-25T04:43:42.880104+0000","last_became_peered":"2023-08-25T04:43:42.880104+0000","last_unstale":"2023-08-25T04:43:44.328035+0000","last_undegraded":"2023-08-25T04:43:44.328035+0000","last_fullsized":"2023-08-25T04:43:44.328035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:38.406155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875014+0000","last_change":"2023-08-25T04:43:41.885729+0000","last_active":"2023-08-25T04:43:43.875014+0000","last_peered":"2023-08-25T04:43:43.875014+0000","last_clean":"2023-08-25T04:43:43.875014+0000","last_became_active":"2023-08-25T04:43:41.885433+0000","last_became_peered":"2023-08-25T04:43:41.885433+0000","last_unstale":"2023-08-25T04:43:43.875014+0000","last_undegraded":"2023-08-25T04:43:43.875014+0000","last_fullsized":"2023-08-25T04:43:43.875014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:40.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328082+0000","last_change":"2023-08-25T04:43:42.896701+0000","last_active":"2023-08-25T04:43:44.328082+0000","last_peered":"2023-08-25T04:43:44.328082+0000","last_clean":"2023-08-25T04:43:44.328082+0000","last_became_active":"2023-08-25T04:43:42.896440+0000","last_became_peered":"2023-08-25T04:43:42.896440+0000","last_unstale":"2023-08-25T04:43:44.328082+0000","last_undegraded":"2023-08-25T04:43:44.328082+0000","last_fullsized":"2023-08-25T04:43:44.328082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:27.309119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328105+0000","last_change":"2023-08-25T04:43:41.891087+0000","last_active":"2023-08-25T04:43:44.328105+0000","last_peered":"2023-08-25T04:43:44.328105+0000","last_clean":"2023-08-25T04:43:44.328105+0000","last_became_active":"2023-08-25T04:43:41.890827+0000","last_became_peered":"2023-08-25T04:43:41.890827+0000","last_unstale":"2023-08-25T04:43:44.328105+0000","last_undegraded":"2023-08-25T04:43:44.328105+0000","last_fullsized":"2023-08-25T04:43:44.328105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:02.814665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328450+0000","last_change":"2023-08-25T04:43:42.897377+0000","last_active":"2023-08-25T04:43:44.328450+0000","last_peered":"2023-08-25T04:43:44.328450+0000","last_clean":"2023-08-25T04:43:44.328450+0000","last_became_active":"2023-08-25T04:43:42.897108+0000","last_became_peered":"2023-08-25T04:43:42.897108+0000","last_unstale":"2023-08-25T04:43:44.328450+0000","last_undegraded":"2023-08-25T04:43:44.328450+0000","last_fullsized":"2023-08-25T04:43:44.328450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:46:27.979648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327909+0000","last_change":"2023-08-25T04:43:41.888568+0000","last_active":"2023-08-25T04:43:44.327909+0000","last_peered":"2023-08-25T04:43:44.327909+0000","last_clean":"2023-08-25T04:43:44.327909+0000","last_became_active":"2023-08-25T04:43:41.888323+0000","last_became_peered":"2023-08-25T04:43:41.888323+0000","last_unstale":"2023-08-25T04:43:44.327909+0000","last_undegraded":"2023-08-25T04:43:44.327909+0000","last_fullsized":"2023-08-25T04:43:44.327909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:40.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328447+0000","last_change":"2023-08-25T04:43:42.897222+0000","last_active":"2023-08-25T04:43:44.328447+0000","last_peered":"2023-08-25T04:43:44.328447+0000","last_clean":"2023-08-25T04:43:44.328447+0000","last_became_active":"2023-08-25T04:43:42.896943+0000","last_became_peered":"2023-08-25T04:43:42.896943+0000","last_unstale":"2023-08-25T04:43:44.328447+0000","last_undegraded":"2023-08-25T04:43:44.328447+0000","last_fullsized":"2023-08-25T04:43:44.328447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:55.675283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874734+0000","last_change":"2023-08-25T04:43:41.887489+0000","last_active":"2023-08-25T04:43:43.874734+0000","last_peered":"2023-08-25T04:43:43.874734+0000","last_clean":"2023-08-25T04:43:43.874734+0000","last_became_active":"2023-08-25T04:43:41.886846+0000","last_became_peered":"2023-08-25T04:43:41.886846+0000","last_unstale":"2023-08-25T04:43:43.874734+0000","last_undegraded":"2023-08-25T04:43:43.874734+0000","last_fullsized":"2023-08-25T04:43:43.874734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:48.183408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874023+0000","last_change":"2023-08-25T04:43:42.903030+0000","last_active":"2023-08-25T04:43:43.874023+0000","last_peered":"2023-08-25T04:43:43.874023+0000","last_clean":"2023-08-25T04:43:43.874023+0000","last_became_active":"2023-08-25T04:43:42.902123+0000","last_became_peered":"2023-08-25T04:43:42.902123+0000","last_unstale":"2023-08-25T04:43:43.874023+0000","last_undegraded":"2023-08-25T04:43:43.874023+0000","last_fullsized":"2023-08-25T04:43:43.874023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:15.216169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875024+0000","last_change":"2023-08-25T04:43:41.883173+0000","last_active":"2023-08-25T04:43:43.875024+0000","last_peered":"2023-08-25T04:43:43.875024+0000","last_clean":"2023-08-25T04:43:43.875024+0000","last_became_active":"2023-08-25T04:43:41.882776+0000","last_became_peered":"2023-08-25T04:43:41.882776+0000","last_unstale":"2023-08-25T04:43:43.875024+0000","last_undegraded":"2023-08-25T04:43:43.875024+0000","last_fullsized":"2023-08-25T04:43:43.875024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328156+0000","last_change":"2023-08-25T04:43:36.786045+0000","last_active":"2023-08-25T04:43:44.328156+0000","last_peered":"2023-08-25T04:43:44.328156+0000","last_clean":"2023-08-25T04:43:44.328156+0000","last_became_active":"2023-08-25T04:43:36.785725+0000","last_became_peered":"2023-08-25T04:43:36.785725+0000","last_unstale":"2023-08-25T04:43:44.328156+0000","last_undegraded":"2023-08-25T04:43:44.328156+0000","last_fullsized":"2023-08-25T04:43:44.328156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:21.173873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874659+0000","last_change":"2023-08-25T04:43:42.890044+0000","last_active":"2023-08-25T04:43:43.874659+0000","last_peered":"2023-08-25T04:43:43.874659+0000","last_clean":"2023-08-25T04:43:43.874659+0000","last_became_active":"2023-08-25T04:43:42.889721+0000","last_became_peered":"2023-08-25T04:43:42.889721+0000","last_unstale":"2023-08-25T04:43:43.874659+0000","last_undegraded":"2023-08-25T04:43:43.874659+0000","last_fullsized":"2023-08-25T04:43:43.874659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:38.406155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875215+0000","last_change":"2023-08-25T04:43:36.782928+0000","last_active":"2023-08-25T04:43:43.875215+0000","last_peered":"2023-08-25T04:43:43.875215+0000","last_clean":"2023-08-25T04:43:43.875215+0000","last_became_active":"2023-08-25T04:43:36.782680+0000","last_became_peered":"2023-08-25T04:43:36.782680+0000","last_unstale":"2023-08-25T04:43:43.875215+0000","last_undegraded":"2023-08-25T04:43:43.875215+0000","last_fullsized":"2023-08-25T04:43:43.875215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:34.009540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328180+0000","last_change":"2023-08-25T04:43:41.888878+0000","last_active":"2023-08-25T04:43:44.328180+0000","last_peered":"2023-08-25T04:43:44.328180+0000","last_clean":"2023-08-25T04:43:44.328180+0000","last_became_active":"2023-08-25T04:43:41.885363+0000","last_became_peered":"2023-08-25T04:43:41.885363+0000","last_unstale":"2023-08-25T04:43:44.328180+0000","last_undegraded":"2023-08-25T04:43:44.328180+0000","last_fullsized":"2023-08-25T04:43:44.328180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:14.211049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328061+0000","last_change":"2023-08-25T04:43:42.899201+0000","last_active":"2023-08-25T04:43:44.328061+0000","last_peered":"2023-08-25T04:43:44.328061+0000","last_clean":"2023-08-25T04:43:44.328061+0000","last_became_active":"2023-08-25T04:43:42.898942+0000","last_became_peered":"2023-08-25T04:43:42.898942+0000","last_unstale":"2023-08-25T04:43:44.328061+0000","last_undegraded":"2023-08-25T04:43:44.328061+0000","last_fullsized":"2023-08-25T04:43:44.328061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:39.577088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873470+0000","last_change":"2023-08-25T04:43:36.785266+0000","last_active":"2023-08-25T04:43:43.873470+0000","last_peered":"2023-08-25T04:43:43.873470+0000","last_clean":"2023-08-25T04:43:43.873470+0000","last_became_active":"2023-08-25T04:43:36.784937+0000","last_became_peered":"2023-08-25T04:43:36.784937+0000","last_unstale":"2023-08-25T04:43:43.873470+0000","last_undegraded":"2023-08-25T04:43:43.873470+0000","last_fullsized":"2023-08-25T04:43:43.873470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:45.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032991+0000","last_change":"2023-08-25T04:43:36.785867+0000","last_active":"2023-08-25T04:43:44.032991+0000","last_peered":"2023-08-25T04:43:44.032991+0000","last_clean":"2023-08-25T04:43:44.032991+0000","last_became_active":"2023-08-25T04:43:36.785451+0000","last_became_peered":"2023-08-25T04:43:36.785451+0000","last_unstale":"2023-08-25T04:43:44.032991+0000","last_undegraded":"2023-08-25T04:43:44.032991+0000","last_fullsized":"2023-08-25T04:43:44.032991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:10.496695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327813+0000","last_change":"2023-08-25T04:43:41.886451+0000","last_active":"2023-08-25T04:43:44.327813+0000","last_peered":"2023-08-25T04:43:44.327813+0000","last_clean":"2023-08-25T04:43:44.327813+0000","last_became_active":"2023-08-25T04:43:41.885029+0000","last_became_peered":"2023-08-25T04:43:41.885029+0000","last_unstale":"2023-08-25T04:43:44.327813+0000","last_undegraded":"2023-08-25T04:43:44.327813+0000","last_fullsized":"2023-08-25T04:43:44.327813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:09.664850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327887+0000","last_change":"2023-08-25T04:43:42.881048+0000","last_active":"2023-08-25T04:43:44.327887+0000","last_peered":"2023-08-25T04:43:44.327887+0000","last_clean":"2023-08-25T04:43:44.327887+0000","last_became_active":"2023-08-25T04:43:42.880591+0000","last_became_peered":"2023-08-25T04:43:42.880591+0000","last_unstale":"2023-08-25T04:43:44.327887+0000","last_undegraded":"2023-08-25T04:43:44.327887+0000","last_fullsized":"2023-08-25T04:43:44.327887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:49.534369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032863+0000","last_change":"2023-08-25T04:43:37.192872+0000","last_active":"2023-08-25T04:43:44.032863+0000","last_peered":"2023-08-25T04:43:44.032863+0000","last_clean":"2023-08-25T04:43:44.032863+0000","last_became_active":"2023-08-25T04:43:37.192594+0000","last_became_peered":"2023-08-25T04:43:37.192594+0000","last_unstale":"2023-08-25T04:43:44.032863+0000","last_undegraded":"2023-08-25T04:43:44.032863+0000","last_fullsized":"2023-08-25T04:43:44.032863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:35.350128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873254+0000","last_change":"2023-08-25T04:43:41.888507+0000","last_active":"2023-08-25T04:43:43.873254+0000","last_peered":"2023-08-25T04:43:43.873254+0000","last_clean":"2023-08-25T04:43:43.873254+0000","last_became_active":"2023-08-25T04:43:41.888158+0000","last_became_peered":"2023-08-25T04:43:41.888158+0000","last_unstale":"2023-08-25T04:43:43.873254+0000","last_undegraded":"2023-08-25T04:43:43.873254+0000","last_fullsized":"2023-08-25T04:43:43.873254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:34:36.120848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874020+0000","last_change":"2023-08-25T04:43:42.902440+0000","last_active":"2023-08-25T04:43:43.874020+0000","last_peered":"2023-08-25T04:43:43.874020+0000","last_clean":"2023-08-25T04:43:43.874020+0000","last_became_active":"2023-08-25T04:43:42.901657+0000","last_became_peered":"2023-08-25T04:43:42.901657+0000","last_unstale":"2023-08-25T04:43:43.874020+0000","last_undegraded":"2023-08-25T04:43:43.874020+0000","last_fullsized":"2023-08-25T04:43:43.874020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:49.188528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032805+0000","last_change":"2023-08-25T04:43:37.192977+0000","last_active":"2023-08-25T04:43:44.032805+0000","last_peered":"2023-08-25T04:43:44.032805+0000","last_clean":"2023-08-25T04:43:44.032805+0000","last_became_active":"2023-08-25T04:43:37.192427+0000","last_became_peered":"2023-08-25T04:43:37.192427+0000","last_unstale":"2023-08-25T04:43:44.032805+0000","last_undegraded":"2023-08-25T04:43:44.032805+0000","last_fullsized":"2023-08-25T04:43:44.032805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:13.949510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875137+0000","last_change":"2023-08-25T04:43:41.883960+0000","last_active":"2023-08-25T04:43:43.875137+0000","last_peered":"2023-08-25T04:43:43.875137+0000","last_clean":"2023-08-25T04:43:43.875137+0000","last_became_active":"2023-08-25T04:43:41.883621+0000","last_became_peered":"2023-08-25T04:43:41.883621+0000","last_unstale":"2023-08-25T04:43:43.875137+0000","last_undegraded":"2023-08-25T04:43:43.875137+0000","last_fullsized":"2023-08-25T04:43:43.875137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:38.571968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327644+0000","last_change":"2023-08-25T04:43:42.893639+0000","last_active":"2023-08-25T04:43:44.327644+0000","last_peered":"2023-08-25T04:43:44.327644+0000","last_clean":"2023-08-25T04:43:44.327644+0000","last_became_active":"2023-08-25T04:43:42.893333+0000","last_became_peered":"2023-08-25T04:43:42.893333+0000","last_unstale":"2023-08-25T04:43:44.327644+0000","last_undegraded":"2023-08-25T04:43:44.327644+0000","last_fullsized":"2023-08-25T04:43:44.327644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:08:04.874031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874239+0000","last_change":"2023-08-25T04:43:37.192780+0000","last_active":"2023-08-25T04:43:43.874239+0000","last_peered":"2023-08-25T04:43:43.874239+0000","last_clean":"2023-08-25T04:43:43.874239+0000","last_became_active":"2023-08-25T04:43:37.192432+0000","last_became_peered":"2023-08-25T04:43:37.192432+0000","last_unstale":"2023-08-25T04:43:43.874239+0000","last_undegraded":"2023-08-25T04:43:43.874239+0000","last_fullsized":"2023-08-25T04:43:43.874239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:20.070499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328104+0000","last_change":"2023-08-25T04:43:41.889966+0000","last_active":"2023-08-25T04:43:44.328104+0000","last_peered":"2023-08-25T04:43:44.328104+0000","last_clean":"2023-08-25T04:43:44.328104+0000","last_became_active":"2023-08-25T04:43:41.889717+0000","last_became_peered":"2023-08-25T04:43:41.889717+0000","last_unstale":"2023-08-25T04:43:44.328104+0000","last_undegraded":"2023-08-25T04:43:44.328104+0000","last_fullsized":"2023-08-25T04:43:44.328104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:13.278697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873901+0000","last_change":"2023-08-25T04:43:42.885970+0000","last_active":"2023-08-25T04:43:43.873901+0000","last_peered":"2023-08-25T04:43:43.873901+0000","last_clean":"2023-08-25T04:43:43.873901+0000","last_became_active":"2023-08-25T04:43:42.885671+0000","last_became_peered":"2023-08-25T04:43:42.885671+0000","last_unstale":"2023-08-25T04:43:43.873901+0000","last_undegraded":"2023-08-25T04:43:43.873901+0000","last_fullsized":"2023-08-25T04:43:43.873901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:58:08.401348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327943+0000","last_change":"2023-08-25T04:43:37.192768+0000","last_active":"2023-08-25T04:43:44.327943+0000","last_peered":"2023-08-25T04:43:44.327943+0000","last_clean":"2023-08-25T04:43:44.327943+0000","last_became_active":"2023-08-25T04:43:37.192429+0000","last_became_peered":"2023-08-25T04:43:37.192429+0000","last_unstale":"2023-08-25T04:43:44.327943+0000","last_undegraded":"2023-08-25T04:43:44.327943+0000","last_fullsized":"2023-08-25T04:43:44.327943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:24.938536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873773+0000","last_change":"2023-08-25T04:43:41.888493+0000","last_active":"2023-08-25T04:43:43.873773+0000","last_peered":"2023-08-25T04:43:43.873773+0000","last_clean":"2023-08-25T04:43:43.873773+0000","last_became_active":"2023-08-25T04:43:41.888207+0000","last_became_peered":"2023-08-25T04:43:41.888207+0000","last_unstale":"2023-08-25T04:43:43.873773+0000","last_undegraded":"2023-08-25T04:43:43.873773+0000","last_fullsized":"2023-08-25T04:43:43.873773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:48.529248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327907+0000","last_change":"2023-08-25T04:43:42.900866+0000","last_active":"2023-08-25T04:43:44.327907+0000","last_peered":"2023-08-25T04:43:44.327907+0000","last_clean":"2023-08-25T04:43:44.327907+0000","last_became_active":"2023-08-25T04:43:42.900470+0000","last_became_peered":"2023-08-25T04:43:42.900470+0000","last_unstale":"2023-08-25T04:43:44.327907+0000","last_undegraded":"2023-08-25T04:43:44.327907+0000","last_fullsized":"2023-08-25T04:43:44.327907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:58:08.401348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327840+0000","last_change":"2023-08-25T04:43:36.785280+0000","last_active":"2023-08-25T04:43:44.327840+0000","last_peered":"2023-08-25T04:43:44.327840+0000","last_clean":"2023-08-25T04:43:44.327840+0000","last_became_active":"2023-08-25T04:43:36.784943+0000","last_became_peered":"2023-08-25T04:43:36.784943+0000","last_unstale":"2023-08-25T04:43:44.327840+0000","last_undegraded":"2023-08-25T04:43:44.327840+0000","last_fullsized":"2023-08-25T04:43:44.327840+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:34:31.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874669+0000","last_change":"2023-08-25T04:43:41.884839+0000","last_active":"2023-08-25T04:43:43.874669+0000","last_peered":"2023-08-25T04:43:43.874669+0000","last_clean":"2023-08-25T04:43:43.874669+0000","last_became_active":"2023-08-25T04:43:41.884535+0000","last_became_peered":"2023-08-25T04:43:41.884535+0000","last_unstale":"2023-08-25T04:43:43.874669+0000","last_undegraded":"2023-08-25T04:43:43.874669+0000","last_fullsized":"2023-08-25T04:43:43.874669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:19.036840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873817+0000","last_change":"2023-08-25T04:43:42.903007+0000","last_active":"2023-08-25T04:43:43.873817+0000","last_peered":"2023-08-25T04:43:43.873817+0000","last_clean":"2023-08-25T04:43:43.873817+0000","last_became_active":"2023-08-25T04:43:42.902721+0000","last_became_peered":"2023-08-25T04:43:42.902721+0000","last_unstale":"2023-08-25T04:43:43.873817+0000","last_undegraded":"2023-08-25T04:43:43.873817+0000","last_fullsized":"2023-08-25T04:43:43.873817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:31.303608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328239+0000","last_change":"2023-08-25T04:43:41.889969+0000","last_active":"2023-08-25T04:43:44.328239+0000","last_peered":"2023-08-25T04:43:44.328239+0000","last_clean":"2023-08-25T04:43:44.328239+0000","last_became_active":"2023-08-25T04:43:41.889659+0000","last_became_peered":"2023-08-25T04:43:41.889659+0000","last_unstale":"2023-08-25T04:43:44.328239+0000","last_undegraded":"2023-08-25T04:43:44.328239+0000","last_fullsized":"2023-08-25T04:43:44.328239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:24.582793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327415+0000","last_change":"2023-08-25T04:43:42.894953+0000","last_active":"2023-08-25T04:43:44.327415+0000","last_peered":"2023-08-25T04:43:44.327415+0000","last_clean":"2023-08-25T04:43:44.327415+0000","last_became_active":"2023-08-25T04:43:42.894618+0000","last_became_peered":"2023-08-25T04:43:42.894618+0000","last_unstale":"2023-08-25T04:43:44.327415+0000","last_undegraded":"2023-08-25T04:43:44.327415+0000","last_fullsized":"2023-08-25T04:43:44.327415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:55.404819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874488+0000","last_change":"2023-08-25T04:43:41.886470+0000","last_active":"2023-08-25T04:43:43.874488+0000","last_peered":"2023-08-25T04:43:43.874488+0000","last_clean":"2023-08-25T04:43:43.874488+0000","last_became_active":"2023-08-25T04:43:41.886063+0000","last_became_peered":"2023-08-25T04:43:41.886063+0000","last_unstale":"2023-08-25T04:43:43.874488+0000","last_undegraded":"2023-08-25T04:43:43.874488+0000","last_fullsized":"2023-08-25T04:43:43.874488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:37.401035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327631+0000","last_change":"2023-08-25T04:43:42.900475+0000","last_active":"2023-08-25T04:43:44.327631+0000","last_peered":"2023-08-25T04:43:44.327631+0000","last_clean":"2023-08-25T04:43:44.327631+0000","last_became_active":"2023-08-25T04:43:42.900135+0000","last_became_peered":"2023-08-25T04:43:42.900135+0000","last_unstale":"2023-08-25T04:43:44.327631+0000","last_undegraded":"2023-08-25T04:43:44.327631+0000","last_fullsized":"2023-08-25T04:43:44.327631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:20.041960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874794+0000","last_change":"2023-08-25T04:43:41.891609+0000","last_active":"2023-08-25T04:43:43.874794+0000","last_peered":"2023-08-25T04:43:43.874794+0000","last_clean":"2023-08-25T04:43:43.874794+0000","last_became_active":"2023-08-25T04:43:41.891306+0000","last_became_peered":"2023-08-25T04:43:41.891306+0000","last_unstale":"2023-08-25T04:43:43.874794+0000","last_undegraded":"2023-08-25T04:43:43.874794+0000","last_fullsized":"2023-08-25T04:43:43.874794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:40.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328451+0000","last_change":"2023-08-25T04:43:42.894647+0000","last_active":"2023-08-25T04:43:44.328451+0000","last_peered":"2023-08-25T04:43:44.328451+0000","last_clean":"2023-08-25T04:43:44.328451+0000","last_became_active":"2023-08-25T04:43:42.894386+0000","last_became_peered":"2023-08-25T04:43:42.894386+0000","last_unstale":"2023-08-25T04:43:44.328451+0000","last_undegraded":"2023-08-25T04:43:44.328451+0000","last_fullsized":"2023-08-25T04:43:44.328451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:37.175484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875135+0000","last_change":"2023-08-25T04:43:41.893331+0000","last_active":"2023-08-25T04:43:43.875135+0000","last_peered":"2023-08-25T04:43:43.875135+0000","last_clean":"2023-08-25T04:43:43.875135+0000","last_became_active":"2023-08-25T04:43:41.892929+0000","last_became_peered":"2023-08-25T04:43:41.892929+0000","last_unstale":"2023-08-25T04:43:43.875135+0000","last_undegraded":"2023-08-25T04:43:43.875135+0000","last_fullsized":"2023-08-25T04:43:43.875135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:13.278697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875244+0000","last_change":"2023-08-25T04:43:42.894553+0000","last_active":"2023-08-25T04:43:43.875244+0000","last_peered":"2023-08-25T04:43:43.875244+0000","last_clean":"2023-08-25T04:43:43.875244+0000","last_became_active":"2023-08-25T04:43:42.894239+0000","last_became_peered":"2023-08-25T04:43:42.894239+0000","last_unstale":"2023-08-25T04:43:43.875244+0000","last_undegraded":"2023-08-25T04:43:43.875244+0000","last_fullsized":"2023-08-25T04:43:43.875244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:27.266322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327794+0000","last_change":"2023-08-25T04:43:41.883254+0000","last_active":"2023-08-25T04:43:44.327794+0000","last_peered":"2023-08-25T04:43:44.327794+0000","last_clean":"2023-08-25T04:43:44.327794+0000","last_became_active":"2023-08-25T04:43:41.882756+0000","last_became_peered":"2023-08-25T04:43:41.882756+0000","last_unstale":"2023-08-25T04:43:44.327794+0000","last_undegraded":"2023-08-25T04:43:44.327794+0000","last_fullsized":"2023-08-25T04:43:44.327794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:25.157829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327503+0000","last_change":"2023-08-25T04:43:42.895154+0000","last_active":"2023-08-25T04:43:44.327503+0000","last_peered":"2023-08-25T04:43:44.327503+0000","last_clean":"2023-08-25T04:43:44.327503+0000","last_became_active":"2023-08-25T04:43:42.894912+0000","last_became_peered":"2023-08-25T04:43:42.894912+0000","last_unstale":"2023-08-25T04:43:44.327503+0000","last_undegraded":"2023-08-25T04:43:44.327503+0000","last_fullsized":"2023-08-25T04:43:44.327503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:25.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327814+0000","last_change":"2023-08-25T04:43:42.893541+0000","last_active":"2023-08-25T04:43:44.327814+0000","last_peered":"2023-08-25T04:43:44.327814+0000","last_clean":"2023-08-25T04:43:44.327814+0000","last_became_active":"2023-08-25T04:43:42.893255+0000","last_became_peered":"2023-08-25T04:43:42.893255+0000","last_unstale":"2023-08-25T04:43:44.327814+0000","last_undegraded":"2023-08-25T04:43:44.327814+0000","last_fullsized":"2023-08-25T04:43:44.327814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:31:35.265544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874788+0000","last_change":"2023-08-25T04:43:42.897868+0000","last_active":"2023-08-25T04:43:43.874788+0000","last_peered":"2023-08-25T04:43:43.874788+0000","last_clean":"2023-08-25T04:43:43.874788+0000","last_became_active":"2023-08-25T04:43:42.897394+0000","last_became_peered":"2023-08-25T04:43:42.897394+0000","last_unstale":"2023-08-25T04:43:43.874788+0000","last_undegraded":"2023-08-25T04:43:43.874788+0000","last_fullsized":"2023-08-25T04:43:43.874788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:25.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327937+0000","last_change":"2023-08-25T04:43:42.894698+0000","last_active":"2023-08-25T04:43:44.327937+0000","last_peered":"2023-08-25T04:43:44.327937+0000","last_clean":"2023-08-25T04:43:44.327937+0000","last_became_active":"2023-08-25T04:43:42.894176+0000","last_became_peered":"2023-08-25T04:43:42.894176+0000","last_unstale":"2023-08-25T04:43:44.327937+0000","last_undegraded":"2023-08-25T04:43:44.327937+0000","last_fullsized":"2023-08-25T04:43:44.327937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:52.451365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875112+0000","last_change":"2023-08-25T04:43:42.899435+0000","last_active":"2023-08-25T04:43:43.875112+0000","last_peered":"2023-08-25T04:43:43.875112+0000","last_clean":"2023-08-25T04:43:43.875112+0000","last_became_active":"2023-08-25T04:43:42.898842+0000","last_became_peered":"2023-08-25T04:43:42.898842+0000","last_unstale":"2023-08-25T04:43:43.875112+0000","last_undegraded":"2023-08-25T04:43:43.875112+0000","last_fullsized":"2023-08-25T04:43:43.875112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:16.589145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873681+0000","last_change":"2023-08-25T04:43:42.890136+0000","last_active":"2023-08-25T04:43:43.873681+0000","last_peered":"2023-08-25T04:43:43.873681+0000","last_clean":"2023-08-25T04:43:43.873681+0000","last_became_active":"2023-08-25T04:43:42.889849+0000","last_became_peered":"2023-08-25T04:43:42.889849+0000","last_unstale":"2023-08-25T04:43:43.873681+0000","last_undegraded":"2023-08-25T04:43:43.873681+0000","last_fullsized":"2023-08-25T04:43:43.873681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:26.162949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":664642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.419}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":72446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":669467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":72067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":74114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:43:47.058 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:43:47.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.213+0000 7f4441160700 1 Processor -- start 2023-08-25T04:43:47.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.213+0000 7f4441160700 1 -- start start 2023-08-25T04:43:47.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.214+0000 7f4441160700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c0cf970 0x7f443c06a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:47.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.214+0000 7f4441160700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f443c15d320 0x7f443c06a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:47.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.214+0000 7f4441160700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443c0ac850 con 0x7f443c15cf40 2023-08-25T04:43:47.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.214+0000 7f4441160700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443c0ce240 con 0x7f443c15d320 2023-08-25T04:43:47.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.214+0000 7f4441160700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c071a60 con 0x7f443c0cf970 2023-08-25T04:43:47.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.214+0000 7f443a59c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c0cf970 0x7f443c06a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:47.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.214+0000 7f443ad9d700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f443c15cf40 0x7f443c0cda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.16:47598/0 (socket says 172.21.15.16:47598) 2023-08-25T04:43:47.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.214+0000 7f443b59e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f443c15d320 0x7f443c06a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:47.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.214+0000 7f443ad9d700 1 -- 172.21.15.16:0/1046094768 learned_addr learned my addr 172.21.15.16:0/1046094768 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:47.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.214+0000 7f4439d9b700 1 -- 172.21.15.16:0/1046094768 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568043262 0 0) 0x7f443c0ac850 con 0x7f443c15cf40 2023-08-25T04:43:47.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.215+0000 7f4439d9b700 1 -- 172.21.15.16:0/1046094768 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44240035b0 con 0x7f443c15cf40 2023-08-25T04:43:47.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.215+0000 7f443b59e700 1 -- 172.21.15.16:0/1046094768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c0cf970 msgr2=0x7f443c06a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:47.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.215+0000 7f443b59e700 1 --2- 172.21.15.16:0/1046094768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c0cf970 0x7f443c06a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.215+0000 7f443b59e700 1 -- 172.21.15.16:0/1046094768 >> v1:172.21.15.117:6789/0 conn(0x7f443c15cf40 legacy=0x7f443c0cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:47.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.215+0000 7f443b59e700 1 -- 172.21.15.16:0/1046094768 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c071d40 con 0x7f443c15d320 2023-08-25T04:43:47.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.215+0000 7f443a59c700 1 --2- 172.21.15.16:0/1046094768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c0cf970 0x7f443c06a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:47.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.215+0000 7f443b59e700 1 --2- 172.21.15.16:0/1046094768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f443c15d320 0x7f443c06a880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4434009d90 tx=0x7f443400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25490404a42a2058 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:47.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.215+0000 7f4439d9b700 1 -- 172.21.15.16:0/1046094768 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443400e070 con 0x7f443c15d320 2023-08-25T04:43:47.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.215+0000 7f4439d9b700 1 -- 172.21.15.16:0/1046094768 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443400bb20 con 0x7f443c15d320 2023-08-25T04:43:47.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.215+0000 7f4439d9b700 1 -- 172.21.15.16:0/1046094768 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434012430 con 0x7f443c15d320 2023-08-25T04:43:47.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.215+0000 7f4441160700 1 -- 172.21.15.16:0/1046094768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f443c15d320 msgr2=0x7f443c06a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:47.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.215+0000 7f4441160700 1 --2- 172.21.15.16:0/1046094768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f443c15d320 0x7f443c06a880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4434009d90 tx=0x7f443400b330 comp rx=0 tx=0).stop 2023-08-25T04:43:47.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.216+0000 7f4441160700 1 -- 172.21.15.16:0/1046094768 shutdown_connections 2023-08-25T04:43:47.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.216+0000 7f4441160700 1 --2- 172.21.15.16:0/1046094768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f443c15d320 0x7f443c06a880 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.216+0000 7f4441160700 1 --2- 172.21.15.16:0/1046094768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c0cf970 0x7f443c06a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.216+0000 7f4441160700 1 -- 172.21.15.16:0/1046094768 >> 172.21.15.16:0/1046094768 conn(0x7f443c0b1a10 msgr2=0x7f443c0b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:47.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.216+0000 7f4441160700 1 -- 172.21.15.16:0/1046094768 shutdown_connections 2023-08-25T04:43:47.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.216+0000 7f4441160700 1 -- 172.21.15.16:0/1046094768 wait complete. 2023-08-25T04:43:47.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.217+0000 7f4441160700 1 Processor -- start 2023-08-25T04:43:47.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.217+0000 7f4441160700 1 -- start start 2023-08-25T04:43:47.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f4441160700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f443c0cf970 0x7f443c159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:47.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f4441160700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c15cf40 0x7f443c0af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:47.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f4441160700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f443c15d320 0x7f443c0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:47.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f4441160700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c15e890 con 0x7f443c15d320 2023-08-25T04:43:47.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f4441160700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c6400 con 0x7f443c0cf970 2023-08-25T04:43:47.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f4441160700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c15df60 con 0x7f443c15cf40 2023-08-25T04:43:47.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f443b59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f443c15d320 0x7f443c0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:47.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f443b59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f443c15d320 0x7f443c0afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49098/0 (socket says 172.21.15.16:49098) 2023-08-25T04:43:47.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f443b59e700 1 -- 172.21.15.16:0/1380196390 learned_addr learned my addr 172.21.15.16:0/1380196390 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:47.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f443ad9d700 1 --2- 172.21.15.16:0/1380196390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f443c0cf970 0x7f443c159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:47.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f443a59c700 1 --2- 172.21.15.16:0/1380196390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c15cf40 0x7f443c0af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f443b59e700 1 -- 172.21.15.16:0/1380196390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c15cf40 msgr2=0x7f443c0af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f443b59e700 1 --2- 172.21.15.16:0/1380196390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c15cf40 0x7f443c0af8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f443b59e700 1 -- 172.21.15.16:0/1380196390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f443c0cf970 msgr2=0x7f443c159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f443b59e700 1 --2- 172.21.15.16:0/1380196390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f443c0cf970 0x7f443c159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.218+0000 7f443b59e700 1 -- 172.21.15.16:0/1380196390 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c0094a0 con 0x7f443c15d320 2023-08-25T04:43:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.219+0000 7f443b59e700 1 --2- 172.21.15.16:0/1380196390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f443c15d320 0x7f443c0afde0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4434014040 tx=0x7f4434004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.219+0000 7f44237fe700 1 -- 172.21.15.16:0/1380196390 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434012430 con 0x7f443c15d320 2023-08-25T04:43:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.219+0000 7f44237fe700 1 -- 172.21.15.16:0/1380196390 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4434020070 con 0x7f443c15d320 2023-08-25T04:43:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.219+0000 7f44237fe700 1 -- 172.21.15.16:0/1380196390 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434004280 con 0x7f443c15d320 2023-08-25T04:43:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.219+0000 7f4441160700 1 -- 172.21.15.16:0/1380196390 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4434009a70 con 0x7f443c15d320 2023-08-25T04:43:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.219+0000 7f4441160700 1 -- 172.21.15.16:0/1380196390 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c15e520 con 0x7f443c15d320 2023-08-25T04:43:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.220+0000 7f4441160700 1 -- 172.21.15.16:0/1380196390 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443c15ea00 con 0x7f443c15d320 2023-08-25T04:43:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.220+0000 7f44237fe700 1 -- 172.21.15.16:0/1380196390 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f44340043e0 con 0x7f443c15d320 2023-08-25T04:43:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.220+0000 7f44237fe700 1 --2- 172.21.15.16:0/1380196390 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f442806a0e0 0x7f442806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.221+0000 7f44237fe700 1 -- 172.21.15.16:0/1380196390 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4434022070 con 0x7f443c15d320 2023-08-25T04:43:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.221+0000 7f443ad9d700 1 --2- 172.21.15.16:0/1380196390 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f442806a0e0 0x7f442806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.221+0000 7f443ad9d700 1 --2- 172.21.15.16:0/1380196390 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f442806a0e0 0x7f442806c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4430007fd0 tx=0x7f4430009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.225+0000 7f44237fe700 1 -- 172.21.15.16:0/1380196390 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f44340557b0 con 0x7f443c15d320 2023-08-25T04:43:47.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.420+0000 7f4441160700 1 -- 172.21.15.16:0/1380196390 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f443c072020 con 0x7f442806a0e0 2023-08-25T04:43:47.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.428+0000 7f44237fe700 1 -- 172.21.15.16:0/1380196390 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287034 (secure 0 0 0) 0x7f443000f690 con 0x7f442806a0e0 2023-08-25T04:43:47.433 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:47.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.431+0000 7f4441160700 1 -- 172.21.15.16:0/1380196390 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f442806a0e0 msgr2=0x7f442806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:47.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.431+0000 7f4441160700 1 --2- 172.21.15.16:0/1380196390 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f442806a0e0 0x7f442806c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4430007fd0 tx=0x7f4430009040 comp rx=0 tx=0).stop 2023-08-25T04:43:47.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.431+0000 7f4441160700 1 -- 172.21.15.16:0/1380196390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f443c15d320 msgr2=0x7f443c0afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:47.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.431+0000 7f4441160700 1 --2- 172.21.15.16:0/1380196390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f443c15d320 0x7f443c0afde0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4434014040 tx=0x7f4434004ad0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.431+0000 7f4441160700 1 -- 172.21.15.16:0/1380196390 shutdown_connections 2023-08-25T04:43:47.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.431+0000 7f4441160700 1 --2- 172.21.15.16:0/1380196390 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f442806a0e0 0x7f442806c5a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.431+0000 7f4441160700 1 --2- 172.21.15.16:0/1380196390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f443c15d320 0x7f443c0afde0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.431+0000 7f4441160700 1 --2- 172.21.15.16:0/1380196390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f443c0cf970 0x7f443c159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.431+0000 7f4441160700 1 --2- 172.21.15.16:0/1380196390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c15cf40 0x7f443c0af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.431+0000 7f4441160700 1 -- 172.21.15.16:0/1380196390 >> 172.21.15.16:0/1380196390 conn(0x7f443c0b1a10 msgr2=0x7f443c0ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.431+0000 7f4441160700 1 -- 172.21.15.16:0/1380196390 shutdown_connections 2023-08-25T04:43:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.431+0000 7f4441160700 1 -- 172.21.15.16:0/1380196390 wait complete. 2023-08-25T04:43:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-08-25T04:43:47.445 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-25T04:43:47.306783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219076,"kb_used_data":2868,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755644,"statfs":{"total":773094113280,"available":772869779456,"internally_reserved":0,"allocated":2936832,"data_stored":1790775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001616"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327803+0000","last_change":"2023-08-25T04:43:42.895145+0000","last_active":"2023-08-25T04:43:44.327803+0000","last_peered":"2023-08-25T04:43:44.327803+0000","last_clean":"2023-08-25T04:43:44.327803+0000","last_became_active":"2023-08-25T04:43:42.894831+0000","last_became_peered":"2023-08-25T04:43:42.894831+0000","last_unstale":"2023-08-25T04:43:44.327803+0000","last_undegraded":"2023-08-25T04:43:44.327803+0000","last_fullsized":"2023-08-25T04:43:44.327803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:14:14.705163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874604+0000","last_change":"2023-08-25T04:43:42.895503+0000","last_active":"2023-08-25T04:43:43.874604+0000","last_peered":"2023-08-25T04:43:43.874604+0000","last_clean":"2023-08-25T04:43:43.874604+0000","last_became_active":"2023-08-25T04:43:42.895245+0000","last_became_peered":"2023-08-25T04:43:42.895245+0000","last_unstale":"2023-08-25T04:43:43.874604+0000","last_undegraded":"2023-08-25T04:43:43.874604+0000","last_fullsized":"2023-08-25T04:43:43.874604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:15.216169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327984+0000","last_change":"2023-08-25T04:43:42.888920+0000","last_active":"2023-08-25T04:43:44.327984+0000","last_peered":"2023-08-25T04:43:44.327984+0000","last_clean":"2023-08-25T04:43:44.327984+0000","last_became_active":"2023-08-25T04:43:42.888568+0000","last_became_peered":"2023-08-25T04:43:42.888568+0000","last_unstale":"2023-08-25T04:43:44.327984+0000","last_undegraded":"2023-08-25T04:43:44.327984+0000","last_fullsized":"2023-08-25T04:43:44.327984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:16.589145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328061+0000","last_change":"2023-08-25T04:43:42.893868+0000","last_active":"2023-08-25T04:43:44.328061+0000","last_peered":"2023-08-25T04:43:44.328061+0000","last_clean":"2023-08-25T04:43:44.328061+0000","last_became_active":"2023-08-25T04:43:42.893534+0000","last_became_peered":"2023-08-25T04:43:42.893534+0000","last_unstale":"2023-08-25T04:43:44.328061+0000","last_undegraded":"2023-08-25T04:43:44.328061+0000","last_fullsized":"2023-08-25T04:43:44.328061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:31.303608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328282+0000","last_change":"2023-08-25T04:43:42.902297+0000","last_active":"2023-08-25T04:43:44.328282+0000","last_peered":"2023-08-25T04:43:44.328282+0000","last_clean":"2023-08-25T04:43:44.328282+0000","last_became_active":"2023-08-25T04:43:42.901963+0000","last_became_peered":"2023-08-25T04:43:42.901963+0000","last_unstale":"2023-08-25T04:43:44.328282+0000","last_undegraded":"2023-08-25T04:43:44.328282+0000","last_fullsized":"2023-08-25T04:43:44.328282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328304+0000","last_change":"2023-08-25T04:43:42.888877+0000","last_active":"2023-08-25T04:43:44.328304+0000","last_peered":"2023-08-25T04:43:44.328304+0000","last_clean":"2023-08-25T04:43:44.328304+0000","last_became_active":"2023-08-25T04:43:42.888567+0000","last_became_peered":"2023-08-25T04:43:42.888567+0000","last_unstale":"2023-08-25T04:43:44.328304+0000","last_undegraded":"2023-08-25T04:43:44.328304+0000","last_fullsized":"2023-08-25T04:43:44.328304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:32:00.413218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032871+0000","last_change":"2023-08-25T04:43:42.902469+0000","last_active":"2023-08-25T04:43:44.032871+0000","last_peered":"2023-08-25T04:43:44.032871+0000","last_clean":"2023-08-25T04:43:44.032871+0000","last_became_active":"2023-08-25T04:43:42.902156+0000","last_became_peered":"2023-08-25T04:43:42.902156+0000","last_unstale":"2023-08-25T04:43:44.032871+0000","last_undegraded":"2023-08-25T04:43:44.032871+0000","last_fullsized":"2023-08-25T04:43:44.032871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874207+0000","last_change":"2023-08-25T04:43:42.895697+0000","last_active":"2023-08-25T04:43:43.874207+0000","last_peered":"2023-08-25T04:43:43.874207+0000","last_clean":"2023-08-25T04:43:43.874207+0000","last_became_active":"2023-08-25T04:43:42.895410+0000","last_became_peered":"2023-08-25T04:43:42.895410+0000","last_unstale":"2023-08-25T04:43:43.874207+0000","last_undegraded":"2023-08-25T04:43:43.874207+0000","last_fullsized":"2023-08-25T04:43:43.874207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:31.303608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327641+0000","last_change":"2023-08-25T04:43:42.897483+0000","last_active":"2023-08-25T04:43:44.327641+0000","last_peered":"2023-08-25T04:43:44.327641+0000","last_clean":"2023-08-25T04:43:44.327641+0000","last_became_active":"2023-08-25T04:43:42.896949+0000","last_became_peered":"2023-08-25T04:43:42.896949+0000","last_unstale":"2023-08-25T04:43:44.327641+0000","last_undegraded":"2023-08-25T04:43:44.327641+0000","last_fullsized":"2023-08-25T04:43:44.327641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:31:35.265544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874624+0000","last_change":"2023-08-25T04:43:42.895115+0000","last_active":"2023-08-25T04:43:43.874624+0000","last_peered":"2023-08-25T04:43:43.874624+0000","last_clean":"2023-08-25T04:43:43.874624+0000","last_became_active":"2023-08-25T04:43:42.894786+0000","last_became_peered":"2023-08-25T04:43:42.894786+0000","last_unstale":"2023-08-25T04:43:43.874624+0000","last_undegraded":"2023-08-25T04:43:43.874624+0000","last_fullsized":"2023-08-25T04:43:43.874624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:25.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328212+0000","last_change":"2023-08-25T04:43:42.892793+0000","last_active":"2023-08-25T04:43:44.328212+0000","last_peered":"2023-08-25T04:43:44.328212+0000","last_clean":"2023-08-25T04:43:44.328212+0000","last_became_active":"2023-08-25T04:43:42.892558+0000","last_became_peered":"2023-08-25T04:43:42.892558+0000","last_unstale":"2023-08-25T04:43:44.328212+0000","last_undegraded":"2023-08-25T04:43:44.328212+0000","last_fullsized":"2023-08-25T04:43:44.328212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:03.096619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327734+0000","last_change":"2023-08-25T04:43:42.892113+0000","last_active":"2023-08-25T04:43:44.327734+0000","last_peered":"2023-08-25T04:43:44.327734+0000","last_clean":"2023-08-25T04:43:44.327734+0000","last_became_active":"2023-08-25T04:43:42.891782+0000","last_became_peered":"2023-08-25T04:43:42.891782+0000","last_unstale":"2023-08-25T04:43:44.327734+0000","last_undegraded":"2023-08-25T04:43:44.327734+0000","last_fullsized":"2023-08-25T04:43:44.327734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:24:49.974531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327765+0000","last_change":"2023-08-25T04:43:42.896635+0000","last_active":"2023-08-25T04:43:44.327765+0000","last_peered":"2023-08-25T04:43:44.327765+0000","last_clean":"2023-08-25T04:43:44.327765+0000","last_became_active":"2023-08-25T04:43:42.896334+0000","last_became_peered":"2023-08-25T04:43:42.896334+0000","last_unstale":"2023-08-25T04:43:44.327765+0000","last_undegraded":"2023-08-25T04:43:44.327765+0000","last_fullsized":"2023-08-25T04:43:44.327765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:56:24.754587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874371+0000","last_change":"2023-08-25T04:43:42.894765+0000","last_active":"2023-08-25T04:43:43.874371+0000","last_peered":"2023-08-25T04:43:43.874371+0000","last_clean":"2023-08-25T04:43:43.874371+0000","last_became_active":"2023-08-25T04:43:42.894472+0000","last_became_peered":"2023-08-25T04:43:42.894472+0000","last_unstale":"2023-08-25T04:43:43.874371+0000","last_undegraded":"2023-08-25T04:43:43.874371+0000","last_fullsized":"2023-08-25T04:43:43.874371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:10.669970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033055+0000","last_change":"2023-08-25T04:43:42.902458+0000","last_active":"2023-08-25T04:43:44.033055+0000","last_peered":"2023-08-25T04:43:44.033055+0000","last_clean":"2023-08-25T04:43:44.033055+0000","last_became_active":"2023-08-25T04:43:42.902184+0000","last_became_peered":"2023-08-25T04:43:42.902184+0000","last_unstale":"2023-08-25T04:43:44.033055+0000","last_undegraded":"2023-08-25T04:43:44.033055+0000","last_fullsized":"2023-08-25T04:43:44.033055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:14.283818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327581+0000","last_change":"2023-08-25T04:43:42.889087+0000","last_active":"2023-08-25T04:43:44.327581+0000","last_peered":"2023-08-25T04:43:44.327581+0000","last_clean":"2023-08-25T04:43:44.327581+0000","last_became_active":"2023-08-25T04:43:42.888730+0000","last_became_peered":"2023-08-25T04:43:42.888730+0000","last_unstale":"2023-08-25T04:43:44.327581+0000","last_undegraded":"2023-08-25T04:43:44.327581+0000","last_fullsized":"2023-08-25T04:43:44.327581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327697+0000","last_change":"2023-08-25T04:43:42.898466+0000","last_active":"2023-08-25T04:43:44.327697+0000","last_peered":"2023-08-25T04:43:44.327697+0000","last_clean":"2023-08-25T04:43:44.327697+0000","last_became_active":"2023-08-25T04:43:42.898103+0000","last_became_peered":"2023-08-25T04:43:42.898103+0000","last_unstale":"2023-08-25T04:43:44.327697+0000","last_undegraded":"2023-08-25T04:43:44.327697+0000","last_fullsized":"2023-08-25T04:43:44.327697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.713590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328356+0000","last_change":"2023-08-25T04:43:42.892153+0000","last_active":"2023-08-25T04:43:44.328356+0000","last_peered":"2023-08-25T04:43:44.328356+0000","last_clean":"2023-08-25T04:43:44.328356+0000","last_became_active":"2023-08-25T04:43:42.891874+0000","last_became_peered":"2023-08-25T04:43:42.891874+0000","last_unstale":"2023-08-25T04:43:44.328356+0000","last_undegraded":"2023-08-25T04:43:44.328356+0000","last_fullsized":"2023-08-25T04:43:44.328356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:23:15.219642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327457+0000","last_change":"2023-08-25T04:43:42.895594+0000","last_active":"2023-08-25T04:43:44.327457+0000","last_peered":"2023-08-25T04:43:44.327457+0000","last_clean":"2023-08-25T04:43:44.327457+0000","last_became_active":"2023-08-25T04:43:42.895114+0000","last_became_peered":"2023-08-25T04:43:42.895114+0000","last_unstale":"2023-08-25T04:43:44.327457+0000","last_undegraded":"2023-08-25T04:43:44.327457+0000","last_fullsized":"2023-08-25T04:43:44.327457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:16:14.273348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328271+0000","last_change":"2023-08-25T04:43:42.896149+0000","last_active":"2023-08-25T04:43:44.328271+0000","last_peered":"2023-08-25T04:43:44.328271+0000","last_clean":"2023-08-25T04:43:44.328271+0000","last_became_active":"2023-08-25T04:43:42.895893+0000","last_became_peered":"2023-08-25T04:43:42.895893+0000","last_unstale":"2023-08-25T04:43:44.328271+0000","last_undegraded":"2023-08-25T04:43:44.328271+0000","last_fullsized":"2023-08-25T04:43:44.328271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:40.101990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033178+0000","last_change":"2023-08-25T04:43:42.905467+0000","last_active":"2023-08-25T04:43:44.033178+0000","last_peered":"2023-08-25T04:43:44.033178+0000","last_clean":"2023-08-25T04:43:44.033178+0000","last_became_active":"2023-08-25T04:43:42.905157+0000","last_became_peered":"2023-08-25T04:43:42.905157+0000","last_unstale":"2023-08-25T04:43:44.033178+0000","last_undegraded":"2023-08-25T04:43:44.033178+0000","last_fullsized":"2023-08-25T04:43:44.033178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:27.309119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327693+0000","last_change":"2023-08-25T04:43:42.881107+0000","last_active":"2023-08-25T04:43:44.327693+0000","last_peered":"2023-08-25T04:43:44.327693+0000","last_clean":"2023-08-25T04:43:44.327693+0000","last_became_active":"2023-08-25T04:43:42.879881+0000","last_became_peered":"2023-08-25T04:43:42.879881+0000","last_unstale":"2023-08-25T04:43:44.327693+0000","last_undegraded":"2023-08-25T04:43:44.327693+0000","last_fullsized":"2023-08-25T04:43:44.327693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:31.030985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874763+0000","last_change":"2023-08-25T04:43:42.899035+0000","last_active":"2023-08-25T04:43:43.874763+0000","last_peered":"2023-08-25T04:43:43.874763+0000","last_clean":"2023-08-25T04:43:43.874763+0000","last_became_active":"2023-08-25T04:43:42.898723+0000","last_became_peered":"2023-08-25T04:43:42.898723+0000","last_unstale":"2023-08-25T04:43:43.874763+0000","last_undegraded":"2023-08-25T04:43:43.874763+0000","last_fullsized":"2023-08-25T04:43:43.874763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:15.216169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032883+0000","last_change":"2023-08-25T04:43:42.897136+0000","last_active":"2023-08-25T04:43:44.032883+0000","last_peered":"2023-08-25T04:43:44.032883+0000","last_clean":"2023-08-25T04:43:44.032883+0000","last_became_active":"2023-08-25T04:43:42.896869+0000","last_became_peered":"2023-08-25T04:43:42.896869+0000","last_unstale":"2023-08-25T04:43:44.032883+0000","last_undegraded":"2023-08-25T04:43:44.032883+0000","last_fullsized":"2023-08-25T04:43:44.032883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873831+0000","last_change":"2023-08-25T04:43:42.893954+0000","last_active":"2023-08-25T04:43:43.873831+0000","last_peered":"2023-08-25T04:43:43.873831+0000","last_clean":"2023-08-25T04:43:43.873831+0000","last_became_active":"2023-08-25T04:43:42.893673+0000","last_became_peered":"2023-08-25T04:43:42.893673+0000","last_unstale":"2023-08-25T04:43:43.873831+0000","last_undegraded":"2023-08-25T04:43:43.873831+0000","last_fullsized":"2023-08-25T04:43:43.873831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:10.669970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873872+0000","last_change":"2023-08-25T04:43:42.888116+0000","last_active":"2023-08-25T04:43:43.873872+0000","last_peered":"2023-08-25T04:43:43.873872+0000","last_clean":"2023-08-25T04:43:43.873872+0000","last_became_active":"2023-08-25T04:43:42.887831+0000","last_became_peered":"2023-08-25T04:43:42.887831+0000","last_unstale":"2023-08-25T04:43:43.873872+0000","last_undegraded":"2023-08-25T04:43:43.873872+0000","last_fullsized":"2023-08-25T04:43:43.873872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:38.406155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874487+0000","last_change":"2023-08-25T04:43:42.894954+0000","last_active":"2023-08-25T04:43:43.874487+0000","last_peered":"2023-08-25T04:43:43.874487+0000","last_clean":"2023-08-25T04:43:43.874487+0000","last_became_active":"2023-08-25T04:43:42.894302+0000","last_became_peered":"2023-08-25T04:43:42.894302+0000","last_unstale":"2023-08-25T04:43:43.874487+0000","last_undegraded":"2023-08-25T04:43:43.874487+0000","last_fullsized":"2023-08-25T04:43:43.874487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:49.188528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328143+0000","last_change":"2023-08-25T04:43:41.888584+0000","last_active":"2023-08-25T04:43:44.328143+0000","last_peered":"2023-08-25T04:43:44.328143+0000","last_clean":"2023-08-25T04:43:44.328143+0000","last_became_active":"2023-08-25T04:43:41.888339+0000","last_became_peered":"2023-08-25T04:43:41.888339+0000","last_unstale":"2023-08-25T04:43:44.328143+0000","last_undegraded":"2023-08-25T04:43:44.328143+0000","last_fullsized":"2023-08-25T04:43:44.328143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:17.587860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874994+0000","last_change":"2023-08-25T04:43:42.897739+0000","last_active":"2023-08-25T04:43:43.874994+0000","last_peered":"2023-08-25T04:43:43.874994+0000","last_clean":"2023-08-25T04:43:43.874994+0000","last_became_active":"2023-08-25T04:43:42.897425+0000","last_became_peered":"2023-08-25T04:43:42.897425+0000","last_unstale":"2023-08-25T04:43:43.874994+0000","last_undegraded":"2023-08-25T04:43:43.874994+0000","last_fullsized":"2023-08-25T04:43:43.874994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873410+0000","last_change":"2023-08-25T04:43:41.886122+0000","last_active":"2023-08-25T04:43:43.873410+0000","last_peered":"2023-08-25T04:43:43.873410+0000","last_clean":"2023-08-25T04:43:43.873410+0000","last_became_active":"2023-08-25T04:43:41.885184+0000","last_became_peered":"2023-08-25T04:43:41.885184+0000","last_unstale":"2023-08-25T04:43:43.873410+0000","last_undegraded":"2023-08-25T04:43:43.873410+0000","last_fullsized":"2023-08-25T04:43:43.873410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:30.025865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328069+0000","last_change":"2023-08-25T04:43:42.890854+0000","last_active":"2023-08-25T04:43:44.328069+0000","last_peered":"2023-08-25T04:43:44.328069+0000","last_clean":"2023-08-25T04:43:44.328069+0000","last_became_active":"2023-08-25T04:43:42.890575+0000","last_became_peered":"2023-08-25T04:43:42.890575+0000","last_unstale":"2023-08-25T04:43:44.328069+0000","last_undegraded":"2023-08-25T04:43:44.328069+0000","last_fullsized":"2023-08-25T04:43:44.328069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:49.188528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874877+0000","last_change":"2023-08-25T04:43:41.885567+0000","last_active":"2023-08-25T04:43:43.874877+0000","last_peered":"2023-08-25T04:43:43.874877+0000","last_clean":"2023-08-25T04:43:43.874877+0000","last_became_active":"2023-08-25T04:43:41.885299+0000","last_became_peered":"2023-08-25T04:43:41.885299+0000","last_unstale":"2023-08-25T04:43:43.874877+0000","last_undegraded":"2023-08-25T04:43:43.874877+0000","last_fullsized":"2023-08-25T04:43:43.874877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:19.036840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328008+0000","last_change":"2023-08-25T04:43:42.899190+0000","last_active":"2023-08-25T04:43:44.328008+0000","last_peered":"2023-08-25T04:43:44.328008+0000","last_clean":"2023-08-25T04:43:44.328008+0000","last_became_active":"2023-08-25T04:43:42.898874+0000","last_became_peered":"2023-08-25T04:43:42.898874+0000","last_unstale":"2023-08-25T04:43:44.328008+0000","last_undegraded":"2023-08-25T04:43:44.328008+0000","last_fullsized":"2023-08-25T04:43:44.328008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.713590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327795+0000","last_change":"2023-08-25T04:43:41.883055+0000","last_active":"2023-08-25T04:43:44.327795+0000","last_peered":"2023-08-25T04:43:44.327795+0000","last_clean":"2023-08-25T04:43:44.327795+0000","last_became_active":"2023-08-25T04:43:41.882381+0000","last_became_peered":"2023-08-25T04:43:41.882381+0000","last_unstale":"2023-08-25T04:43:44.327795+0000","last_undegraded":"2023-08-25T04:43:44.327795+0000","last_fullsized":"2023-08-25T04:43:44.327795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:30.298488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874811+0000","last_change":"2023-08-25T04:43:42.897118+0000","last_active":"2023-08-25T04:43:43.874811+0000","last_peered":"2023-08-25T04:43:43.874811+0000","last_clean":"2023-08-25T04:43:43.874811+0000","last_became_active":"2023-08-25T04:43:42.896817+0000","last_became_peered":"2023-08-25T04:43:42.896817+0000","last_unstale":"2023-08-25T04:43:43.874811+0000","last_undegraded":"2023-08-25T04:43:43.874811+0000","last_fullsized":"2023-08-25T04:43:43.874811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874464+0000","last_change":"2023-08-25T04:43:41.882339+0000","last_active":"2023-08-25T04:43:43.874464+0000","last_peered":"2023-08-25T04:43:43.874464+0000","last_clean":"2023-08-25T04:43:43.874464+0000","last_became_active":"2023-08-25T04:43:41.882055+0000","last_became_peered":"2023-08-25T04:43:41.882055+0000","last_unstale":"2023-08-25T04:43:43.874464+0000","last_undegraded":"2023-08-25T04:43:43.874464+0000","last_fullsized":"2023-08-25T04:43:43.874464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:58:07.396227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875270+0000","last_change":"2023-08-25T04:43:42.891741+0000","last_active":"2023-08-25T04:43:43.875270+0000","last_peered":"2023-08-25T04:43:43.875270+0000","last_clean":"2023-08-25T04:43:43.875270+0000","last_became_active":"2023-08-25T04:43:42.890100+0000","last_became_peered":"2023-08-25T04:43:42.890100+0000","last_unstale":"2023-08-25T04:43:43.875270+0000","last_undegraded":"2023-08-25T04:43:43.875270+0000","last_fullsized":"2023-08-25T04:43:43.875270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:03.096619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033307+0000","last_change":"2023-08-25T04:43:41.887924+0000","last_active":"2023-08-25T04:43:44.033307+0000","last_peered":"2023-08-25T04:43:44.033307+0000","last_clean":"2023-08-25T04:43:44.033307+0000","last_became_active":"2023-08-25T04:43:41.887622+0000","last_became_peered":"2023-08-25T04:43:41.887622+0000","last_unstale":"2023-08-25T04:43:44.033307+0000","last_undegraded":"2023-08-25T04:43:44.033307+0000","last_fullsized":"2023-08-25T04:43:44.033307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:26.261202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873335+0000","last_change":"2023-08-25T04:43:42.891006+0000","last_active":"2023-08-25T04:43:43.873335+0000","last_peered":"2023-08-25T04:43:43.873335+0000","last_clean":"2023-08-25T04:43:43.873335+0000","last_became_active":"2023-08-25T04:43:42.890648+0000","last_became_peered":"2023-08-25T04:43:42.890648+0000","last_unstale":"2023-08-25T04:43:43.873335+0000","last_undegraded":"2023-08-25T04:43:43.873335+0000","last_fullsized":"2023-08-25T04:43:43.873335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:03.819785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328264+0000","last_change":"2023-08-25T04:43:41.887033+0000","last_active":"2023-08-25T04:43:44.328264+0000","last_peered":"2023-08-25T04:43:44.328264+0000","last_clean":"2023-08-25T04:43:44.328264+0000","last_became_active":"2023-08-25T04:43:41.886491+0000","last_became_peered":"2023-08-25T04:43:41.886491+0000","last_unstale":"2023-08-25T04:43:44.328264+0000","last_undegraded":"2023-08-25T04:43:44.328264+0000","last_fullsized":"2023-08-25T04:43:44.328264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:58:33.572888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328258+0000","last_change":"2023-08-25T04:43:42.893709+0000","last_active":"2023-08-25T04:43:44.328258+0000","last_peered":"2023-08-25T04:43:44.328258+0000","last_clean":"2023-08-25T04:43:44.328258+0000","last_became_active":"2023-08-25T04:43:42.893525+0000","last_became_peered":"2023-08-25T04:43:42.893525+0000","last_unstale":"2023-08-25T04:43:44.328258+0000","last_undegraded":"2023-08-25T04:43:44.328258+0000","last_fullsized":"2023-08-25T04:43:44.328258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:58:52.209554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033093+0000","last_change":"2023-08-25T04:43:41.890946+0000","last_active":"2023-08-25T04:43:44.033093+0000","last_peered":"2023-08-25T04:43:44.033093+0000","last_clean":"2023-08-25T04:43:44.033093+0000","last_became_active":"2023-08-25T04:43:41.890673+0000","last_became_peered":"2023-08-25T04:43:41.890673+0000","last_unstale":"2023-08-25T04:43:44.033093+0000","last_undegraded":"2023-08-25T04:43:44.033093+0000","last_fullsized":"2023-08-25T04:43:44.033093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:38.571968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875163+0000","last_change":"2023-08-25T04:43:42.897809+0000","last_active":"2023-08-25T04:43:43.875163+0000","last_peered":"2023-08-25T04:43:43.875163+0000","last_clean":"2023-08-25T04:43:43.875163+0000","last_became_active":"2023-08-25T04:43:42.897204+0000","last_became_peered":"2023-08-25T04:43:42.897204+0000","last_unstale":"2023-08-25T04:43:43.875163+0000","last_undegraded":"2023-08-25T04:43:43.875163+0000","last_fullsized":"2023-08-25T04:43:43.875163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:27.309119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327671+0000","last_change":"2023-08-25T04:43:41.881387+0000","last_active":"2023-08-25T04:43:44.327671+0000","last_peered":"2023-08-25T04:43:44.327671+0000","last_clean":"2023-08-25T04:43:44.327671+0000","last_became_active":"2023-08-25T04:43:41.881067+0000","last_became_peered":"2023-08-25T04:43:41.881067+0000","last_unstale":"2023-08-25T04:43:44.327671+0000","last_undegraded":"2023-08-25T04:43:44.327671+0000","last_fullsized":"2023-08-25T04:43:44.327671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:34:36.120848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874683+0000","last_change":"2023-08-25T04:43:42.895088+0000","last_active":"2023-08-25T04:43:43.874683+0000","last_peered":"2023-08-25T04:43:43.874683+0000","last_clean":"2023-08-25T04:43:43.874683+0000","last_became_active":"2023-08-25T04:43:42.894807+0000","last_became_peered":"2023-08-25T04:43:42.894807+0000","last_unstale":"2023-08-25T04:43:43.874683+0000","last_undegraded":"2023-08-25T04:43:43.874683+0000","last_fullsized":"2023-08-25T04:43:43.874683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032938+0000","last_change":"2023-08-25T04:43:41.890995+0000","last_active":"2023-08-25T04:43:44.032938+0000","last_peered":"2023-08-25T04:43:44.032938+0000","last_clean":"2023-08-25T04:43:44.032938+0000","last_became_active":"2023-08-25T04:43:41.890706+0000","last_became_peered":"2023-08-25T04:43:41.890706+0000","last_unstale":"2023-08-25T04:43:44.032938+0000","last_undegraded":"2023-08-25T04:43:44.032938+0000","last_fullsized":"2023-08-25T04:43:44.032938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327738+0000","last_change":"2023-08-25T04:43:42.897775+0000","last_active":"2023-08-25T04:43:44.327738+0000","last_peered":"2023-08-25T04:43:44.327738+0000","last_clean":"2023-08-25T04:43:44.327738+0000","last_became_active":"2023-08-25T04:43:42.897476+0000","last_became_peered":"2023-08-25T04:43:42.897476+0000","last_unstale":"2023-08-25T04:43:44.327738+0000","last_undegraded":"2023-08-25T04:43:44.327738+0000","last_fullsized":"2023-08-25T04:43:44.327738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:03.819785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327483+0000","last_change":"2023-08-25T04:43:41.892829+0000","last_active":"2023-08-25T04:43:44.327483+0000","last_peered":"2023-08-25T04:43:44.327483+0000","last_clean":"2023-08-25T04:43:44.327483+0000","last_became_active":"2023-08-25T04:43:41.892517+0000","last_became_peered":"2023-08-25T04:43:41.892517+0000","last_unstale":"2023-08-25T04:43:44.327483+0000","last_undegraded":"2023-08-25T04:43:44.327483+0000","last_fullsized":"2023-08-25T04:43:44.327483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:40:01.170031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875239+0000","last_change":"2023-08-25T04:43:42.905276+0000","last_active":"2023-08-25T04:43:43.875239+0000","last_peered":"2023-08-25T04:43:43.875239+0000","last_clean":"2023-08-25T04:43:43.875239+0000","last_became_active":"2023-08-25T04:43:42.904736+0000","last_became_peered":"2023-08-25T04:43:42.904736+0000","last_unstale":"2023-08-25T04:43:43.875239+0000","last_undegraded":"2023-08-25T04:43:43.875239+0000","last_fullsized":"2023-08-25T04:43:43.875239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:18.592980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033419+0000","last_change":"2023-08-25T04:43:41.891246+0000","last_active":"2023-08-25T04:43:44.033419+0000","last_peered":"2023-08-25T04:43:44.033419+0000","last_clean":"2023-08-25T04:43:44.033419+0000","last_became_active":"2023-08-25T04:43:41.890942+0000","last_became_peered":"2023-08-25T04:43:41.890942+0000","last_unstale":"2023-08-25T04:43:44.033419+0000","last_undegraded":"2023-08-25T04:43:44.033419+0000","last_fullsized":"2023-08-25T04:43:44.033419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:39.096870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874433+0000","last_change":"2023-08-25T04:43:42.895071+0000","last_active":"2023-08-25T04:43:43.874433+0000","last_peered":"2023-08-25T04:43:43.874433+0000","last_clean":"2023-08-25T04:43:43.874433+0000","last_became_active":"2023-08-25T04:43:42.894285+0000","last_became_peered":"2023-08-25T04:43:42.894285+0000","last_unstale":"2023-08-25T04:43:43.874433+0000","last_undegraded":"2023-08-25T04:43:43.874433+0000","last_fullsized":"2023-08-25T04:43:43.874433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:49.534369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033324+0000","last_change":"2023-08-25T04:43:41.891175+0000","last_active":"2023-08-25T04:43:44.033324+0000","last_peered":"2023-08-25T04:43:44.033324+0000","last_clean":"2023-08-25T04:43:44.033324+0000","last_became_active":"2023-08-25T04:43:41.890883+0000","last_became_peered":"2023-08-25T04:43:41.890883+0000","last_unstale":"2023-08-25T04:43:44.033324+0000","last_undegraded":"2023-08-25T04:43:44.033324+0000","last_fullsized":"2023-08-25T04:43:44.033324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:02.091499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327753+0000","last_change":"2023-08-25T04:43:42.891686+0000","last_active":"2023-08-25T04:43:44.327753+0000","last_peered":"2023-08-25T04:43:44.327753+0000","last_clean":"2023-08-25T04:43:44.327753+0000","last_became_active":"2023-08-25T04:43:42.891443+0000","last_became_peered":"2023-08-25T04:43:42.891443+0000","last_unstale":"2023-08-25T04:43:44.327753+0000","last_undegraded":"2023-08-25T04:43:44.327753+0000","last_fullsized":"2023-08-25T04:43:44.327753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033233+0000","last_change":"2023-08-25T04:43:41.888723+0000","last_active":"2023-08-25T04:43:44.033233+0000","last_peered":"2023-08-25T04:43:44.033233+0000","last_clean":"2023-08-25T04:43:44.033233+0000","last_became_active":"2023-08-25T04:43:41.888447+0000","last_became_peered":"2023-08-25T04:43:41.888447+0000","last_unstale":"2023-08-25T04:43:44.033233+0000","last_undegraded":"2023-08-25T04:43:44.033233+0000","last_fullsized":"2023-08-25T04:43:44.033233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:17.587860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328252+0000","last_change":"2023-08-25T04:43:42.892447+0000","last_active":"2023-08-25T04:43:44.328252+0000","last_peered":"2023-08-25T04:43:44.328252+0000","last_clean":"2023-08-25T04:43:44.328252+0000","last_became_active":"2023-08-25T04:43:42.892191+0000","last_became_peered":"2023-08-25T04:43:42.892191+0000","last_unstale":"2023-08-25T04:43:44.328252+0000","last_undegraded":"2023-08-25T04:43:44.328252+0000","last_fullsized":"2023-08-25T04:43:44.328252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:26.162949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874646+0000","last_change":"2023-08-25T04:43:41.884395+0000","last_active":"2023-08-25T04:43:43.874646+0000","last_peered":"2023-08-25T04:43:43.874646+0000","last_clean":"2023-08-25T04:43:43.874646+0000","last_became_active":"2023-08-25T04:43:41.884098+0000","last_became_peered":"2023-08-25T04:43:41.884098+0000","last_unstale":"2023-08-25T04:43:43.874646+0000","last_undegraded":"2023-08-25T04:43:43.874646+0000","last_fullsized":"2023-08-25T04:43:43.874646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:26.896561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328035+0000","last_change":"2023-08-25T04:43:42.881050+0000","last_active":"2023-08-25T04:43:44.328035+0000","last_peered":"2023-08-25T04:43:44.328035+0000","last_clean":"2023-08-25T04:43:44.328035+0000","last_became_active":"2023-08-25T04:43:42.880104+0000","last_became_peered":"2023-08-25T04:43:42.880104+0000","last_unstale":"2023-08-25T04:43:44.328035+0000","last_undegraded":"2023-08-25T04:43:44.328035+0000","last_fullsized":"2023-08-25T04:43:44.328035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:38.406155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875014+0000","last_change":"2023-08-25T04:43:41.885729+0000","last_active":"2023-08-25T04:43:43.875014+0000","last_peered":"2023-08-25T04:43:43.875014+0000","last_clean":"2023-08-25T04:43:43.875014+0000","last_became_active":"2023-08-25T04:43:41.885433+0000","last_became_peered":"2023-08-25T04:43:41.885433+0000","last_unstale":"2023-08-25T04:43:43.875014+0000","last_undegraded":"2023-08-25T04:43:43.875014+0000","last_fullsized":"2023-08-25T04:43:43.875014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:40.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328082+0000","last_change":"2023-08-25T04:43:42.896701+0000","last_active":"2023-08-25T04:43:44.328082+0000","last_peered":"2023-08-25T04:43:44.328082+0000","last_clean":"2023-08-25T04:43:44.328082+0000","last_became_active":"2023-08-25T04:43:42.896440+0000","last_became_peered":"2023-08-25T04:43:42.896440+0000","last_unstale":"2023-08-25T04:43:44.328082+0000","last_undegraded":"2023-08-25T04:43:44.328082+0000","last_fullsized":"2023-08-25T04:43:44.328082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:27.309119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328105+0000","last_change":"2023-08-25T04:43:41.891087+0000","last_active":"2023-08-25T04:43:44.328105+0000","last_peered":"2023-08-25T04:43:44.328105+0000","last_clean":"2023-08-25T04:43:44.328105+0000","last_became_active":"2023-08-25T04:43:41.890827+0000","last_became_peered":"2023-08-25T04:43:41.890827+0000","last_unstale":"2023-08-25T04:43:44.328105+0000","last_undegraded":"2023-08-25T04:43:44.328105+0000","last_fullsized":"2023-08-25T04:43:44.328105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:02.814665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328450+0000","last_change":"2023-08-25T04:43:42.897377+0000","last_active":"2023-08-25T04:43:44.328450+0000","last_peered":"2023-08-25T04:43:44.328450+0000","last_clean":"2023-08-25T04:43:44.328450+0000","last_became_active":"2023-08-25T04:43:42.897108+0000","last_became_peered":"2023-08-25T04:43:42.897108+0000","last_unstale":"2023-08-25T04:43:44.328450+0000","last_undegraded":"2023-08-25T04:43:44.328450+0000","last_fullsized":"2023-08-25T04:43:44.328450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:46:27.979648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327909+0000","last_change":"2023-08-25T04:43:41.888568+0000","last_active":"2023-08-25T04:43:44.327909+0000","last_peered":"2023-08-25T04:43:44.327909+0000","last_clean":"2023-08-25T04:43:44.327909+0000","last_became_active":"2023-08-25T04:43:41.888323+0000","last_became_peered":"2023-08-25T04:43:41.888323+0000","last_unstale":"2023-08-25T04:43:44.327909+0000","last_undegraded":"2023-08-25T04:43:44.327909+0000","last_fullsized":"2023-08-25T04:43:44.327909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:40.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328447+0000","last_change":"2023-08-25T04:43:42.897222+0000","last_active":"2023-08-25T04:43:44.328447+0000","last_peered":"2023-08-25T04:43:44.328447+0000","last_clean":"2023-08-25T04:43:44.328447+0000","last_became_active":"2023-08-25T04:43:42.896943+0000","last_became_peered":"2023-08-25T04:43:42.896943+0000","last_unstale":"2023-08-25T04:43:44.328447+0000","last_undegraded":"2023-08-25T04:43:44.328447+0000","last_fullsized":"2023-08-25T04:43:44.328447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:55.675283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874734+0000","last_change":"2023-08-25T04:43:41.887489+0000","last_active":"2023-08-25T04:43:43.874734+0000","last_peered":"2023-08-25T04:43:43.874734+0000","last_clean":"2023-08-25T04:43:43.874734+0000","last_became_active":"2023-08-25T04:43:41.886846+0000","last_became_peered":"2023-08-25T04:43:41.886846+0000","last_unstale":"2023-08-25T04:43:43.874734+0000","last_undegraded":"2023-08-25T04:43:43.874734+0000","last_fullsized":"2023-08-25T04:43:43.874734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:48.183408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874023+0000","last_change":"2023-08-25T04:43:42.903030+0000","last_active":"2023-08-25T04:43:43.874023+0000","last_peered":"2023-08-25T04:43:43.874023+0000","last_clean":"2023-08-25T04:43:43.874023+0000","last_became_active":"2023-08-25T04:43:42.902123+0000","last_became_peered":"2023-08-25T04:43:42.902123+0000","last_unstale":"2023-08-25T04:43:43.874023+0000","last_undegraded":"2023-08-25T04:43:43.874023+0000","last_fullsized":"2023-08-25T04:43:43.874023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:15.216169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875024+0000","last_change":"2023-08-25T04:43:41.883173+0000","last_active":"2023-08-25T04:43:43.875024+0000","last_peered":"2023-08-25T04:43:43.875024+0000","last_clean":"2023-08-25T04:43:43.875024+0000","last_became_active":"2023-08-25T04:43:41.882776+0000","last_became_peered":"2023-08-25T04:43:41.882776+0000","last_unstale":"2023-08-25T04:43:43.875024+0000","last_undegraded":"2023-08-25T04:43:43.875024+0000","last_fullsized":"2023-08-25T04:43:43.875024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328156+0000","last_change":"2023-08-25T04:43:36.786045+0000","last_active":"2023-08-25T04:43:44.328156+0000","last_peered":"2023-08-25T04:43:44.328156+0000","last_clean":"2023-08-25T04:43:44.328156+0000","last_became_active":"2023-08-25T04:43:36.785725+0000","last_became_peered":"2023-08-25T04:43:36.785725+0000","last_unstale":"2023-08-25T04:43:44.328156+0000","last_undegraded":"2023-08-25T04:43:44.328156+0000","last_fullsized":"2023-08-25T04:43:44.328156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:21.173873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874659+0000","last_change":"2023-08-25T04:43:42.890044+0000","last_active":"2023-08-25T04:43:43.874659+0000","last_peered":"2023-08-25T04:43:43.874659+0000","last_clean":"2023-08-25T04:43:43.874659+0000","last_became_active":"2023-08-25T04:43:42.889721+0000","last_became_peered":"2023-08-25T04:43:42.889721+0000","last_unstale":"2023-08-25T04:43:43.874659+0000","last_undegraded":"2023-08-25T04:43:43.874659+0000","last_fullsized":"2023-08-25T04:43:43.874659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:38.406155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875215+0000","last_change":"2023-08-25T04:43:36.782928+0000","last_active":"2023-08-25T04:43:43.875215+0000","last_peered":"2023-08-25T04:43:43.875215+0000","last_clean":"2023-08-25T04:43:43.875215+0000","last_became_active":"2023-08-25T04:43:36.782680+0000","last_became_peered":"2023-08-25T04:43:36.782680+0000","last_unstale":"2023-08-25T04:43:43.875215+0000","last_undegraded":"2023-08-25T04:43:43.875215+0000","last_fullsized":"2023-08-25T04:43:43.875215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:34.009540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328180+0000","last_change":"2023-08-25T04:43:41.888878+0000","last_active":"2023-08-25T04:43:44.328180+0000","last_peered":"2023-08-25T04:43:44.328180+0000","last_clean":"2023-08-25T04:43:44.328180+0000","last_became_active":"2023-08-25T04:43:41.885363+0000","last_became_peered":"2023-08-25T04:43:41.885363+0000","last_unstale":"2023-08-25T04:43:44.328180+0000","last_undegraded":"2023-08-25T04:43:44.328180+0000","last_fullsized":"2023-08-25T04:43:44.328180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:14.211049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328061+0000","last_change":"2023-08-25T04:43:42.899201+0000","last_active":"2023-08-25T04:43:44.328061+0000","last_peered":"2023-08-25T04:43:44.328061+0000","last_clean":"2023-08-25T04:43:44.328061+0000","last_became_active":"2023-08-25T04:43:42.898942+0000","last_became_peered":"2023-08-25T04:43:42.898942+0000","last_unstale":"2023-08-25T04:43:44.328061+0000","last_undegraded":"2023-08-25T04:43:44.328061+0000","last_fullsized":"2023-08-25T04:43:44.328061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:39.577088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873470+0000","last_change":"2023-08-25T04:43:36.785266+0000","last_active":"2023-08-25T04:43:43.873470+0000","last_peered":"2023-08-25T04:43:43.873470+0000","last_clean":"2023-08-25T04:43:43.873470+0000","last_became_active":"2023-08-25T04:43:36.784937+0000","last_became_peered":"2023-08-25T04:43:36.784937+0000","last_unstale":"2023-08-25T04:43:43.873470+0000","last_undegraded":"2023-08-25T04:43:43.873470+0000","last_fullsized":"2023-08-25T04:43:43.873470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:45.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032991+0000","last_change":"2023-08-25T04:43:36.785867+0000","last_active":"2023-08-25T04:43:44.032991+0000","last_peered":"2023-08-25T04:43:44.032991+0000","last_clean":"2023-08-25T04:43:44.032991+0000","last_became_active":"2023-08-25T04:43:36.785451+0000","last_became_peered":"2023-08-25T04:43:36.785451+0000","last_unstale":"2023-08-25T04:43:44.032991+0000","last_undegraded":"2023-08-25T04:43:44.032991+0000","last_fullsized":"2023-08-25T04:43:44.032991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:10.496695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327813+0000","last_change":"2023-08-25T04:43:41.886451+0000","last_active":"2023-08-25T04:43:44.327813+0000","last_peered":"2023-08-25T04:43:44.327813+0000","last_clean":"2023-08-25T04:43:44.327813+0000","last_became_active":"2023-08-25T04:43:41.885029+0000","last_became_peered":"2023-08-25T04:43:41.885029+0000","last_unstale":"2023-08-25T04:43:44.327813+0000","last_undegraded":"2023-08-25T04:43:44.327813+0000","last_fullsized":"2023-08-25T04:43:44.327813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:09.664850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327887+0000","last_change":"2023-08-25T04:43:42.881048+0000","last_active":"2023-08-25T04:43:44.327887+0000","last_peered":"2023-08-25T04:43:44.327887+0000","last_clean":"2023-08-25T04:43:44.327887+0000","last_became_active":"2023-08-25T04:43:42.880591+0000","last_became_peered":"2023-08-25T04:43:42.880591+0000","last_unstale":"2023-08-25T04:43:44.327887+0000","last_undegraded":"2023-08-25T04:43:44.327887+0000","last_fullsized":"2023-08-25T04:43:44.327887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:49.534369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032863+0000","last_change":"2023-08-25T04:43:37.192872+0000","last_active":"2023-08-25T04:43:44.032863+0000","last_peered":"2023-08-25T04:43:44.032863+0000","last_clean":"2023-08-25T04:43:44.032863+0000","last_became_active":"2023-08-25T04:43:37.192594+0000","last_became_peered":"2023-08-25T04:43:37.192594+0000","last_unstale":"2023-08-25T04:43:44.032863+0000","last_undegraded":"2023-08-25T04:43:44.032863+0000","last_fullsized":"2023-08-25T04:43:44.032863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:35.350128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873254+0000","last_change":"2023-08-25T04:43:41.888507+0000","last_active":"2023-08-25T04:43:43.873254+0000","last_peered":"2023-08-25T04:43:43.873254+0000","last_clean":"2023-08-25T04:43:43.873254+0000","last_became_active":"2023-08-25T04:43:41.888158+0000","last_became_peered":"2023-08-25T04:43:41.888158+0000","last_unstale":"2023-08-25T04:43:43.873254+0000","last_undegraded":"2023-08-25T04:43:43.873254+0000","last_fullsized":"2023-08-25T04:43:43.873254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:34:36.120848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874020+0000","last_change":"2023-08-25T04:43:42.902440+0000","last_active":"2023-08-25T04:43:43.874020+0000","last_peered":"2023-08-25T04:43:43.874020+0000","last_clean":"2023-08-25T04:43:43.874020+0000","last_became_active":"2023-08-25T04:43:42.901657+0000","last_became_peered":"2023-08-25T04:43:42.901657+0000","last_unstale":"2023-08-25T04:43:43.874020+0000","last_undegraded":"2023-08-25T04:43:43.874020+0000","last_fullsized":"2023-08-25T04:43:43.874020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:49.188528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032805+0000","last_change":"2023-08-25T04:43:37.192977+0000","last_active":"2023-08-25T04:43:44.032805+0000","last_peered":"2023-08-25T04:43:44.032805+0000","last_clean":"2023-08-25T04:43:44.032805+0000","last_became_active":"2023-08-25T04:43:37.192427+0000","last_became_peered":"2023-08-25T04:43:37.192427+0000","last_unstale":"2023-08-25T04:43:44.032805+0000","last_undegraded":"2023-08-25T04:43:44.032805+0000","last_fullsized":"2023-08-25T04:43:44.032805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:13.949510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875137+0000","last_change":"2023-08-25T04:43:41.883960+0000","last_active":"2023-08-25T04:43:43.875137+0000","last_peered":"2023-08-25T04:43:43.875137+0000","last_clean":"2023-08-25T04:43:43.875137+0000","last_became_active":"2023-08-25T04:43:41.883621+0000","last_became_peered":"2023-08-25T04:43:41.883621+0000","last_unstale":"2023-08-25T04:43:43.875137+0000","last_undegraded":"2023-08-25T04:43:43.875137+0000","last_fullsized":"2023-08-25T04:43:43.875137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:38.571968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327644+0000","last_change":"2023-08-25T04:43:42.893639+0000","last_active":"2023-08-25T04:43:44.327644+0000","last_peered":"2023-08-25T04:43:44.327644+0000","last_clean":"2023-08-25T04:43:44.327644+0000","last_became_active":"2023-08-25T04:43:42.893333+0000","last_became_peered":"2023-08-25T04:43:42.893333+0000","last_unstale":"2023-08-25T04:43:44.327644+0000","last_undegraded":"2023-08-25T04:43:44.327644+0000","last_fullsized":"2023-08-25T04:43:44.327644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:08:04.874031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874239+0000","last_change":"2023-08-25T04:43:37.192780+0000","last_active":"2023-08-25T04:43:43.874239+0000","last_peered":"2023-08-25T04:43:43.874239+0000","last_clean":"2023-08-25T04:43:43.874239+0000","last_became_active":"2023-08-25T04:43:37.192432+0000","last_became_peered":"2023-08-25T04:43:37.192432+0000","last_unstale":"2023-08-25T04:43:43.874239+0000","last_undegraded":"2023-08-25T04:43:43.874239+0000","last_fullsized":"2023-08-25T04:43:43.874239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:20.070499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328104+0000","last_change":"2023-08-25T04:43:41.889966+0000","last_active":"2023-08-25T04:43:44.328104+0000","last_peered":"2023-08-25T04:43:44.328104+0000","last_clean":"2023-08-25T04:43:44.328104+0000","last_became_active":"2023-08-25T04:43:41.889717+0000","last_became_peered":"2023-08-25T04:43:41.889717+0000","last_unstale":"2023-08-25T04:43:44.328104+0000","last_undegraded":"2023-08-25T04:43:44.328104+0000","last_fullsized":"2023-08-25T04:43:44.328104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:13.278697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873901+0000","last_change":"2023-08-25T04:43:42.885970+0000","last_active":"2023-08-25T04:43:43.873901+0000","last_peered":"2023-08-25T04:43:43.873901+0000","last_clean":"2023-08-25T04:43:43.873901+0000","last_became_active":"2023-08-25T04:43:42.885671+0000","last_became_peered":"2023-08-25T04:43:42.885671+0000","last_unstale":"2023-08-25T04:43:43.873901+0000","last_undegraded":"2023-08-25T04:43:43.873901+0000","last_fullsized":"2023-08-25T04:43:43.873901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:58:08.401348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327943+0000","last_change":"2023-08-25T04:43:37.192768+0000","last_active":"2023-08-25T04:43:44.327943+0000","last_peered":"2023-08-25T04:43:44.327943+0000","last_clean":"2023-08-25T04:43:44.327943+0000","last_became_active":"2023-08-25T04:43:37.192429+0000","last_became_peered":"2023-08-25T04:43:37.192429+0000","last_unstale":"2023-08-25T04:43:44.327943+0000","last_undegraded":"2023-08-25T04:43:44.327943+0000","last_fullsized":"2023-08-25T04:43:44.327943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:24.938536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873773+0000","last_change":"2023-08-25T04:43:41.888493+0000","last_active":"2023-08-25T04:43:43.873773+0000","last_peered":"2023-08-25T04:43:43.873773+0000","last_clean":"2023-08-25T04:43:43.873773+0000","last_became_active":"2023-08-25T04:43:41.888207+0000","last_became_peered":"2023-08-25T04:43:41.888207+0000","last_unstale":"2023-08-25T04:43:43.873773+0000","last_undegraded":"2023-08-25T04:43:43.873773+0000","last_fullsized":"2023-08-25T04:43:43.873773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:48.529248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327907+0000","last_change":"2023-08-25T04:43:42.900866+0000","last_active":"2023-08-25T04:43:44.327907+0000","last_peered":"2023-08-25T04:43:44.327907+0000","last_clean":"2023-08-25T04:43:44.327907+0000","last_became_active":"2023-08-25T04:43:42.900470+0000","last_became_peered":"2023-08-25T04:43:42.900470+0000","last_unstale":"2023-08-25T04:43:44.327907+0000","last_undegraded":"2023-08-25T04:43:44.327907+0000","last_fullsized":"2023-08-25T04:43:44.327907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:58:08.401348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327840+0000","last_change":"2023-08-25T04:43:36.785280+0000","last_active":"2023-08-25T04:43:44.327840+0000","last_peered":"2023-08-25T04:43:44.327840+0000","last_clean":"2023-08-25T04:43:44.327840+0000","last_became_active":"2023-08-25T04:43:36.784943+0000","last_became_peered":"2023-08-25T04:43:36.784943+0000","last_unstale":"2023-08-25T04:43:44.327840+0000","last_undegraded":"2023-08-25T04:43:44.327840+0000","last_fullsized":"2023-08-25T04:43:44.327840+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:34:31.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874669+0000","last_change":"2023-08-25T04:43:41.884839+0000","last_active":"2023-08-25T04:43:43.874669+0000","last_peered":"2023-08-25T04:43:43.874669+0000","last_clean":"2023-08-25T04:43:43.874669+0000","last_became_active":"2023-08-25T04:43:41.884535+0000","last_became_peered":"2023-08-25T04:43:41.884535+0000","last_unstale":"2023-08-25T04:43:43.874669+0000","last_undegraded":"2023-08-25T04:43:43.874669+0000","last_fullsized":"2023-08-25T04:43:43.874669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:19.036840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873817+0000","last_change":"2023-08-25T04:43:42.903007+0000","last_active":"2023-08-25T04:43:43.873817+0000","last_peered":"2023-08-25T04:43:43.873817+0000","last_clean":"2023-08-25T04:43:43.873817+0000","last_became_active":"2023-08-25T04:43:42.902721+0000","last_became_peered":"2023-08-25T04:43:42.902721+0000","last_unstale":"2023-08-25T04:43:43.873817+0000","last_undegraded":"2023-08-25T04:43:43.873817+0000","last_fullsized":"2023-08-25T04:43:43.873817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:31.303608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328239+0000","last_change":"2023-08-25T04:43:41.889969+0000","last_active":"2023-08-25T04:43:44.328239+0000","last_peered":"2023-08-25T04:43:44.328239+0000","last_clean":"2023-08-25T04:43:44.328239+0000","last_became_active":"2023-08-25T04:43:41.889659+0000","last_became_peered":"2023-08-25T04:43:41.889659+0000","last_unstale":"2023-08-25T04:43:44.328239+0000","last_undegraded":"2023-08-25T04:43:44.328239+0000","last_fullsized":"2023-08-25T04:43:44.328239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:24.582793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327415+0000","last_change":"2023-08-25T04:43:42.894953+0000","last_active":"2023-08-25T04:43:44.327415+0000","last_peered":"2023-08-25T04:43:44.327415+0000","last_clean":"2023-08-25T04:43:44.327415+0000","last_became_active":"2023-08-25T04:43:42.894618+0000","last_became_peered":"2023-08-25T04:43:42.894618+0000","last_unstale":"2023-08-25T04:43:44.327415+0000","last_undegraded":"2023-08-25T04:43:44.327415+0000","last_fullsized":"2023-08-25T04:43:44.327415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:55.404819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874488+0000","last_change":"2023-08-25T04:43:41.886470+0000","last_active":"2023-08-25T04:43:43.874488+0000","last_peered":"2023-08-25T04:43:43.874488+0000","last_clean":"2023-08-25T04:43:43.874488+0000","last_became_active":"2023-08-25T04:43:41.886063+0000","last_became_peered":"2023-08-25T04:43:41.886063+0000","last_unstale":"2023-08-25T04:43:43.874488+0000","last_undegraded":"2023-08-25T04:43:43.874488+0000","last_fullsized":"2023-08-25T04:43:43.874488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:37.401035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327631+0000","last_change":"2023-08-25T04:43:42.900475+0000","last_active":"2023-08-25T04:43:44.327631+0000","last_peered":"2023-08-25T04:43:44.327631+0000","last_clean":"2023-08-25T04:43:44.327631+0000","last_became_active":"2023-08-25T04:43:42.900135+0000","last_became_peered":"2023-08-25T04:43:42.900135+0000","last_unstale":"2023-08-25T04:43:44.327631+0000","last_undegraded":"2023-08-25T04:43:44.327631+0000","last_fullsized":"2023-08-25T04:43:44.327631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:20.041960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874794+0000","last_change":"2023-08-25T04:43:41.891609+0000","last_active":"2023-08-25T04:43:43.874794+0000","last_peered":"2023-08-25T04:43:43.874794+0000","last_clean":"2023-08-25T04:43:43.874794+0000","last_became_active":"2023-08-25T04:43:41.891306+0000","last_became_peered":"2023-08-25T04:43:41.891306+0000","last_unstale":"2023-08-25T04:43:43.874794+0000","last_undegraded":"2023-08-25T04:43:43.874794+0000","last_fullsized":"2023-08-25T04:43:43.874794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:40.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328451+0000","last_change":"2023-08-25T04:43:42.894647+0000","last_active":"2023-08-25T04:43:44.328451+0000","last_peered":"2023-08-25T04:43:44.328451+0000","last_clean":"2023-08-25T04:43:44.328451+0000","last_became_active":"2023-08-25T04:43:42.894386+0000","last_became_peered":"2023-08-25T04:43:42.894386+0000","last_unstale":"2023-08-25T04:43:44.328451+0000","last_undegraded":"2023-08-25T04:43:44.328451+0000","last_fullsized":"2023-08-25T04:43:44.328451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:37.175484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875135+0000","last_change":"2023-08-25T04:43:41.893331+0000","last_active":"2023-08-25T04:43:43.875135+0000","last_peered":"2023-08-25T04:43:43.875135+0000","last_clean":"2023-08-25T04:43:43.875135+0000","last_became_active":"2023-08-25T04:43:41.892929+0000","last_became_peered":"2023-08-25T04:43:41.892929+0000","last_unstale":"2023-08-25T04:43:43.875135+0000","last_undegraded":"2023-08-25T04:43:43.875135+0000","last_fullsized":"2023-08-25T04:43:43.875135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:13.278697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875244+0000","last_change":"2023-08-25T04:43:42.894553+0000","last_active":"2023-08-25T04:43:43.875244+0000","last_peered":"2023-08-25T04:43:43.875244+0000","last_clean":"2023-08-25T04:43:43.875244+0000","last_became_active":"2023-08-25T04:43:42.894239+0000","last_became_peered":"2023-08-25T04:43:42.894239+0000","last_unstale":"2023-08-25T04:43:43.875244+0000","last_undegraded":"2023-08-25T04:43:43.875244+0000","last_fullsized":"2023-08-25T04:43:43.875244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:27.266322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327794+0000","last_change":"2023-08-25T04:43:41.883254+0000","last_active":"2023-08-25T04:43:44.327794+0000","last_peered":"2023-08-25T04:43:44.327794+0000","last_clean":"2023-08-25T04:43:44.327794+0000","last_became_active":"2023-08-25T04:43:41.882756+0000","last_became_peered":"2023-08-25T04:43:41.882756+0000","last_unstale":"2023-08-25T04:43:44.327794+0000","last_undegraded":"2023-08-25T04:43:44.327794+0000","last_fullsized":"2023-08-25T04:43:44.327794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:25.157829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327503+0000","last_change":"2023-08-25T04:43:42.895154+0000","last_active":"2023-08-25T04:43:44.327503+0000","last_peered":"2023-08-25T04:43:44.327503+0000","last_clean":"2023-08-25T04:43:44.327503+0000","last_became_active":"2023-08-25T04:43:42.894912+0000","last_became_peered":"2023-08-25T04:43:42.894912+0000","last_unstale":"2023-08-25T04:43:44.327503+0000","last_undegraded":"2023-08-25T04:43:44.327503+0000","last_fullsized":"2023-08-25T04:43:44.327503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:25.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327814+0000","last_change":"2023-08-25T04:43:42.893541+0000","last_active":"2023-08-25T04:43:44.327814+0000","last_peered":"2023-08-25T04:43:44.327814+0000","last_clean":"2023-08-25T04:43:44.327814+0000","last_became_active":"2023-08-25T04:43:42.893255+0000","last_became_peered":"2023-08-25T04:43:42.893255+0000","last_unstale":"2023-08-25T04:43:44.327814+0000","last_undegraded":"2023-08-25T04:43:44.327814+0000","last_fullsized":"2023-08-25T04:43:44.327814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:31:35.265544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874788+0000","last_change":"2023-08-25T04:43:42.897868+0000","last_active":"2023-08-25T04:43:43.874788+0000","last_peered":"2023-08-25T04:43:43.874788+0000","last_clean":"2023-08-25T04:43:43.874788+0000","last_became_active":"2023-08-25T04:43:42.897394+0000","last_became_peered":"2023-08-25T04:43:42.897394+0000","last_unstale":"2023-08-25T04:43:43.874788+0000","last_undegraded":"2023-08-25T04:43:43.874788+0000","last_fullsized":"2023-08-25T04:43:43.874788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:25.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327937+0000","last_change":"2023-08-25T04:43:42.894698+0000","last_active":"2023-08-25T04:43:44.327937+0000","last_peered":"2023-08-25T04:43:44.327937+0000","last_clean":"2023-08-25T04:43:44.327937+0000","last_became_active":"2023-08-25T04:43:42.894176+0000","last_became_peered":"2023-08-25T04:43:42.894176+0000","last_unstale":"2023-08-25T04:43:44.327937+0000","last_undegraded":"2023-08-25T04:43:44.327937+0000","last_fullsized":"2023-08-25T04:43:44.327937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:52.451365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875112+0000","last_change":"2023-08-25T04:43:42.899435+0000","last_active":"2023-08-25T04:43:43.875112+0000","last_peered":"2023-08-25T04:43:43.875112+0000","last_clean":"2023-08-25T04:43:43.875112+0000","last_became_active":"2023-08-25T04:43:42.898842+0000","last_became_peered":"2023-08-25T04:43:42.898842+0000","last_unstale":"2023-08-25T04:43:43.875112+0000","last_undegraded":"2023-08-25T04:43:43.875112+0000","last_fullsized":"2023-08-25T04:43:43.875112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:16.589145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873681+0000","last_change":"2023-08-25T04:43:42.890136+0000","last_active":"2023-08-25T04:43:43.873681+0000","last_peered":"2023-08-25T04:43:43.873681+0000","last_clean":"2023-08-25T04:43:43.873681+0000","last_became_active":"2023-08-25T04:43:42.889849+0000","last_became_peered":"2023-08-25T04:43:42.889849+0000","last_unstale":"2023-08-25T04:43:43.873681+0000","last_undegraded":"2023-08-25T04:43:43.873681+0000","last_fullsized":"2023-08-25T04:43:43.873681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:26.162949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":664642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.419}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":72446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":669467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":72067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":74114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:43:47.457 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T04:43:47.457 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-25T04:43:47.458 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-25T04:43:47.459 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-25T04:43:47.460 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-25T04:43:47.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.609+0000 7fc4e36bc700 1 Processor -- start 2023-08-25T04:43:47.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.609+0000 7fc4e36bc700 1 -- start start 2023-08-25T04:43:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.610+0000 7fc4e36bc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0cc830 0x7fc4dc0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.610+0000 7fc4e36bc700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc4dc0caf10 0x7fc4dc06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.610+0000 7fc4e36bc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc4dc070eb0 0x7fc4dc06d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.610+0000 7fc4e36bc700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4dc0cbfe0 con 0x7fc4dc070eb0 2023-08-25T04:43:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.610+0000 7fc4e36bc700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4dc0cd150 con 0x7fc4dc0caf10 2023-08-25T04:43:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.610+0000 7fc4e36bc700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc0cb3d0 con 0x7fc4dc0cc830 2023-08-25T04:43:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.610+0000 7fc4e1c59700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc4dc070eb0 0x7fc4dc06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.610+0000 7fc4e1c59700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc4dc070eb0 0x7fc4dc06d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49106/0 (socket says 172.21.15.16:49106) 2023-08-25T04:43:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.610+0000 7fc4e1c59700 1 -- 172.21.15.16:0/2409180783 learned_addr learned my addr 172.21.15.16:0/2409180783 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4e1458700 1 --2- 172.21.15.16:0/2409180783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0cc830 0x7fc4dc0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4e0c57700 1 --2- 172.21.15.16:0/2409180783 >> v2:172.21.15.117:3300/0 conn(0x7fc4dc0caf10 0x7fc4dc06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4e1c59700 1 -- 172.21.15.16:0/2409180783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0cc830 msgr2=0x7fc4dc0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4e1c59700 1 --2- 172.21.15.16:0/2409180783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0cc830 0x7fc4dc0ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4e1c59700 1 -- 172.21.15.16:0/2409180783 >> v2:172.21.15.117:3300/0 conn(0x7fc4dc0caf10 msgr2=0x7fc4dc06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4e1c59700 1 --2- 172.21.15.16:0/2409180783 >> v2:172.21.15.117:3300/0 conn(0x7fc4dc0caf10 0x7fc4dc06ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4e1c59700 1 -- 172.21.15.16:0/2409180783 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4dc0cb6b0 con 0x7fc4dc070eb0 2023-08-25T04:43:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4e1458700 1 --2- 172.21.15.16:0/2409180783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0cc830 0x7fc4dc0ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4e0c57700 1 --2- 172.21.15.16:0/2409180783 >> v2:172.21.15.117:3300/0 conn(0x7fc4dc0caf10 0x7fc4dc06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4e1c59700 1 --2- 172.21.15.16:0/2409180783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4dc070eb0 0x7fc4dc06d410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0740f0 tx=0x7fc4d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4fb6f8b9ad1024 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4d3fff700 1 -- 172.21.15.16:0/2409180783 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d400e070 con 0x7fc4dc070eb0 2023-08-25T04:43:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4d3fff700 1 -- 172.21.15.16:0/2409180783 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d400b9c0 con 0x7fc4dc070eb0 2023-08-25T04:43:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4d3fff700 1 -- 172.21.15.16:0/2409180783 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d400bd70 con 0x7fc4dc070eb0 2023-08-25T04:43:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2409180783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4dc070eb0 msgr2=0x7fc4dc06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.611+0000 7fc4e36bc700 1 --2- 172.21.15.16:0/2409180783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4dc070eb0 0x7fc4dc06d410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0740f0 tx=0x7fc4d400b330 comp rx=0 tx=0).stop 2023-08-25T04:43:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.612+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2409180783 shutdown_connections 2023-08-25T04:43:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.612+0000 7fc4e36bc700 1 --2- 172.21.15.16:0/2409180783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4dc070eb0 0x7fc4dc06d410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.612+0000 7fc4e36bc700 1 --2- 172.21.15.16:0/2409180783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0cc830 0x7fc4dc0ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.612+0000 7fc4e36bc700 1 --2- 172.21.15.16:0/2409180783 >> v2:172.21.15.117:3300/0 conn(0x7fc4dc0caf10 0x7fc4dc06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.612+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2409180783 >> 172.21.15.16:0/2409180783 conn(0x7fc4dc0b1a10 msgr2=0x7fc4dc0b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.612+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2409180783 shutdown_connections 2023-08-25T04:43:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.612+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2409180783 wait complete. 2023-08-25T04:43:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.613+0000 7fc4e36bc700 1 Processor -- start 2023-08-25T04:43:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.613+0000 7fc4e36bc700 1 -- start start 2023-08-25T04:43:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e36bc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4dc070eb0 0x7fc4dc0ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e36bc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0caf10 0x7fc4dc1f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e36bc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4dc0cc830 0x7fc4dc155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e36bc700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc0b27c0 con 0x7fc4dc070eb0 2023-08-25T04:43:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e36bc700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc0aed00 con 0x7fc4dc0cc830 2023-08-25T04:43:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e36bc700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc1f68e0 con 0x7fc4dc0caf10 2023-08-25T04:43:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e1458700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4dc070eb0 0x7fc4dc0ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:47.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e1458700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4dc070eb0 0x7fc4dc0ae6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49108/0 (socket says 172.21.15.16:49108) 2023-08-25T04:43:47.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e1458700 1 -- 172.21.15.16:0/2547609078 learned_addr learned my addr 172.21.15.16:0/2547609078 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:47.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e1458700 1 -- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0caf10 msgr2=0x7fc4dc1f1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:47.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e0c57700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0caf10 0x7fc4dc1f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e1c59700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4dc0cc830 0x7fc4dc155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e1458700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0caf10 0x7fc4dc1f1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e1458700 1 -- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4dc0cc830 msgr2=0x7fc4dc155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e1458700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4dc0cc830 0x7fc4dc155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e1458700 1 -- 172.21.15.16:0/2547609078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d4009b30 con 0x7fc4dc070eb0 2023-08-25T04:43:47.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e1c59700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4dc0cc830 0x7fc4dc155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:47.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e0c57700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0caf10 0x7fc4dc1f1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:47.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e1458700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4dc070eb0 0x7fc4dc0ae6f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00c750 tx=0x7fc4cc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:47.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4d1ffb700 1 -- 172.21.15.16:0/2547609078 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc011800 con 0x7fc4dc070eb0 2023-08-25T04:43:47.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4d1ffb700 1 -- 172.21.15.16:0/2547609078 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc011960 con 0x7fc4dc070eb0 2023-08-25T04:43:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2547609078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4dc1f6bc0 con 0x7fc4dc070eb0 2023-08-25T04:43:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.614+0000 7fc4d1ffb700 1 -- 172.21.15.16:0/2547609078 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc011cd0 con 0x7fc4dc070eb0 2023-08-25T04:43:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.615+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2547609078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4dc1f2620 con 0x7fc4dc070eb0 2023-08-25T04:43:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.615+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2547609078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4dc0af010 con 0x7fc4dc070eb0 2023-08-25T04:43:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.616+0000 7fc4d1ffb700 1 -- 172.21.15.16:0/2547609078 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc4cc021350 con 0x7fc4dc070eb0 2023-08-25T04:43:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.616+0000 7fc4d1ffb700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc4c006a0e0 0x7fc4c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.616+0000 7fc4d1ffb700 1 -- 172.21.15.16:0/2547609078 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4cc0884f0 con 0x7fc4dc070eb0 2023-08-25T04:43:47.629 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.616+0000 7fc4e0c57700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc4c006a0e0 0x7fc4c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:47.629 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.617+0000 7fc4e0c57700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc4c006a0e0 0x7fc4c006c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8006fd0 tx=0x7fc4d8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:47.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.621+0000 7fc4d1ffb700 1 -- 172.21.15.16:0/2547609078 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc4cc053be0 con 0x7fc4dc070eb0 2023-08-25T04:43:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.883+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2547609078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc4dc04ee70 con 0x7fc4dc070eb0 2023-08-25T04:43:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.886+0000 7fc4d1ffb700 1 -- 172.21.15.16:0/2547609078 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169499 (secure 0 0 0) 0x7fc4cc057200 con 0x7fc4dc070eb0 2023-08-25T04:43:47.889 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:47.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.888+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc4c006a0e0 msgr2=0x7fc4c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:47.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.888+0000 7fc4e36bc700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc4c006a0e0 0x7fc4c006c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8006fd0 tx=0x7fc4d8008040 comp rx=0 tx=0).stop 2023-08-25T04:43:47.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.888+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2547609078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4dc070eb0 msgr2=0x7fc4dc0ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:47.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.888+0000 7fc4e36bc700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4dc070eb0 0x7fc4dc0ae6f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00c750 tx=0x7fc4cc00cb10 comp rx=0 tx=0).stop 2023-08-25T04:43:47.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.889+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2547609078 shutdown_connections 2023-08-25T04:43:47.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.889+0000 7fc4e36bc700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc4c006a0e0 0x7fc4c006c5a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.889+0000 7fc4e36bc700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4dc0cc830 0x7fc4dc155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.889+0000 7fc4e36bc700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4dc070eb0 0x7fc4dc0ae6f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.889+0000 7fc4e36bc700 1 --2- 172.21.15.16:0/2547609078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4dc0caf10 0x7fc4dc1f1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:47.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.889+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2547609078 >> 172.21.15.16:0/2547609078 conn(0x7fc4dc0b1a10 msgr2=0x7fc4dc156d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:47.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.889+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2547609078 shutdown_connections 2023-08-25T04:43:47.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:47.889+0000 7fc4e36bc700 1 -- 172.21.15.16:0/2547609078 wait complete. 2023-08-25T04:43:47.902 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":5,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3170738628},{"type":"v1","addr":"172.21.15.117:6833","nonce":3170738628}]},"active_addr":"172.21.15.117:6833/3170738628","active_change":"2023-08-25T04:43:29.297522+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":1499812176}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":1165178613}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3753272484}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3033486045}]}]} 2023-08-25T04:43:47.906 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-25T04:43:47.907 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-25T04:43:47.907 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:43:47.931 INFO:tasks.ceph.mds.d.smithi117.stderr:2023-08-25T04:43:47.930+0000 7fe03530a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:43:48.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.030+0000 7f832506c700 1 Processor -- start 2023-08-25T04:43:48.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.030+0000 7f832506c700 1 -- start start 2023-08-25T04:43:48.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.031+0000 7f832506c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f83200cf970 0x7f832006a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.031+0000 7f832506c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83200ac850 con 0x7f832015d320 2023-08-25T04:43:48.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.031+0000 7f832506c700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83200ce240 con 0x7f832015cf40 2023-08-25T04:43:48.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.031+0000 7f832506c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8320071a60 con 0x7f83200cf970 2023-08-25T04:43:48.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.031+0000 7f831e59c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f83200cf970 0x7f832006a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.031+0000 7f831f59e700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f832015d320 0x7f83200acce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39534/0 (socket says 172.21.15.16:39534) 2023-08-25T04:43:48.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.031+0000 7f831f59e700 1 -- 172.21.15.16:0/3599724345 learned_addr learned my addr 172.21.15.16:0/3599724345 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:48.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.031+0000 7f831e59c700 1 -- 172.21.15.16:0/3599724345 >> v1:172.21.15.117:6789/0 conn(0x7f832015cf40 legacy=0x7f83200cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.031+0000 7f831e59c700 1 -- 172.21.15.16:0/3599724345 >> v1:172.21.15.16:6789/0 conn(0x7f832015d320 legacy=0x7f83200acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.031+0000 7f831e59c700 1 -- 172.21.15.16:0/3599724345 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8320071d40 con 0x7f83200cf970 2023-08-25T04:43:48.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.031+0000 7f831dd9b700 1 -- 172.21.15.16:0/3599724345 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19032628 0 0) 0x7f83200ac850 con 0x7f832015d320 2023-08-25T04:43:48.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.031+0000 7f831e59c700 1 --2- 172.21.15.16:0/3599724345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83200cf970 0x7f832006a340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8310009840 tx=0x7f8310009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4bf3a089a3557d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.032+0000 7f831dd9b700 1 -- 172.21.15.16:0/3599724345 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310011830 con 0x7f83200cf970 2023-08-25T04:43:48.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.032+0000 7f831dd9b700 1 -- 172.21.15.16:0/3599724345 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310011990 con 0x7f83200cf970 2023-08-25T04:43:48.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.032+0000 7f831dd9b700 1 -- 172.21.15.16:0/3599724345 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310011d20 con 0x7f83200cf970 2023-08-25T04:43:48.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.032+0000 7f832506c700 1 -- 172.21.15.16:0/3599724345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83200cf970 msgr2=0x7f832006a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.032+0000 7f832506c700 1 --2- 172.21.15.16:0/3599724345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83200cf970 0x7f832006a340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8310009840 tx=0x7f8310009b50 comp rx=0 tx=0).stop 2023-08-25T04:43:48.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.032+0000 7f832506c700 1 -- 172.21.15.16:0/3599724345 shutdown_connections 2023-08-25T04:43:48.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.032+0000 7f832506c700 1 --2- 172.21.15.16:0/3599724345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83200cf970 0x7f832006a340 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.032+0000 7f832506c700 1 -- 172.21.15.16:0/3599724345 >> 172.21.15.16:0/3599724345 conn(0x7f83200b1a10 msgr2=0x7f83200b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.032+0000 7f832506c700 1 -- 172.21.15.16:0/3599724345 shutdown_connections 2023-08-25T04:43:48.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.032+0000 7f832506c700 1 -- 172.21.15.16:0/3599724345 wait complete. 2023-08-25T04:43:48.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.034+0000 7f832506c700 1 Processor -- start 2023-08-25T04:43:48.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.034+0000 7f832506c700 1 -- start start 2023-08-25T04:43:48.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.034+0000 7f832506c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83200cf970 0x7f83200b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.034+0000 7f832506c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832015cf40 0x7f83201566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.034+0000 7f832506c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832015d320 0x7f83200b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.034+0000 7f832506c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83200b43f0 con 0x7f832015d320 2023-08-25T04:43:48.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.034+0000 7f832506c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83200b2e10 con 0x7f83200cf970 2023-08-25T04:43:48.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.034+0000 7f832506c700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83200b30f0 con 0x7f832015cf40 2023-08-25T04:43:48.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f831f59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832015d320 0x7f83200b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f831f59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832015d320 0x7f83200b4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49126/0 (socket says 172.21.15.16:49126) 2023-08-25T04:43:48.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f831f59e700 1 -- 172.21.15.16:0/2636664728 learned_addr learned my addr 172.21.15.16:0/2636664728 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:48.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f831ed9d700 1 --2- 172.21.15.16:0/2636664728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83200cf970 0x7f83200b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f831e59c700 1 --2- 172.21.15.16:0/2636664728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832015cf40 0x7f83201566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f831f59e700 1 -- 172.21.15.16:0/2636664728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832015cf40 msgr2=0x7f83201566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f831f59e700 1 --2- 172.21.15.16:0/2636664728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832015cf40 0x7f83201566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f831f59e700 1 -- 172.21.15.16:0/2636664728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83200cf970 msgr2=0x7f83200b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f831f59e700 1 --2- 172.21.15.16:0/2636664728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83200cf970 0x7f83200b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f831f59e700 1 -- 172.21.15.16:0/2636664728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100094a0 con 0x7f832015d320 2023-08-25T04:43:48.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f831f59e700 1 --2- 172.21.15.16:0/2636664728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832015d320 0x7f83200b4f80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f831800cb60 tx=0x7f831800ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f83077fe700 1 -- 172.21.15.16:0/2636664728 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831800a9e0 con 0x7f832015d320 2023-08-25T04:43:48.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f83077fe700 1 -- 172.21.15.16:0/2636664728 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831800ab40 con 0x7f832015d320 2023-08-25T04:43:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f832506c700 1 -- 172.21.15.16:0/2636664728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83200b33d0 con 0x7f832015d320 2023-08-25T04:43:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f83077fe700 1 -- 172.21.15.16:0/2636664728 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180070d0 con 0x7f832015d320 2023-08-25T04:43:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.035+0000 7f832506c700 1 -- 172.21.15.16:0/2636664728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83200b3990 con 0x7f832015d320 2023-08-25T04:43:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.036+0000 7f832506c700 1 -- 172.21.15.16:0/2636664728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83200b3b80 con 0x7f832015d320 2023-08-25T04:43:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.037+0000 7f83077fe700 1 -- 172.21.15.16:0/2636664728 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8318007230 con 0x7f832015d320 2023-08-25T04:43:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.037+0000 7f83077fe700 1 --2- 172.21.15.16:0/2636664728 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f830c06a0e0 0x7f830c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.037+0000 7f83077fe700 1 -- 172.21.15.16:0/2636664728 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8318088230 con 0x7f832015d320 2023-08-25T04:43:48.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.037+0000 7f831ed9d700 1 --2- 172.21.15.16:0/2636664728 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f830c06a0e0 0x7f830c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.038+0000 7f831ed9d700 1 --2- 172.21.15.16:0/2636664728 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f830c06a0e0 0x7f830c06c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8314007fd0 tx=0x7f8314009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.042+0000 7f83077fe700 1 -- 172.21.15.16:0/2636664728 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8318053920 con 0x7f832015d320 2023-08-25T04:43:48.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.243+0000 7f832506c700 1 -- 172.21.15.16:0/2636664728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f832004ee70 con 0x7f832015d320 2023-08-25T04:43:48.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.244+0000 7f83077fe700 1 -- 172.21.15.16:0/2636664728 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18233 (secure 0 0 0) 0x7f8318056f40 con 0x7f832015d320 2023-08-25T04:43:48.246 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:48.246 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:43:43.870075+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:43:40.197381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:43:41.268759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:43:48.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.246+0000 7f832506c700 1 -- 172.21.15.16:0/2636664728 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f830c06a0e0 msgr2=0x7f830c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.246+0000 7f832506c700 1 --2- 172.21.15.16:0/2636664728 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f830c06a0e0 0x7f830c06c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8314007fd0 tx=0x7f8314009040 comp rx=0 tx=0).stop 2023-08-25T04:43:48.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.246+0000 7f832506c700 1 -- 172.21.15.16:0/2636664728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832015d320 msgr2=0x7f83200b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.246+0000 7f832506c700 1 --2- 172.21.15.16:0/2636664728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832015d320 0x7f83200b4f80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f831800cb60 tx=0x7f831800ce70 comp rx=0 tx=0).stop 2023-08-25T04:43:48.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.246+0000 7f832506c700 1 -- 172.21.15.16:0/2636664728 shutdown_connections 2023-08-25T04:43:48.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.246+0000 7f832506c700 1 --2- 172.21.15.16:0/2636664728 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f830c06a0e0 0x7f830c06c5a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.246+0000 7f832506c700 1 --2- 172.21.15.16:0/2636664728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832015d320 0x7f83200b4f80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.246+0000 7f832506c700 1 --2- 172.21.15.16:0/2636664728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83200cf970 0x7f83200b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.246+0000 7f832506c700 1 --2- 172.21.15.16:0/2636664728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832015cf40 0x7f83201566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.246+0000 7f832506c700 1 -- 172.21.15.16:0/2636664728 >> 172.21.15.16:0/2636664728 conn(0x7f83200b1a10 msgr2=0x7f832015f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.246+0000 7f832506c700 1 -- 172.21.15.16:0/2636664728 shutdown_connections 2023-08-25T04:43:48.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.246+0000 7f832506c700 1 -- 172.21.15.16:0/2636664728 wait complete. 2023-08-25T04:43:48.261 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-25T04:43:48.261 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:43:48.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.385+0000 7f84afa9b700 1 Processor -- start 2023-08-25T04:43:48.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.385+0000 7f84afa9b700 1 -- start start 2023-08-25T04:43:48.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.386+0000 7f84afa9b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f84a80cc830 0x7f84a80ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.386+0000 7f84afa9b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f84a80cedc0 0x7f84a806d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.386+0000 7f84afa9b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a80cbfe0 con 0x7f84a80caf10 2023-08-25T04:43:48.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.386+0000 7f84afa9b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a80cd150 con 0x7f84a80cedc0 2023-08-25T04:43:48.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.386+0000 7f84afa9b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a80cb3d0 con 0x7f84a80cc830 2023-08-25T04:43:48.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.386+0000 7f84ae038700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f84a80cedc0 0x7f84a806d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.386+0000 7f84ae038700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f84a80cedc0 0x7f84a806d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49134/0 (socket says 172.21.15.16:49134) 2023-08-25T04:43:48.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.386+0000 7f84ae038700 1 -- 172.21.15.16:0/2583576430 learned_addr learned my addr 172.21.15.16:0/2583576430 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:48.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.386+0000 7f84ae038700 1 -- 172.21.15.16:0/2583576430 >> v2:172.21.15.117:3300/0 conn(0x7f84a80cc830 msgr2=0x7f84a80ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:48.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.386+0000 7f84ad837700 1 --2- 172.21.15.16:0/2583576430 >> v2:172.21.15.117:3300/0 conn(0x7f84a80cc830 0x7f84a80ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.386+0000 7f84ae038700 1 --2- 172.21.15.16:0/2583576430 >> v2:172.21.15.117:3300/0 conn(0x7f84a80cc830 0x7f84a80ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.386+0000 7f84ae038700 1 -- 172.21.15.16:0/2583576430 >> v1:172.21.15.117:6789/0 conn(0x7f84a80caf10 legacy=0x7f84a806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:48.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.386+0000 7f84ae038700 1 -- 172.21.15.16:0/2583576430 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a80cb6b0 con 0x7f84a80cedc0 2023-08-25T04:43:48.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.386+0000 7f84ae038700 1 --2- 172.21.15.16:0/2583576430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84a80cedc0 0x7f84a806d5e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f84a8072790 tx=0x7f84a000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c916ae3b3bb9eccf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.387+0000 7f84ac835700 1 -- 172.21.15.16:0/2583576430 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0010070 con 0x7f84a80cedc0 2023-08-25T04:43:48.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.387+0000 7f84ac835700 1 -- 172.21.15.16:0/2583576430 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a000dd50 con 0x7f84a80cedc0 2023-08-25T04:43:48.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.387+0000 7f84ac835700 1 -- 172.21.15.16:0/2583576430 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a000b310 con 0x7f84a80cedc0 2023-08-25T04:43:48.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.387+0000 7f84afa9b700 1 -- 172.21.15.16:0/2583576430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84a80cedc0 msgr2=0x7f84a806d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.387+0000 7f84afa9b700 1 --2- 172.21.15.16:0/2583576430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84a80cedc0 0x7f84a806d5e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f84a8072790 tx=0x7f84a000d430 comp rx=0 tx=0).stop 2023-08-25T04:43:48.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.387+0000 7f84afa9b700 1 -- 172.21.15.16:0/2583576430 shutdown_connections 2023-08-25T04:43:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.387+0000 7f84afa9b700 1 --2- 172.21.15.16:0/2583576430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84a80cedc0 0x7f84a806d5e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.387+0000 7f84afa9b700 1 --2- 172.21.15.16:0/2583576430 >> v2:172.21.15.117:3300/0 conn(0x7f84a80cc830 0x7f84a80ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.387+0000 7f84afa9b700 1 -- 172.21.15.16:0/2583576430 >> 172.21.15.16:0/2583576430 conn(0x7f84a80b1a10 msgr2=0x7f84a80b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.387+0000 7f84afa9b700 1 -- 172.21.15.16:0/2583576430 shutdown_connections 2023-08-25T04:43:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.387+0000 7f84afa9b700 1 -- 172.21.15.16:0/2583576430 wait complete. 2023-08-25T04:43:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.388+0000 7f84afa9b700 1 Processor -- start 2023-08-25T04:43:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.388+0000 7f84afa9b700 1 -- start start 2023-08-25T04:43:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.389+0000 7f84afa9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84a80caf10 0x7f84a80c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.389+0000 7f84afa9b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84a80cc830 0x7f84a814a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.389+0000 7f84afa9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80cedc0 0x7f84a81edbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.389+0000 7f84afa9b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80c58a0 con 0x7f84a80caf10 2023-08-25T04:43:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.389+0000 7f84afa9b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a814aa90 con 0x7f84a80cedc0 2023-08-25T04:43:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.389+0000 7f84afa9b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a814bd60 con 0x7f84a80cc830 2023-08-25T04:43:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.389+0000 7f84ad837700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84a80caf10 0x7f84a80c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.389+0000 7f84ad837700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84a80caf10 0x7f84a80c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49136/0 (socket says 172.21.15.16:49136) 2023-08-25T04:43:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.389+0000 7f84ad837700 1 -- 172.21.15.16:0/1633807990 learned_addr learned my addr 172.21.15.16:0/1633807990 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.389+0000 7f84ad036700 1 --2- 172.21.15.16:0/1633807990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84a80cc830 0x7f84a814a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.389+0000 7f84ae038700 1 --2- 172.21.15.16:0/1633807990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80cedc0 0x7f84a81edbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.389+0000 7f84ad837700 1 -- 172.21.15.16:0/1633807990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84a80cc830 msgr2=0x7f84a814a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.389+0000 7f84ad837700 1 --2- 172.21.15.16:0/1633807990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84a80cc830 0x7f84a814a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.390+0000 7f84ad837700 1 -- 172.21.15.16:0/1633807990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80cedc0 msgr2=0x7f84a81edbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.390+0000 7f84ad837700 1 --2- 172.21.15.16:0/1633807990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80cedc0 0x7f84a81edbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.390+0000 7f84ad837700 1 -- 172.21.15.16:0/1633807990 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a000bd40 con 0x7f84a80caf10 2023-08-25T04:43:48.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.390+0000 7f84ad837700 1 --2- 172.21.15.16:0/1633807990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84a80caf10 0x7f84a80c5360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f84a400c7f0 tx=0x7f84a400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.390+0000 7f849e7fc700 1 -- 172.21.15.16:0/1633807990 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4011800 con 0x7f84a80caf10 2023-08-25T04:43:48.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.390+0000 7f849e7fc700 1 -- 172.21.15.16:0/1633807990 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a4011960 con 0x7f84a80caf10 2023-08-25T04:43:48.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.390+0000 7f84afa9b700 1 -- 172.21.15.16:0/1633807990 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a814acc0 con 0x7f84a80caf10 2023-08-25T04:43:48.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.390+0000 7f849e7fc700 1 -- 172.21.15.16:0/1633807990 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4011cf0 con 0x7f84a80caf10 2023-08-25T04:43:48.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.390+0000 7f84afa9b700 1 -- 172.21.15.16:0/1633807990 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a814b050 con 0x7f84a80caf10 2023-08-25T04:43:48.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.391+0000 7f84afa9b700 1 -- 172.21.15.16:0/1633807990 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a804ee70 con 0x7f84a80caf10 2023-08-25T04:43:48.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.391+0000 7f849e7fc700 1 -- 172.21.15.16:0/1633807990 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f84a4018360 con 0x7f84a80caf10 2023-08-25T04:43:48.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.392+0000 7f849e7fc700 1 --2- 172.21.15.16:0/1633807990 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f848c06a0e0 0x7f848c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.392+0000 7f849e7fc700 1 -- 172.21.15.16:0/1633807990 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84a40884e0 con 0x7f84a80caf10 2023-08-25T04:43:48.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.392+0000 7f84ad036700 1 --2- 172.21.15.16:0/1633807990 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f848c06a0e0 0x7f848c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.392+0000 7f84ad036700 1 --2- 172.21.15.16:0/1633807990 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f848c06a0e0 0x7f848c06c5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f84a806dff0 tx=0x7f8498008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.396+0000 7f849e7fc700 1 -- 172.21.15.16:0/1633807990 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f84a4053bd0 con 0x7f84a80caf10 2023-08-25T04:43:48.597 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.596+0000 7f84afa9b700 1 -- 172.21.15.16:0/1633807990 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84a80cea80 con 0x7f84a80caf10 2023-08-25T04:43:48.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.597+0000 7f849e7fc700 1 -- 172.21.15.16:0/1633807990 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18233 (secure 0 0 0) 0x7f84a40571f0 con 0x7f84a80caf10 2023-08-25T04:43:48.599 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:48.599 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:43:43.870075+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:43:40.197381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:43:41.268759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:43:48.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.599+0000 7f84afa9b700 1 -- 172.21.15.16:0/1633807990 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f848c06a0e0 msgr2=0x7f848c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.599+0000 7f84afa9b700 1 --2- 172.21.15.16:0/1633807990 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f848c06a0e0 0x7f848c06c5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f84a806dff0 tx=0x7f8498008040 comp rx=0 tx=0).stop 2023-08-25T04:43:48.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.599+0000 7f84afa9b700 1 -- 172.21.15.16:0/1633807990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84a80caf10 msgr2=0x7f84a80c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.599+0000 7f84afa9b700 1 --2- 172.21.15.16:0/1633807990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84a80caf10 0x7f84a80c5360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f84a400c7f0 tx=0x7f84a400cbb0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.599+0000 7f84afa9b700 1 -- 172.21.15.16:0/1633807990 shutdown_connections 2023-08-25T04:43:48.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.599+0000 7f84afa9b700 1 --2- 172.21.15.16:0/1633807990 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f848c06a0e0 0x7f848c06c5a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.599+0000 7f84afa9b700 1 --2- 172.21.15.16:0/1633807990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80cedc0 0x7f84a81edbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.599+0000 7f84afa9b700 1 --2- 172.21.15.16:0/1633807990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84a80caf10 0x7f84a80c5360 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.599+0000 7f84afa9b700 1 --2- 172.21.15.16:0/1633807990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84a80cc830 0x7f84a814a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.599+0000 7f84afa9b700 1 -- 172.21.15.16:0/1633807990 >> 172.21.15.16:0/1633807990 conn(0x7f84a80b1a10 msgr2=0x7f84a80b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.599+0000 7f84afa9b700 1 -- 172.21.15.16:0/1633807990 shutdown_connections 2023-08-25T04:43:48.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.599+0000 7f84afa9b700 1 -- 172.21.15.16:0/1633807990 wait complete. 2023-08-25T04:43:48.613 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-25T04:43:48.614 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-25T04:43:48.614 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-25T04:43:48.615 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-25T04:43:48.615 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-25T04:43:48.616 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-25T04:43:48.616 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-25T04:43:48.617 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-25T04:43:48.831 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.828+0000 7fe41e4a4700 1 Processor -- start 2023-08-25T04:43:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.828+0000 7fe41e4a4700 1 -- start start 2023-08-25T04:43:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.830+0000 7fe41e4a4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe41815ccc0 0x7fe4180cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.830+0000 7fe41e4a4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4180c9f30 0x7fe4180ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.830+0000 7fe41e4a4700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4180ce630 con 0x7fe41815d0a0 2023-08-25T04:43:48.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.830+0000 7fe41e4a4700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4180cda20 con 0x7fe41815ccc0 2023-08-25T04:43:48.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.830+0000 7fe41e4a4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4180cdd00 con 0x7fe4180c9f30 2023-08-25T04:43:48.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.830+0000 7fe41ca41700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4180c9f30 0x7fe4180ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.830+0000 7fe41ca41700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4180c9f30 0x7fe4180ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:49686/0 (socket says 172.21.15.16:49686) 2023-08-25T04:43:48.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.830+0000 7fe41ca41700 1 -- 172.21.15.16:0/3189556615 learned_addr learned my addr 172.21.15.16:0/3189556615 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:48.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.830+0000 7fe41ca41700 1 -- 172.21.15.16:0/3189556615 >> v2:172.21.15.117:3300/0 conn(0x7fe41815ccc0 msgr2=0x7fe4180cd360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T04:43:48.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.830+0000 7fe41ca41700 1 --2- 172.21.15.16:0/3189556615 >> v2:172.21.15.117:3300/0 conn(0x7fe41815ccc0 0x7fe4180cd360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.830+0000 7fe41ca41700 1 -- 172.21.15.16:0/3189556615 >> v1:172.21.15.16:6789/0 conn(0x7fe41815d0a0 legacy=0x7fe418070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:48.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.830+0000 7fe41ca41700 1 -- 172.21.15.16:0/3189556615 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4180cdfe0 con 0x7fe4180c9f30 2023-08-25T04:43:48.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.831+0000 7fe41ca41700 1 --2- 172.21.15.16:0/3189556615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4180c9f30 0x7fe4180ca3a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe410009bd0 tx=0x7fe41000d3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98fdbaff900b34d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.835+0000 7fe416ffd700 1 -- 172.21.15.16:0/3189556615 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000dcd0 con 0x7fe4180c9f30 2023-08-25T04:43:48.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.835+0000 7fe416ffd700 1 -- 172.21.15.16:0/3189556615 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41000de30 con 0x7fe4180c9f30 2023-08-25T04:43:48.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.835+0000 7fe416ffd700 1 -- 172.21.15.16:0/3189556615 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410003c60 con 0x7fe4180c9f30 2023-08-25T04:43:48.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.836+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3189556615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4180c9f30 msgr2=0x7fe4180ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.836+0000 7fe41e4a4700 1 --2- 172.21.15.16:0/3189556615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4180c9f30 0x7fe4180ca3a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe410009bd0 tx=0x7fe41000d3c0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.836+0000 7f2bb3de0700 1 Processor -- start 2023-08-25T04:43:48.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.836+0000 7f0c38039700 1 Processor -- start 2023-08-25T04:43:48.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.837+0000 7f0c38039700 1 -- start start 2023-08-25T04:43:48.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.837+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3189556615 shutdown_connections 2023-08-25T04:43:48.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.837+0000 7fe41e4a4700 1 --2- 172.21.15.16:0/3189556615 >> v2:172.21.15.117:3300/0 conn(0x7fe41815ccc0 0x7fe4180cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.837+0000 7fe41e4a4700 1 --2- 172.21.15.16:0/3189556615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4180c9f30 0x7fe4180ca3a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.837+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3189556615 >> 172.21.15.16:0/3189556615 conn(0x7fe4180cbbe0 msgr2=0x7fe4180cbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.837+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3189556615 shutdown_connections 2023-08-25T04:43:48.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.837+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3189556615 wait complete. 2023-08-25T04:43:48.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.838+0000 7f0c38039700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0c3006a5e0 0x7f0c3006a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.838+0000 7f0c38039700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c30066470 0x7f0c300cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.838+0000 7f0c38039700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3015d910 con 0x7f0c30065fe0 2023-08-25T04:43:48.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.838+0000 7f0c38039700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3006af00 con 0x7f0c3006a5e0 2023-08-25T04:43:48.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.838+0000 7f0c38039700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3015db90 con 0x7f0c30066470 2023-08-25T04:43:48.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.838+0000 7f0c355d4700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0c30065fe0 0x7f0c300cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39566/0 (socket says 172.21.15.16:39566) 2023-08-25T04:43:48.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.838+0000 7f0c355d4700 1 -- 172.21.15.16:0/2927318836 learned_addr learned my addr 172.21.15.16:0/2927318836 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:48.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.838+0000 7f0c35dd5700 1 --2- 172.21.15.16:0/2927318836 >> v2:172.21.15.117:3300/0 conn(0x7f0c3006a5e0 0x7f0c3006a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.839+0000 7f0c35dd5700 1 -- 172.21.15.16:0/2927318836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c30066470 msgr2=0x7f0c300cc220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T04:43:48.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.839+0000 7f0c35dd5700 1 --2- 172.21.15.16:0/2927318836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c30066470 0x7f0c300cc220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.839+0000 7f0c34dd3700 1 -- 172.21.15.16:0/2927318836 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914519242 0 0) 0x7f0c3015d910 con 0x7f0c30065fe0 2023-08-25T04:43:48.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.839+0000 7f0c35dd5700 1 -- 172.21.15.16:0/2927318836 >> v1:172.21.15.16:6789/0 conn(0x7f0c30065fe0 legacy=0x7f0c300cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.839+0000 7f0c35dd5700 1 -- 172.21.15.16:0/2927318836 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3015de70 con 0x7f0c3006a5e0 2023-08-25T04:43:48.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.839+0000 7f0c35dd5700 1 --2- 172.21.15.16:0/2927318836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c3006a5e0 0x7f0c3006a9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009820 tx=0x7f0c20009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81c1f104406707cc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.839+0000 7fe41e4a4700 1 Processor -- start 2023-08-25T04:43:48.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.839+0000 7f0c34dd3700 1 -- 172.21.15.16:0/2927318836 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c20005e30 con 0x7f0c3006a5e0 2023-08-25T04:43:48.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.839+0000 7f0c34dd3700 1 -- 172.21.15.16:0/2927318836 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c20006030 con 0x7f0c3006a5e0 2023-08-25T04:43:48.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.839+0000 7f0c34dd3700 1 -- 172.21.15.16:0/2927318836 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c200063e0 con 0x7f0c3006a5e0 2023-08-25T04:43:48.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.839+0000 7fe41e4a4700 1 -- start start 2023-08-25T04:43:48.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.839+0000 7f2bb3de0700 1 -- start start 2023-08-25T04:43:48.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.840+0000 7f2bb3de0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bac0caf10 0x7f2bac0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.840+0000 7f2bb3de0700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bac0cbfe0 con 0x7f2bac0cc830 2023-08-25T04:43:48.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.840+0000 7f2bb3de0700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bac0cb3d0 con 0x7f2bac070eb0 2023-08-25T04:43:48.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.840+0000 7f2bb3de0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0cb6b0 con 0x7f2bac0caf10 2023-08-25T04:43:48.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.840+0000 7fe41e4a4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4180c9f30 0x7fe41814f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.840+0000 7fe41e4a4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe41815ccc0 0x7fe418159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.840+0000 7fe41e4a4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe41815d0a0 0x7fe4181581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.840+0000 7fe41e4a4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4180c6f00 con 0x7fe41815d0a0 2023-08-25T04:43:48.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.840+0000 7fe41e4a4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41815a880 con 0x7fe4180c9f30 2023-08-25T04:43:48.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.840+0000 7fe41e4a4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe418159fe0 con 0x7fe41815ccc0 2023-08-25T04:43:48.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.840+0000 7f2bb137b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bac0caf10 0x7f2bac0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.840+0000 7f2bb1b7c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f2bac0cc830 0x7f2bac0ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39570/0 (socket says 172.21.15.16:39570) 2023-08-25T04:43:48.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.840+0000 7f2bb1b7c700 1 -- 172.21.15.16:0/1606760437 learned_addr learned my addr 172.21.15.16:0/1606760437 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:48.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7fe4177fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe41815ccc0 0x7fe418159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7fe417fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4180c9f30 0x7fe41814f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7fe4177fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe41815ccc0 0x7fe418159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:49708/0 (socket says 172.21.15.16:49708) 2023-08-25T04:43:48.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7fe417fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4180c9f30 0x7fe41814f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36494/0 (socket says 172.21.15.16:36494) 2023-08-25T04:43:48.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7fe4177fe700 1 -- 172.21.15.16:0/3680686607 learned_addr learned my addr 172.21.15.16:0/3680686607 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:48.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7fe41ca41700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe41815d0a0 0x7fe4181581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7fe4177fe700 1 -- 172.21.15.16:0/3680686607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4180c9f30 msgr2=0x7fe41814f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7fe4177fe700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4180c9f30 0x7fe41814f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7fe4177fe700 1 -- 172.21.15.16:0/3680686607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe41815d0a0 msgr2=0x7fe4181581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7fe4177fe700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe41815d0a0 0x7fe4181581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7fe4177fe700 1 -- 172.21.15.16:0/3680686607 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe410009830 con 0x7fe41815ccc0 2023-08-25T04:43:48.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7fe417fff700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4180c9f30 0x7fe41814f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:48.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7fe41ca41700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe41815d0a0 0x7fe4181581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:48.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7fe4177fe700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe41815ccc0 0x7fe418159540 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe40800b470 tx=0x7fe40800b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7f0c38039700 1 -- 172.21.15.16:0/2927318836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c3006a5e0 msgr2=0x7f0c3006a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.841+0000 7f0c38039700 1 --2- 172.21.15.16:0/2927318836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c3006a5e0 0x7f0c3006a9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009820 tx=0x7f0c20009b30 comp rx=0 tx=0).stop 2023-08-25T04:43:48.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7f0c38039700 1 -- 172.21.15.16:0/2927318836 shutdown_connections 2023-08-25T04:43:48.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7f0c38039700 1 --2- 172.21.15.16:0/2927318836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c3006a5e0 0x7f0c3006a9c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7f0c38039700 1 --2- 172.21.15.16:0/2927318836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c30066470 0x7f0c300cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7f0c38039700 1 -- 172.21.15.16:0/2927318836 >> 172.21.15.16:0/2927318836 conn(0x7f0c300b2480 msgr2=0x7f0c300b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7f0c38039700 1 -- 172.21.15.16:0/2927318836 shutdown_connections 2023-08-25T04:43:48.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7fc1831be700 1 Processor -- start 2023-08-25T04:43:48.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7f2bb137b700 1 -- 172.21.15.16:0/1606760437 >> v1:172.21.15.117:6789/0 conn(0x7f2bac070eb0 legacy=0x7f2bac0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7f2bb137b700 1 -- 172.21.15.16:0/1606760437 >> v1:172.21.15.16:6789/0 conn(0x7f2bac0cc830 legacy=0x7f2bac0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7f0c38039700 1 -- 172.21.15.16:0/2927318836 wait complete. 2023-08-25T04:43:48.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7f2bb137b700 1 -- 172.21.15.16:0/1606760437 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac0cb990 con 0x7f2bac0caf10 2023-08-25T04:43:48.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7fc1831be700 1 -- start start 2023-08-25T04:43:48.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7f2bb137b700 1 --2- 172.21.15.16:0/1606760437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bac0caf10 0x7f2bac0cddb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009870 tx=0x7f2b9c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f580f03bf24dbf7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7fe414ff9700 1 -- 172.21.15.16:0/3680686607 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408011830 con 0x7fe41815ccc0 2023-08-25T04:43:48.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7fe414ff9700 1 -- 172.21.15.16:0/3680686607 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4080119b0 con 0x7fe41815ccc0 2023-08-25T04:43:48.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.842+0000 7fe414ff9700 1 -- 172.21.15.16:0/3680686607 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408011d60 con 0x7fe41815ccc0 2023-08-25T04:43:48.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.843+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3680686607 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41815a2c0 con 0x7fe41815ccc0 2023-08-25T04:43:48.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.843+0000 7f2bb0b7a700 1 -- 172.21.15.16:0/1606760437 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c004230 con 0x7f2bac0caf10 2023-08-25T04:43:48.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.843+0000 7f2bb0b7a700 1 -- 172.21.15.16:0/1606760437 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c004390 con 0x7f2bac0caf10 2023-08-25T04:43:48.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.843+0000 7f2bb0b7a700 1 -- 172.21.15.16:0/1606760437 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0036a0 con 0x7f2bac0caf10 2023-08-25T04:43:48.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.843+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3680686607 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4180c7130 con 0x7fe41815ccc0 2023-08-25T04:43:48.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7fc1831be700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc17c0cf970 0x7fc17c06a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7fc1831be700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c0ac850 con 0x7fc17c15d320 2023-08-25T04:43:48.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7fc1831be700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c0ce240 con 0x7fc17c15cf40 2023-08-25T04:43:48.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7fc1831be700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c071a60 con 0x7fc17c0cf970 2023-08-25T04:43:48.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7f2bb3de0700 1 -- 172.21.15.16:0/1606760437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bac0caf10 msgr2=0x7f2bac0cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7f2bb3de0700 1 --2- 172.21.15.16:0/1606760437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bac0caf10 0x7f2bac0cddb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009870 tx=0x7f2b9c009b80 comp rx=0 tx=0).stop 2023-08-25T04:43:48.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7f2bb3de0700 1 -- 172.21.15.16:0/1606760437 shutdown_connections 2023-08-25T04:43:48.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7f2bb3de0700 1 --2- 172.21.15.16:0/1606760437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bac0caf10 0x7f2bac0cddb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7f2bb3de0700 1 -- 172.21.15.16:0/1606760437 >> 172.21.15.16:0/1606760437 conn(0x7f2bac0b1a10 msgr2=0x7f2bac0b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7f2bb3de0700 1 -- 172.21.15.16:0/1606760437 shutdown_connections 2023-08-25T04:43:48.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7f0c38039700 1 Processor -- start 2023-08-25T04:43:48.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7f50dffac700 1 Processor -- start 2023-08-25T04:43:48.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7eff6f345700 1 Processor -- start 2023-08-25T04:43:48.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7fc173fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc17c0cf970 0x7fc17c06a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7fc173fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc17c0cf970 0x7fc17c06a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36500/0 (socket says 172.21.15.16:36500) 2023-08-25T04:43:48.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7fc173fff700 1 -- 172.21.15.16:0/3491033459 learned_addr learned my addr 172.21.15.16:0/3491033459 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:48.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3680686607 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe41815d530 con 0x7fe41815ccc0 2023-08-25T04:43:48.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7fc173fff700 1 -- 172.21.15.16:0/3491033459 >> v1:172.21.15.117:6789/0 conn(0x7fc17c15cf40 legacy=0x7fc17c0cda10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T04:43:48.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7fc173fff700 1 -- 172.21.15.16:0/3491033459 >> v1:172.21.15.16:6789/0 conn(0x7fc17c15d320 legacy=0x7fc17c0acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7fc173fff700 1 -- 172.21.15.16:0/3491033459 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c071d40 con 0x7fc17c0cf970 2023-08-25T04:43:48.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7f0c38039700 1 -- start start 2023-08-25T04:43:48.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7f0c38039700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c30065fe0 0x7f0c300c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7f0c38039700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c30066470 0x7f0c300c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7f0c38039700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c3006a5e0 0x7f0c3015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7f0c38039700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300c6020 con 0x7f0c3006a5e0 2023-08-25T04:43:48.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7f0c38039700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300c3b80 con 0x7f0c30065fe0 2023-08-25T04:43:48.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7f0c38039700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300c3e60 con 0x7f0c30066470 2023-08-25T04:43:48.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7f0c355d4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c30066470 0x7f0c300c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7fc173fff700 1 --2- 172.21.15.16:0/3491033459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc17c0cf970 0x7fc17c06a340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0098f0 tx=0x7fc16c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56d9b0dc806f54ec server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7fcd2807d700 1 Processor -- start 2023-08-25T04:43:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7fcd2807d700 1 -- start start 2023-08-25T04:43:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7fcd2807d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd200cd930 0x7fcd2006b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7fcd2807d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcd2016b0d0 0x7fcd2006bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7fcd2807d700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd200cc890 con 0x7fcd2006d3b0 2023-08-25T04:43:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7fcd2807d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd200ccb70 con 0x7fcd2016b0d0 2023-08-25T04:43:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7fcd2807d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200cce50 con 0x7fcd200cd930 2023-08-25T04:43:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7f0c365d6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c3006a5e0 0x7f0c3015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7f0c365d6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c3006a5e0 0x7f0c3015ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49176/0 (socket says 172.21.15.16:49176) 2023-08-25T04:43:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7f0c365d6700 1 -- 172.21.15.16:0/4100168632 learned_addr learned my addr 172.21.15.16:0/4100168632 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.845+0000 7f0c35dd5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c30065fe0 0x7f0c300c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7f0c355d4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c30066470 0x7f0c300c5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:49720/0 (socket says 172.21.15.16:49720) 2023-08-25T04:43:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7f50dffac700 1 -- start start 2023-08-25T04:43:48.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7fc1737fe700 1 -- 172.21.15.16:0/3491033459 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c004230 con 0x7fc17c0cf970 2023-08-25T04:43:48.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7fc1737fe700 1 -- 172.21.15.16:0/3491033459 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c004390 con 0x7fc17c0cf970 2023-08-25T04:43:48.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7fc1737fe700 1 -- 172.21.15.16:0/3491033459 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0036a0 con 0x7fc17c0cf970 2023-08-25T04:43:48.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7fe414ff9700 1 -- 172.21.15.16:0/3680686607 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe40801a400 con 0x7fe41815ccc0 2023-08-25T04:43:48.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7f0c365d6700 1 -- 172.21.15.16:0/4100168632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c30066470 msgr2=0x7f0c300c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7f0c365d6700 1 --2- 172.21.15.16:0/4100168632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c30066470 0x7f0c300c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7f0c365d6700 1 -- 172.21.15.16:0/4100168632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c30065fe0 msgr2=0x7f0c300c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7f0c365d6700 1 --2- 172.21.15.16:0/4100168632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c30065fe0 0x7f0c300c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7f0c365d6700 1 -- 172.21.15.16:0/4100168632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c20009430 con 0x7f0c3006a5e0 2023-08-25T04:43:48.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.844+0000 7f2bb3de0700 1 -- 172.21.15.16:0/1606760437 wait complete. 2023-08-25T04:43:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7f2bb3de0700 1 Processor -- start 2023-08-25T04:43:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7f2bb3de0700 1 -- start start 2023-08-25T04:43:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7f0c365d6700 1 --2- 172.21.15.16:0/4100168632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c3006a5e0 0x7f0c3015ecf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800b990 tx=0x7f0c2800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fe414ff9700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe40406a1b0 0x7fe40406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fe414ff9700 1 -- 172.21.15.16:0/3680686607 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4080884a0 con 0x7fe41815ccc0 2023-08-25T04:43:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fe414ff9700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.16:6808/1569731109,v1:172.21.15.16:6811/1569731109] conn(0x7fe404072a70 0x7fe404074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fe414ff9700 1 -- 172.21.15.16:0/3680686607 --> [v2:172.21.15.16:6808/1569731109,v1:172.21.15.16:6811/1569731109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe404075540 con 0x7fe404072a70 2023-08-25T04:43:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fe414ff9700 1 -- 172.21.15.16:0/3680686607 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe40808aac0 con 0x7fe41815ccc0 2023-08-25T04:43:48.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7eff6f345700 1 -- start start 2023-08-25T04:43:48.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7eff6f345700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7eff680caf60 0x7eff6815f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7eff6f345700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7eff681651b0 0x7eff68165620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7eff6f345700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff680c2600 con 0x7eff680c2220 2023-08-25T04:43:48.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7eff6f345700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6806c890 con 0x7eff680caf60 2023-08-25T04:43:48.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7eff6f345700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff680cd8e0 con 0x7eff681651b0 2023-08-25T04:43:48.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fc1831be700 1 -- 172.21.15.16:0/3491033459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc17c0cf970 msgr2=0x7fc17c06a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fc1831be700 1 --2- 172.21.15.16:0/3491033459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc17c0cf970 0x7fc17c06a340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0098f0 tx=0x7fc16c009c00 comp rx=0 tx=0).stop 2023-08-25T04:43:48.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fc1831be700 1 -- 172.21.15.16:0/3491033459 shutdown_connections 2023-08-25T04:43:48.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fc1831be700 1 --2- 172.21.15.16:0/3491033459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc17c0cf970 0x7fc17c06a340 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fc1831be700 1 -- 172.21.15.16:0/3491033459 >> 172.21.15.16:0/3491033459 conn(0x7fc17c0b1a10 msgr2=0x7fc17c0b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fcd25e19700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcd2006d3b0 0x7fcd200ce330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.16:47684/0 (socket says 172.21.15.16:47684) 2023-08-25T04:43:48.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fcd25e19700 1 -- 172.21.15.16:0/1393706130 learned_addr learned my addr 172.21.15.16:0/1393706130 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:48.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fcd2661a700 1 --2- 172.21.15.16:0/1393706130 >> v2:172.21.15.16:3300/0 conn(0x7fcd2016b0d0 0x7fcd2006bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fe417fff700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe40406a1b0 0x7fe40406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.846+0000 7f50dffac700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50d806aa50 0x7f50d8071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7eff6d8e2700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7eff681651b0 0x7eff68165620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7f50dffac700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d80cf6b0 0x7f50d80cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7fe41ca41700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.16:6808/1569731109,v1:172.21.15.16:6811/1569731109] conn(0x7fe404072a70 0x7fe404074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7eff6d8e2700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7eff681651b0 0x7eff68165620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36518/0 (socket says 172.21.15.16:36518) 2023-08-25T04:43:48.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7eff6d8e2700 1 -- 172.21.15.16:0/3791752170 learned_addr learned my addr 172.21.15.16:0/3791752170 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:48.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7f50dffac700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d80cdf50 con 0x7f50d8161780 2023-08-25T04:43:48.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7f50dffac700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d80cfb40 con 0x7f50d806aa50 2023-08-25T04:43:48.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7f50dffac700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d806e120 con 0x7f50d80cf6b0 2023-08-25T04:43:48.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7f50ddd48700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f50d8161780 0x7f50d806a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39610/0 (socket says 172.21.15.16:39610) 2023-08-25T04:43:48.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7f50ddd48700 1 -- 172.21.15.16:0/540802883 learned_addr learned my addr 172.21.15.16:0/540802883 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:48.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7eff6c8e0700 1 --2- 172.21.15.16:0/3791752170 >> v2:172.21.15.16:3300/0 conn(0x7eff680caf60 0x7eff6815f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7fc1831be700 1 -- 172.21.15.16:0/3491033459 shutdown_connections 2023-08-25T04:43:48.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7fc1831be700 1 -- 172.21.15.16:0/3491033459 wait complete. 2023-08-25T04:43:48.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7f2bb3de0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bac070eb0 0x7f2bac0c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7f2bb3de0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bac0caf10 0x7f2bac14c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7f2bb3de0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bac0cc830 0x7f2bac14ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7f2bb3de0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac1441b0 con 0x7f2bac0cc830 2023-08-25T04:43:48.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7f2bb3de0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac167c80 con 0x7f2bac0caf10 2023-08-25T04:43:48.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.847+0000 7f2bb3de0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac1435a0 con 0x7f2bac070eb0 2023-08-25T04:43:48.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f2bb137b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bac0caf10 0x7f2bac14c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f2bb237d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bac0cc830 0x7f2bac14ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f2bb1b7c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bac070eb0 0x7f2bac0c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f2bb137b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bac0caf10 0x7f2bac14c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36534/0 (socket says 172.21.15.16:36534) 2023-08-25T04:43:48.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f2bb237d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bac0cc830 0x7f2bac14ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49206/0 (socket says 172.21.15.16:49206) 2023-08-25T04:43:48.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f2bb137b700 1 -- 172.21.15.16:0/334976225 learned_addr learned my addr 172.21.15.16:0/334976225 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:48.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f2bb137b700 1 -- 172.21.15.16:0/334976225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bac070eb0 msgr2=0x7f2bac0c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f2bb137b700 1 --2- 172.21.15.16:0/334976225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bac070eb0 0x7f2bac0c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f2bb137b700 1 -- 172.21.15.16:0/334976225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bac0cc830 msgr2=0x7f2bac14ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f2bb137b700 1 --2- 172.21.15.16:0/334976225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bac0cc830 0x7f2bac14ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f2bb137b700 1 -- 172.21.15.16:0/334976225 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c0094a0 con 0x7f2bac0caf10 2023-08-25T04:43:48.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7fe41ca41700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.16:6808/1569731109,v1:172.21.15.16:6811/1569731109] conn(0x7fe404072a70 0x7fe404074e90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f0c267fc700 1 -- 172.21.15.16:0/4100168632 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800d890 con 0x7f0c3006a5e0 2023-08-25T04:43:48.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f0c267fc700 1 -- 172.21.15.16:0/4100168632 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2800d9f0 con 0x7f0c3006a5e0 2023-08-25T04:43:48.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f0c267fc700 1 -- 172.21.15.16:0/4100168632 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800dda0 con 0x7f0c3006a5e0 2023-08-25T04:43:48.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f0c38039700 1 -- 172.21.15.16:0/4100168632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c300c4140 con 0x7f0c3006a5e0 2023-08-25T04:43:48.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f0c38039700 1 -- 172.21.15.16:0/4100168632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3015f230 con 0x7f0c3006a5e0 2023-08-25T04:43:48.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f50dd547700 1 --2- 172.21.15.16:0/540802883 >> v2:172.21.15.117:3300/0 conn(0x7f50d806aa50 0x7f50d8071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.848+0000 7f50de549700 1 --2- 172.21.15.16:0/540802883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d80cf6b0 0x7f50d80cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7f2bb137b700 1 --2- 172.21.15.16:0/334976225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bac0caf10 0x7f2bac14c8e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009f80 tx=0x7f2b9c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7f50dd547700 1 -- 172.21.15.16:0/540802883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d80cf6b0 msgr2=0x7f50d80cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:48.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7f50dd547700 1 --2- 172.21.15.16:0/540802883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d80cf6b0 0x7f50d80cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7f50dd547700 1 -- 172.21.15.16:0/540802883 >> v1:172.21.15.16:6789/0 conn(0x7f50d8161780 legacy=0x7f50d806a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7f50dd547700 1 -- 172.21.15.16:0/540802883 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d8071910 con 0x7f50d806aa50 2023-08-25T04:43:48.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7f50dd547700 1 --2- 172.21.15.16:0/540802883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d806aa50 0x7f50d8071da0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009840 tx=0x7f50c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5691cd99a285a3b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7fcd2661a700 1 -- 172.21.15.16:0/1393706130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd200cd930 msgr2=0x7fcd2006b880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T04:43:48.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7fcd2661a700 1 --2- 172.21.15.16:0/1393706130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd200cd930 0x7fcd2006b880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7fcd2661a700 1 -- 172.21.15.16:0/1393706130 >> v1:172.21.15.117:6789/0 conn(0x7fcd2006d3b0 legacy=0x7fcd200ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7fcd2661a700 1 -- 172.21.15.16:0/1393706130 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd200cd130 con 0x7fcd2016b0d0 2023-08-25T04:43:48.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7f2ba27fc700 1 -- 172.21.15.16:0/334976225 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c003e50 con 0x7f2bac0caf10 2023-08-25T04:43:48.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7f2ba27fc700 1 -- 172.21.15.16:0/334976225 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c010590 con 0x7f2bac0caf10 2023-08-25T04:43:48.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7f2ba27fc700 1 -- 172.21.15.16:0/334976225 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c010940 con 0x7f2bac0caf10 2023-08-25T04:43:48.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7fe414ff9700 1 -- 172.21.15.16:0/3680686607 <== osd.3 v2:172.21.15.16:6808/1569731109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe404075540 con 0x7fe404072a70 2023-08-25T04:43:48.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7f2bb3de0700 1 -- 172.21.15.16:0/334976225 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac143880 con 0x7f2bac0caf10 2023-08-25T04:43:48.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7f2bb3de0700 1 -- 172.21.15.16:0/334976225 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac143e40 con 0x7f2bac0caf10 2023-08-25T04:43:48.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7f50dcd46700 1 -- 172.21.15.16:0/540802883 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8011830 con 0x7f50d806aa50 2023-08-25T04:43:48.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7f50dcd46700 1 -- 172.21.15.16:0/540802883 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c8011990 con 0x7f50d806aa50 2023-08-25T04:43:48.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.850+0000 7f50dcd46700 1 -- 172.21.15.16:0/540802883 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8011d00 con 0x7f50d806aa50 2023-08-25T04:43:48.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.850+0000 7fc1831be700 1 Processor -- start 2023-08-25T04:43:48.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.850+0000 7fc1831be700 1 -- start start 2023-08-25T04:43:48.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.849+0000 7fcd2661a700 1 --2- 172.21.15.16:0/1393706130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd2016b0d0 0x7fcd2006bdc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800be90 tx=0x7fcd1800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a364ebbd5fd0906c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.850+0000 7f2bb3de0700 1 -- 172.21.15.16:0/334976225 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2bac0cbc70 con 0x7f2bac0caf10 2023-08-25T04:43:48.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7f50dffac700 1 -- 172.21.15.16:0/540802883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d806aa50 msgr2=0x7f50d8071da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7f50dffac700 1 --2- 172.21.15.16:0/540802883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d806aa50 0x7f50d8071da0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009840 tx=0x7f50c8009b50 comp rx=0 tx=0).stop 2023-08-25T04:43:48.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7fc1831be700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc17c0cf970 0x7fc17c1f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7fc1831be700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc17c15cf40 0x7fc17c0c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7fc1831be700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c15d320 0x7fc17c1f9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7fc1831be700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0b4910 con 0x7fc17c15d320 2023-08-25T04:43:48.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7fc1831be700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1f7400 con 0x7fc17c0cf970 2023-08-25T04:43:48.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7fc180f5a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc17c0cf970 0x7fc17c1f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7fc180f5a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc17c0cf970 0x7fc17c1f6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36538/0 (socket says 172.21.15.16:36538) 2023-08-25T04:43:48.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7fc180f5a700 1 -- 172.21.15.16:0/627277969 learned_addr learned my addr 172.21.15.16:0/627277969 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:48.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7fc1831be700 1 -- 172.21.15.16:0/627277969 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0b38b0 con 0x7fc17c15cf40 2023-08-25T04:43:48.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7fc18175b700 1 --2- 172.21.15.16:0/627277969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c15d320 0x7fc17c1f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7fc173fff700 1 --2- 172.21.15.16:0/627277969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc17c15cf40 0x7fc17c0c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7fc180f5a700 1 -- 172.21.15.16:0/627277969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc17c15cf40 msgr2=0x7fc17c0c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7fc180f5a700 1 --2- 172.21.15.16:0/627277969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc17c15cf40 0x7fc17c0c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7fc180f5a700 1 -- 172.21.15.16:0/627277969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c15d320 msgr2=0x7fc17c1f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7fc180f5a700 1 --2- 172.21.15.16:0/627277969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c15d320 0x7fc17c1f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7fc180f5a700 1 -- 172.21.15.16:0/627277969 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c009550 con 0x7fc17c0cf970 2023-08-25T04:43:48.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7fe417fff700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe40406a1b0 0x7fe40406c670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0099b0 tx=0x7fe40c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7f0c267fc700 1 -- 172.21.15.16:0/4100168632 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0c28006d50 con 0x7f0c3006a5e0 2023-08-25T04:43:48.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7f0c38039700 1 -- 172.21.15.16:0/4100168632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c3015e430 con 0x7f0c3006a5e0 2023-08-25T04:43:48.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7f0c267fc700 1 --2- 172.21.15.16:0/4100168632 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0c1406a130 0x7f0c1406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7eff6c8e0700 1 -- 172.21.15.16:0/3791752170 >> v2:172.21.15.117:3300/0 conn(0x7eff681651b0 msgr2=0x7eff68165620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:48.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7eff6c8e0700 1 --2- 172.21.15.16:0/3791752170 >> v2:172.21.15.117:3300/0 conn(0x7eff681651b0 0x7eff68165620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7eff6c8e0700 1 -- 172.21.15.16:0/3791752170 >> v1:172.21.15.117:6789/0 conn(0x7eff680c2220 legacy=0x7eff6815e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7eff6c8e0700 1 -- 172.21.15.16:0/3791752170 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff680c9440 con 0x7eff680caf60 2023-08-25T04:43:48.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.851+0000 7eff6c8e0700 1 --2- 172.21.15.16:0/3791752170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff680caf60 0x7eff6815f080 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7eff680b4bf0 tx=0x7eff58009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163ca5f2f673a9b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7f2ba27fc700 1 -- 172.21.15.16:0/334976225 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2b9c010aa0 con 0x7f2bac0caf10 2023-08-25T04:43:48.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7f50dffac700 1 -- 172.21.15.16:0/540802883 shutdown_connections 2023-08-25T04:43:48.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7f50dffac700 1 --2- 172.21.15.16:0/540802883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d80cf6b0 0x7f50d80cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7f50dffac700 1 --2- 172.21.15.16:0/540802883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d806aa50 0x7f50d8071da0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7f50dffac700 1 -- 172.21.15.16:0/540802883 >> 172.21.15.16:0/540802883 conn(0x7f50d80b1a10 msgr2=0x7f50d80b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7fc180f5a700 1 --2- 172.21.15.16:0/627277969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc17c0cf970 0x7fc17c1f6ec0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc17800b840 tx=0x7fc17800bb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7f50dffac700 1 -- 172.21.15.16:0/540802883 shutdown_connections 2023-08-25T04:43:48.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7f50dffac700 1 -- 172.21.15.16:0/540802883 wait complete. 2023-08-25T04:43:48.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7fc1717fa700 1 -- 172.21.15.16:0/627277969 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178010800 con 0x7fc17c0cf970 2023-08-25T04:43:48.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7fc1717fa700 1 -- 172.21.15.16:0/627277969 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc178010960 con 0x7fc17c0cf970 2023-08-25T04:43:48.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7fc1831be700 1 -- 172.21.15.16:0/627277969 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c0b3fe0 con 0x7fc17c0cf970 2023-08-25T04:43:48.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.852+0000 7f0c267fc700 1 -- 172.21.15.16:0/4100168632 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c280882e0 con 0x7f0c3006a5e0 2023-08-25T04:43:48.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7f0c267fc700 1 --2- 172.21.15.16:0/4100168632 >> [v2:172.21.15.117:6816/2302216214,v1:172.21.15.117:6817/2302216214] conn(0x7f0c14072970 0x7f0c14074d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7f0c267fc700 1 -- 172.21.15.16:0/4100168632 --> [v2:172.21.15.117:6816/2302216214,v1:172.21.15.117:6817/2302216214] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c14075440 con 0x7f0c14072970 2023-08-25T04:43:48.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7f0c267fc700 1 -- 172.21.15.16:0/4100168632 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c28053970 con 0x7f0c3006a5e0 2023-08-25T04:43:48.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7fc1717fa700 1 -- 172.21.15.16:0/627277969 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178010d10 con 0x7fc17c0cf970 2023-08-25T04:43:48.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7fc1831be700 1 -- 172.21.15.16:0/627277969 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c0b45a0 con 0x7fc17c0cf970 2023-08-25T04:43:48.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7f0c35dd5700 1 --2- 172.21.15.16:0/4100168632 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0c1406a130 0x7f0c1406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7fcd24e17700 1 -- 172.21.15.16:0/1393706130 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18010070 con 0x7fcd2016b0d0 2023-08-25T04:43:48.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7fcd24e17700 1 -- 172.21.15.16:0/1393706130 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18003a20 con 0x7fcd2016b0d0 2023-08-25T04:43:48.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7fcd24e17700 1 -- 172.21.15.16:0/1393706130 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18003db0 con 0x7fcd2016b0d0 2023-08-25T04:43:48.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7eff5ffff700 1 -- 172.21.15.16:0/3791752170 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58004230 con 0x7eff680caf60 2023-08-25T04:43:48.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7eff5ffff700 1 -- 172.21.15.16:0/3791752170 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff58004390 con 0x7eff680caf60 2023-08-25T04:43:48.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7eff5ffff700 1 -- 172.21.15.16:0/3791752170 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff580036a0 con 0x7eff680caf60 2023-08-25T04:43:48.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7f2ba27fc700 1 --2- 172.21.15.16:0/334976225 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f2b9006a130 0x7f2b9006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7f2ba27fc700 1 -- 172.21.15.16:0/334976225 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b9c089a30 con 0x7f2bac0caf10 2023-08-25T04:43:48.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7f2ba27fc700 1 --2- 172.21.15.16:0/334976225 >> [v2:172.21.15.16:6800/3011235108,v1:172.21.15.16:6801/3011235108] conn(0x7f2b900729f0 0x7f2b90074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7f2ba27fc700 1 -- 172.21.15.16:0/334976225 --> [v2:172.21.15.16:6800/3011235108,v1:172.21.15.16:6801/3011235108] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b900754c0 con 0x7f2b900729f0 2023-08-25T04:43:48.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7f2ba27fc700 1 -- 172.21.15.16:0/334976225 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b9c08bea0 con 0x7f2bac0caf10 2023-08-25T04:43:48.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7f2bb237d700 1 --2- 172.21.15.16:0/334976225 >> [v2:172.21.15.16:6800/3011235108,v1:172.21.15.16:6801/3011235108] conn(0x7f2b900729f0 0x7f2b90074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.853+0000 7f0c355d4700 1 --2- 172.21.15.16:0/4100168632 >> [v2:172.21.15.117:6816/2302216214,v1:172.21.15.117:6817/2302216214] conn(0x7f0c14072970 0x7f0c14074d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.854+0000 7fc1831be700 1 -- 172.21.15.16:0/627277969 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc15c000fc0 con 0x7fc17c0cf970 2023-08-25T04:43:48.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.854+0000 7f2bb1b7c700 1 --2- 172.21.15.16:0/334976225 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f2b9006a130 0x7f2b9006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.855+0000 7eff6f345700 1 -- 172.21.15.16:0/3791752170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff680caf60 msgr2=0x7eff6815f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.855+0000 7eff6f345700 1 --2- 172.21.15.16:0/3791752170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff680caf60 0x7eff6815f080 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7eff680b4bf0 tx=0x7eff58009b20 comp rx=0 tx=0).stop 2023-08-25T04:43:48.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.854+0000 7f2bb237d700 1 --2- 172.21.15.16:0/334976225 >> [v2:172.21.15.16:6800/3011235108,v1:172.21.15.16:6801/3011235108] conn(0x7f2b900729f0 0x7f2b90074e10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.855+0000 7eff6f345700 1 -- 172.21.15.16:0/3791752170 shutdown_connections 2023-08-25T04:43:48.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.855+0000 7eff6f345700 1 --2- 172.21.15.16:0/3791752170 >> v2:172.21.15.117:3300/0 conn(0x7eff681651b0 0x7eff68165620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.855+0000 7eff6f345700 1 --2- 172.21.15.16:0/3791752170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff680caf60 0x7eff6815f080 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.855+0000 7eff6f345700 1 -- 172.21.15.16:0/3791752170 >> 172.21.15.16:0/3791752170 conn(0x7eff680cecc0 msgr2=0x7eff680cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.855+0000 7f2bb1b7c700 1 --2- 172.21.15.16:0/334976225 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f2b9006a130 0x7f2b9006c5f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8007c60 tx=0x7f2ba8007bb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.855+0000 7fcd2807d700 1 -- 172.21.15.16:0/1393706130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd2016b0d0 msgr2=0x7fcd2006bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.855+0000 7fcd2807d700 1 --2- 172.21.15.16:0/1393706130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd2016b0d0 0x7fcd2006bdc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800be90 tx=0x7fcd1800d330 comp rx=0 tx=0).stop 2023-08-25T04:43:48.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f0c355d4700 1 --2- 172.21.15.16:0/4100168632 >> [v2:172.21.15.117:6816/2302216214,v1:172.21.15.117:6817/2302216214] conn(0x7f0c14072970 0x7f0c14074d90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f2ba27fc700 1 -- 172.21.15.16:0/334976225 <== osd.1 v2:172.21.15.16:6800/3011235108 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2b900754c0 con 0x7f2b900729f0 2023-08-25T04:43:48.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7eff6f345700 1 -- 172.21.15.16:0/3791752170 shutdown_connections 2023-08-25T04:43:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7fc1717fa700 1 -- 172.21.15.16:0/627277969 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc178019450 con 0x7fc17c0cf970 2023-08-25T04:43:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7fc1717fa700 1 --2- 172.21.15.16:0/627277969 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc16406a2f0 0x7fc16406c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7fc1717fa700 1 -- 172.21.15.16:0/627277969 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc178088b70 con 0x7fc17c0cf970 2023-08-25T04:43:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7fc1717fa700 1 --2- 172.21.15.16:0/627277969 >> [v2:172.21.15.16:6809/1681052994,v1:172.21.15.16:6810/1681052994] conn(0x7fc164072bb0 0x7fc164074fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7fc1717fa700 1 -- 172.21.15.16:0/627277969 --> [v2:172.21.15.16:6809/1681052994,v1:172.21.15.16:6810/1681052994] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc164075680 con 0x7fc164072bb0 2023-08-25T04:43:48.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7fc1717fa700 1 -- 172.21.15.16:0/627277969 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc178089010 con 0x7fc17c0cf970 2023-08-25T04:43:48.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.857+0000 7f0c267fc700 1 -- 172.21.15.16:0/4100168632 <== osd.4 v2:172.21.15.117:6816/2302216214 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0c14075440 con 0x7f0c14072970 2023-08-25T04:43:48.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.857+0000 7f0c35dd5700 1 --2- 172.21.15.16:0/4100168632 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0c1406a130 0x7f0c1406c5f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c20013040 tx=0x7f0c20008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.854+0000 7f50dffac700 1 Processor -- start 2023-08-25T04:43:48.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.854+0000 7f50dffac700 1 -- start start 2023-08-25T04:43:48.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50dffac700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50d806aa50 0x7f50d8159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50dffac700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d80cf6b0 0x7f50d81602a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50dffac700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d8161780 0x7f50d8145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50dffac700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d80c3b10 con 0x7f50d806aa50 2023-08-25T04:43:48.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50dffac700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d80c3df0 con 0x7f50d8161780 2023-08-25T04:43:48.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50dffac700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d80c40d0 con 0x7f50d80cf6b0 2023-08-25T04:43:48.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50ddd48700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50d806aa50 0x7f50d8159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50ddd48700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50d806aa50 0x7f50d8159b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49222/0 (socket says 172.21.15.16:49222) 2023-08-25T04:43:48.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50ddd48700 1 -- 172.21.15.16:0/1879458892 learned_addr learned my addr 172.21.15.16:0/1879458892 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:48.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50dd547700 1 --2- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d80cf6b0 0x7f50d81602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50ddd48700 1 -- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d80cf6b0 msgr2=0x7f50d81602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50ddd48700 1 --2- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d80cf6b0 0x7f50d81602a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50ddd48700 1 -- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d8161780 msgr2=0x7f50d8145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50ddd48700 1 --2- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d8161780 0x7f50d8145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50ddd48700 1 -- 172.21.15.16:0/1879458892 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c80094a0 con 0x7f50d806aa50 2023-08-25T04:43:48.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7f50ddd48700 1 --2- 172.21.15.16:0/1879458892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50d806aa50 0x7f50d8159b80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f50d400c480 tx=0x7f50d400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.857+0000 7f50ce7fc700 1 -- 172.21.15.16:0/1879458892 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4005d70 con 0x7f50d806aa50 2023-08-25T04:43:48.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.857+0000 7f50ce7fc700 1 -- 172.21.15.16:0/1879458892 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d40070d0 con 0x7f50d806aa50 2023-08-25T04:43:48.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.857+0000 7f50dffac700 1 -- 172.21.15.16:0/1879458892 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d80c43b0 con 0x7f50d806aa50 2023-08-25T04:43:48.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.857+0000 7fc18175b700 1 --2- 172.21.15.16:0/627277969 >> [v2:172.21.15.16:6809/1681052994,v1:172.21.15.16:6810/1681052994] conn(0x7fc164072bb0 0x7fc164074fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.857+0000 7fc173fff700 1 --2- 172.21.15.16:0/627277969 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc16406a2f0 0x7fc16406c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.857+0000 7f50dffac700 1 -- 172.21.15.16:0/1879458892 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d8145f90 con 0x7f50d806aa50 2023-08-25T04:43:48.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.856+0000 7eff6f345700 1 -- 172.21.15.16:0/3791752170 wait complete. 2023-08-25T04:43:48.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.857+0000 7fcd2807d700 1 -- 172.21.15.16:0/1393706130 shutdown_connections 2023-08-25T04:43:48.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.857+0000 7fcd2807d700 1 --2- 172.21.15.16:0/1393706130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd2016b0d0 0x7fcd2006bdc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.857+0000 7fcd2807d700 1 --2- 172.21.15.16:0/1393706130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd200cd930 0x7fcd2006b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.857+0000 7fcd2807d700 1 -- 172.21.15.16:0/1393706130 >> 172.21.15.16:0/1393706130 conn(0x7fcd200cecc0 msgr2=0x7fcd200cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.857+0000 7f50ce7fc700 1 -- 172.21.15.16:0/1879458892 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4007440 con 0x7f50d806aa50 2023-08-25T04:43:48.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.858+0000 7f50dffac700 1 -- 172.21.15.16:0/1879458892 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50c0000fc0 con 0x7f50d806aa50 2023-08-25T04:43:48.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.858+0000 7eff6f345700 1 Processor -- start 2023-08-25T04:43:48.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.858+0000 7fcd2807d700 1 -- 172.21.15.16:0/1393706130 shutdown_connections 2023-08-25T04:43:48.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.858+0000 7fcd2807d700 1 -- 172.21.15.16:0/1393706130 wait complete. 2023-08-25T04:43:48.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.858+0000 7fc18175b700 1 --2- 172.21.15.16:0/627277969 >> [v2:172.21.15.16:6809/1681052994,v1:172.21.15.16:6810/1681052994] conn(0x7fc164072bb0 0x7fc164074fd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.858+0000 7fc173fff700 1 --2- 172.21.15.16:0/627277969 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc16406a2f0 0x7fc16406c7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0cfde0 tx=0x7fc16c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.858+0000 7eff6f345700 1 -- start start 2023-08-25T04:43:48.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.859+0000 7eff6f345700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff680c2220 0x7eff680b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.859+0000 7eff6f345700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff680caf60 0x7eff6815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.859+0000 7eff6f345700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff681651b0 0x7eff681fe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.859+0000 7eff6f345700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff680b2880 con 0x7eff680caf60 2023-08-25T04:43:48.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.859+0000 7eff6f345700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff680b36a0 con 0x7eff681651b0 2023-08-25T04:43:48.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.859+0000 7eff6f345700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff680b25a0 con 0x7eff680c2220 2023-08-25T04:43:48.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.859+0000 7eff6d0e1700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff680c2220 0x7eff680b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.860+0000 7eff6d0e1700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff680c2220 0x7eff680b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:49774/0 (socket says 172.21.15.16:49774) 2023-08-25T04:43:48.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.860+0000 7eff6d0e1700 1 -- 172.21.15.16:0/1637427454 learned_addr learned my addr 172.21.15.16:0/1637427454 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:48.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.860+0000 7eff6d8e2700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff681651b0 0x7eff681fe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.860+0000 7fcd2807d700 1 Processor -- start 2023-08-25T04:43:48.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.860+0000 7fcd2807d700 1 -- start start 2023-08-25T04:43:48.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.860+0000 7eff6c8e0700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff680caf60 0x7eff6815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.860+0000 7eff6d0e1700 1 -- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff681651b0 msgr2=0x7eff681fe9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.860+0000 7eff6d0e1700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff681651b0 0x7eff681fe9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.860+0000 7eff6d0e1700 1 -- 172.21.15.16:0/1637427454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff680caf60 msgr2=0x7eff6815d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.860+0000 7eff6d0e1700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff680caf60 0x7eff6815d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.860+0000 7eff6d0e1700 1 -- 172.21.15.16:0/1637427454 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff580094a0 con 0x7eff680c2220 2023-08-25T04:43:48.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.860+0000 7eff6c8e0700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff680caf60 0x7eff6815d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:48.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.860+0000 7eff6d0e1700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff680c2220 0x7eff680b3b30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7eff6400c730 tx=0x7eff6400caf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.861+0000 7fcd2807d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd2006d3b0 0x7fcd2016a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.861+0000 7fcd2807d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd200cd930 0x7fcd200b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.861+0000 7fcd2807d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd2016b0d0 0x7fcd200b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.861+0000 7fcd2807d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2016a7b0 con 0x7fcd200cd930 2023-08-25T04:43:48.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.861+0000 7fcd2807d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200b4a70 con 0x7fcd2006d3b0 2023-08-25T04:43:48.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.861+0000 7fcd2807d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200b40a0 con 0x7fcd2016b0d0 2023-08-25T04:43:48.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.861+0000 7fcd25e19700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd2006d3b0 0x7fcd2016a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.861+0000 7fcd25e19700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd2006d3b0 0x7fcd2016a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36568/0 (socket says 172.21.15.16:36568) 2023-08-25T04:43:48.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.861+0000 7fcd25e19700 1 -- 172.21.15.16:0/1343930172 learned_addr learned my addr 172.21.15.16:0/1343930172 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:48.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.861+0000 7fcd2661a700 1 --2- 172.21.15.16:0/1343930172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd2016b0d0 0x7fcd200b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.861+0000 7fcd25e19700 1 -- 172.21.15.16:0/1343930172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd2016b0d0 msgr2=0x7fcd200b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.861+0000 7fcd25e19700 1 --2- 172.21.15.16:0/1343930172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd2016b0d0 0x7fcd200b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.862+0000 7fcd25e19700 1 -- 172.21.15.16:0/1343930172 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd200cd930 msgr2=0x7fcd200b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.862+0000 7fcd25e19700 1 --2- 172.21.15.16:0/1343930172 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd200cd930 0x7fcd200b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.862+0000 7fcd25e19700 1 -- 172.21.15.16:0/1343930172 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1800bb70 con 0x7fcd2006d3b0 2023-08-25T04:43:48.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.862+0000 7eff5dffb700 1 -- 172.21.15.16:0/1637427454 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff640054e0 con 0x7eff680c2220 2023-08-25T04:43:48.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.862+0000 7eff5dffb700 1 -- 172.21.15.16:0/1637427454 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff64003680 con 0x7eff680c2220 2023-08-25T04:43:48.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.862+0000 7eff5dffb700 1 -- 172.21.15.16:0/1637427454 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64003a30 con 0x7eff680c2220 2023-08-25T04:43:48.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.862+0000 7fcd25e19700 1 --2- 172.21.15.16:0/1343930172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd2006d3b0 0x7fcd2016a270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00bda0 tx=0x7fcd1c00bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.863+0000 7f50ce7fc700 1 -- 172.21.15.16:0/1879458892 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f50d40075a0 con 0x7f50d806aa50 2023-08-25T04:43:48.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.863+0000 7eff6f345700 1 -- 172.21.15.16:0/1637427454 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff680b3050 con 0x7eff680c2220 2023-08-25T04:43:48.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.863+0000 7eff6f345700 1 -- 172.21.15.16:0/1637427454 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6815d920 con 0x7eff680c2220 2023-08-25T04:43:48.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.863+0000 7f50ce7fc700 1 --2- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f50bc06a0e0 0x7f50bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.863+0000 7f50ce7fc700 1 -- 172.21.15.16:0/1879458892 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50d4088210 con 0x7f50d806aa50 2023-08-25T04:43:48.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.863+0000 7fc1717fa700 1 -- 172.21.15.16:0/627277969 <== osd.0 v2:172.21.15.16:6809/1681052994 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc164075680 con 0x7fc164072bb0 2023-08-25T04:43:48.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.863+0000 7f50ce7fc700 1 --2- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:6806/3890202206,v1:172.21.15.117:6808/3890202206] conn(0x7f50bc072920 0x7f50bc074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.863+0000 7f50ce7fc700 1 -- 172.21.15.16:0/1879458892 --> [v2:172.21.15.117:6806/3890202206,v1:172.21.15.117:6808/3890202206] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50bc0753f0 con 0x7f50bc072920 2023-08-25T04:43:48.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.863+0000 7f50ce7fc700 1 -- 172.21.15.16:0/1879458892 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50d4088580 con 0x7f50d806aa50 2023-08-25T04:43:48.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.864+0000 7f50de549700 1 --2- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:6806/3890202206,v1:172.21.15.117:6808/3890202206] conn(0x7f50bc072920 0x7f50bc074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.864+0000 7eff6f345700 1 -- 172.21.15.16:0/1637427454 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7eff6815f5c0 con 0x7eff680c2220 2023-08-25T04:43:48.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.864+0000 7eff5dffb700 1 -- 172.21.15.16:0/1637427454 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7eff64003b90 con 0x7eff680c2220 2023-08-25T04:43:48.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.864+0000 7f50dd547700 1 --2- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f50bc06a0e0 0x7f50bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.865+0000 7eff5dffb700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7eff4c06a0e0 0x7eff4c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.865+0000 7eff5dffb700 1 -- 172.21.15.16:0/1637427454 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff64087740 con 0x7eff680c2220 2023-08-25T04:43:48.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.865+0000 7eff6c8e0700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7eff4c06a0e0 0x7eff4c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.865+0000 7eff5dffb700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:6824/3606866589,v1:172.21.15.117:6825/3606866589] conn(0x7eff4c072920 0x7eff4c074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.865+0000 7eff5dffb700 1 -- 172.21.15.16:0/1637427454 --> [v2:172.21.15.117:6824/3606866589,v1:172.21.15.117:6825/3606866589] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff4c0753f0 con 0x7eff4c072920 2023-08-25T04:43:48.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.865+0000 7eff5dffb700 1 -- 172.21.15.16:0/1637427454 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff64089d20 con 0x7eff680c2220 2023-08-25T04:43:48.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.865+0000 7f50de549700 1 --2- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:6806/3890202206,v1:172.21.15.117:6808/3890202206] conn(0x7f50bc072920 0x7f50bc074d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.865+0000 7f50dd547700 1 --2- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f50bc06a0e0 0x7f50bc06c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f50c80090b0 tx=0x7f50c8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.865+0000 7eff6d8e2700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:6824/3606866589,v1:172.21.15.117:6825/3606866589] conn(0x7eff4c072920 0x7eff4c074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.865+0000 7eff6c8e0700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7eff4c06a0e0 0x7eff4c06c5a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7eff58009b60 tx=0x7eff58008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.865+0000 7f1afc3f4700 1 Processor -- start 2023-08-25T04:43:48.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.866+0000 7f1afc3f4700 1 -- start start 2023-08-25T04:43:48.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.866+0000 7eff6d8e2700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:6824/3606866589,v1:172.21.15.117:6825/3606866589] conn(0x7eff4c072920 0x7eff4c074d40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.866+0000 7f50ce7fc700 1 -- 172.21.15.16:0/1879458892 <== osd.5 v2:172.21.15.117:6806/3890202206 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f50bc0753f0 con 0x7f50bc072920 2023-08-25T04:43:48.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.867+0000 7f1afc3f4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af406c4e0 0x7f1af40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.867+0000 7f1afc3f4700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af406c050 con 0x7f1af415d3b0 2023-08-25T04:43:48.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.867+0000 7f1afc3f4700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af406d600 con 0x7f1af406c960 2023-08-25T04:43:48.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.867+0000 7f1afc3f4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af406ba00 con 0x7f1af406c4e0 2023-08-25T04:43:48.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.867+0000 7f1af998f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af406c4e0 0x7f1af40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.867+0000 7f1afa991700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1af406c960 0x7f1af40ac850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.16:47766/0 (socket says 172.21.15.16:47766) 2023-08-25T04:43:48.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.867+0000 7f1af998f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af406c4e0 0x7f1af40cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:49796/0 (socket says 172.21.15.16:49796) 2023-08-25T04:43:48.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.867+0000 7f1afa991700 1 -- 172.21.15.16:0/352829206 learned_addr learned my addr 172.21.15.16:0/352829206 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:48.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.867+0000 7f1af918e700 1 -- 172.21.15.16:0/352829206 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371860621 0 0) 0x7f1af406d600 con 0x7f1af406c960 2023-08-25T04:43:48.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.867+0000 7f1af998f700 1 -- 172.21.15.16:0/352829206 >> v1:172.21.15.117:6789/0 conn(0x7f1af406c960 legacy=0x7f1af40ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.867+0000 7f1af998f700 1 -- 172.21.15.16:0/352829206 >> v1:172.21.15.16:6789/0 conn(0x7f1af415d3b0 legacy=0x7f1af4161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:48.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.867+0000 7f1af998f700 1 -- 172.21.15.16:0/352829206 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af406bce0 con 0x7f1af406c4e0 2023-08-25T04:43:48.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.868+0000 7f1af998f700 1 --2- 172.21.15.16:0/352829206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af406c4e0 0x7f1af40cc890 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009dc0 tx=0x7f1aec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a06846e9ba8da80 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.868+0000 7f1af918e700 1 -- 172.21.15.16:0/352829206 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00e070 con 0x7f1af406c4e0 2023-08-25T04:43:48.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.868+0000 7f1af918e700 1 -- 172.21.15.16:0/352829206 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec00bb90 con 0x7f1af406c4e0 2023-08-25T04:43:48.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.868+0000 7f1af918e700 1 -- 172.21.15.16:0/352829206 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec003a20 con 0x7f1af406c4e0 2023-08-25T04:43:48.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.869+0000 7eff5dffb700 1 -- 172.21.15.16:0/1637427454 <== osd.7 v2:172.21.15.117:6824/3606866589 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7eff4c0753f0 con 0x7eff4c072920 2023-08-25T04:43:48.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.869+0000 7f1afc3f4700 1 -- 172.21.15.16:0/352829206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af406c4e0 msgr2=0x7f1af40cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.869+0000 7f1afc3f4700 1 --2- 172.21.15.16:0/352829206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af406c4e0 0x7f1af40cc890 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009dc0 tx=0x7f1aec00b330 comp rx=0 tx=0).stop 2023-08-25T04:43:48.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.869+0000 7f1afc3f4700 1 -- 172.21.15.16:0/352829206 shutdown_connections 2023-08-25T04:43:48.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.869+0000 7f1afc3f4700 1 --2- 172.21.15.16:0/352829206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af406c4e0 0x7f1af40cc890 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.869+0000 7f1afc3f4700 1 -- 172.21.15.16:0/352829206 >> 172.21.15.16:0/352829206 conn(0x7f1af40cecc0 msgr2=0x7f1af40cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.869+0000 7f1afc3f4700 1 -- 172.21.15.16:0/352829206 shutdown_connections 2023-08-25T04:43:48.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.869+0000 7f1afc3f4700 1 -- 172.21.15.16:0/352829206 wait complete. 2023-08-25T04:43:48.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.870+0000 7f1afc3f4700 1 Processor -- start 2023-08-25T04:43:48.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.870+0000 7f1afc3f4700 1 -- start start 2023-08-25T04:43:48.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.871+0000 7f1afc3f4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1af406c4e0 0x7f1af414b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.871+0000 7f1afc3f4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1af406c960 0x7f1af40b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.871+0000 7f1afc3f4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af415d3b0 0x7f1af4157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.871+0000 7f1afc3f4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af414b5d0 con 0x7f1af406c4e0 2023-08-25T04:43:48.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.871+0000 7f1afc3f4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40c5d90 con 0x7f1af406c960 2023-08-25T04:43:48.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.871+0000 7f1afc3f4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40c6bf0 con 0x7f1af415d3b0 2023-08-25T04:43:48.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.871+0000 7f1af998f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1af406c960 0x7f1af40b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.871+0000 7f1afa991700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af415d3b0 0x7f1af4157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.871+0000 7f1af998f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1af406c960 0x7f1af40b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36592/0 (socket says 172.21.15.16:36592) 2023-08-25T04:43:48.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.871+0000 7f1af998f700 1 -- 172.21.15.16:0/169650902 learned_addr learned my addr 172.21.15.16:0/169650902 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:48.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.871+0000 7f1afa991700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af415d3b0 0x7f1af4157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:49802/0 (socket says 172.21.15.16:49802) 2023-08-25T04:43:48.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.872+0000 7f1af998f700 1 -- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af415d3b0 msgr2=0x7f1af4157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.872+0000 7f1af998f700 1 --2- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1af415d3b0 0x7f1af4157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.872+0000 7f1af998f700 1 -- 172.21.15.16:0/169650902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1af406c4e0 msgr2=0x7f1af414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.872+0000 7f1af998f700 1 --2- 172.21.15.16:0/169650902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1af406c4e0 0x7f1af414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.872+0000 7f1af998f700 1 -- 172.21.15.16:0/169650902 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec009a70 con 0x7f1af406c960 2023-08-25T04:43:48.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.872+0000 7f1af998f700 1 --2- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1af406c960 0x7f1af40b3a60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1af40b18b0 tx=0x7f1aec004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.872+0000 7f1aeaffd700 1 -- 172.21.15.16:0/169650902 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec012630 con 0x7f1af406c960 2023-08-25T04:43:48.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.872+0000 7f1aeaffd700 1 -- 172.21.15.16:0/169650902 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec0127b0 con 0x7f1af406c960 2023-08-25T04:43:48.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.872+0000 7f1aeaffd700 1 -- 172.21.15.16:0/169650902 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec012b60 con 0x7f1af406c960 2023-08-25T04:43:48.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.872+0000 7f1afc3f4700 1 -- 172.21.15.16:0/169650902 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af40c5fe0 con 0x7f1af406c960 2023-08-25T04:43:48.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.872+0000 7f1afc3f4700 1 -- 172.21.15.16:0/169650902 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af40c65a0 con 0x7f1af406c960 2023-08-25T04:43:48.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.873+0000 7f1afc3f4700 1 -- 172.21.15.16:0/169650902 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1af40cd630 con 0x7f1af406c960 2023-08-25T04:43:48.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.875+0000 7fcd167fc700 1 -- 172.21.15.16:0/1343930172 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c010ea0 con 0x7fcd2006d3b0 2023-08-25T04:43:48.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.875+0000 7fcd167fc700 1 -- 172.21.15.16:0/1343930172 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c019670 con 0x7fcd2006d3b0 2023-08-25T04:43:48.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.875+0000 7fcd2807d700 1 -- 172.21.15.16:0/1343930172 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd200b3490 con 0x7fcd2006d3b0 2023-08-25T04:43:48.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.875+0000 7fcd2807d700 1 -- 172.21.15.16:0/1343930172 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd200b3a50 con 0x7fcd2006d3b0 2023-08-25T04:43:48.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.876+0000 7f1aeaffd700 1 -- 172.21.15.16:0/169650902 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1aec012cc0 con 0x7f1af406c960 2023-08-25T04:43:48.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.875+0000 7fcd167fc700 1 -- 172.21.15.16:0/1343930172 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c019a20 con 0x7fcd2006d3b0 2023-08-25T04:43:48.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.876+0000 7f1aeaffd700 1 --2- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1ad806a0e0 0x7f1ad806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.876+0000 7f1aeaffd700 1 -- 172.21.15.16:0/169650902 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1aec08afb0 con 0x7f1af406c960 2023-08-25T04:43:48.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.876+0000 7f1aeaffd700 1 --2- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:6800/2380390161,v1:172.21.15.117:6801/2380390161] conn(0x7f1ad8072920 0x7f1ad8074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.876+0000 7f1aeaffd700 1 -- 172.21.15.16:0/169650902 --> [v2:172.21.15.117:6800/2380390161,v1:172.21.15.117:6801/2380390161] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ad80753f0 con 0x7f1ad8072920 2023-08-25T04:43:48.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.876+0000 7f1aeaffd700 1 -- 172.21.15.16:0/169650902 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1aec08b400 con 0x7f1af406c960 2023-08-25T04:43:48.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.877+0000 7f1afa190700 1 --2- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1ad806a0e0 0x7f1ad806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.877+0000 7f1afa190700 1 --2- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1ad806a0e0 0x7f1ad806c5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1ae40096d0 tx=0x7f1ae4006c30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.877+0000 7f1afa991700 1 --2- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:6800/2380390161,v1:172.21.15.117:6801/2380390161] conn(0x7f1ad8072920 0x7f1ad8074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.878+0000 7f1afa991700 1 --2- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:6800/2380390161,v1:172.21.15.117:6801/2380390161] conn(0x7f1ad8072920 0x7f1ad8074d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.877+0000 7fcd167fc700 1 -- 172.21.15.16:0/1343930172 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcd1c016070 con 0x7fcd2006d3b0 2023-08-25T04:43:48.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.878+0000 7fcd167fc700 1 --2- 172.21.15.16:0/1343930172 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fcd0406a130 0x7fcd0406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.878+0000 7fcd167fc700 1 -- 172.21.15.16:0/1343930172 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd1c08c920 con 0x7fcd2006d3b0 2023-08-25T04:43:48.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.878+0000 7fcd25618700 1 --2- 172.21.15.16:0/1343930172 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fcd0406a130 0x7fcd0406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.879+0000 7fcd25618700 1 --2- 172.21.15.16:0/1343930172 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fcd0406a130 0x7fcd0406c5f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd2006bf80 tx=0x7fcd10006cd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.879+0000 7f1aeaffd700 1 -- 172.21.15.16:0/169650902 <== osd.6 v2:172.21.15.117:6800/2380390161 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1ad80753f0 con 0x7f1ad8072920 2023-08-25T04:43:48.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.885+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3680686607 --> [v2:172.21.15.16:6808/1569731109,v1:172.21.15.16:6811/1569731109] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe4180ce2c0 con 0x7fe404072a70 2023-08-25T04:43:48.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.885+0000 7fe414ff9700 1 -- 172.21.15.16:0/3680686607 <== osd.3 v2:172.21.15.16:6808/1569731109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe41000dad0 con 0x7fe404072a70 2023-08-25T04:43:48.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.887+0000 7fcd2807d700 1 --2- 172.21.15.16:0/1343930172 >> [v2:172.21.15.16:6824/2473914366,v1:172.21.15.16:6825/2473914366] conn(0x7fcd080015e0 0x7fcd08003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:48.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.887+0000 7fcd2807d700 1 -- 172.21.15.16:0/1343930172 --> [v2:172.21.15.16:6824/2473914366,v1:172.21.15.16:6825/2473914366] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd08006bd0 con 0x7fcd080015e0 2023-08-25T04:43:48.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.887+0000 7fcd2661a700 1 --2- 172.21.15.16:0/1343930172 >> [v2:172.21.15.16:6824/2473914366,v1:172.21.15.16:6825/2473914366] conn(0x7fcd080015e0 0x7fcd08003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:48.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.887+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3680686607 >> [v2:172.21.15.16:6808/1569731109,v1:172.21.15.16:6811/1569731109] conn(0x7fe404072a70 msgr2=0x7fe404074e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.887+0000 7fe41e4a4700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.16:6808/1569731109,v1:172.21.15.16:6811/1569731109] conn(0x7fe404072a70 0x7fe404074e90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.887+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3680686607 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe40406a1b0 msgr2=0x7fe40406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.887+0000 7fe41e4a4700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe40406a1b0 0x7fe40406c670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0099b0 tx=0x7fe40c008040 comp rx=0 tx=0).stop 2023-08-25T04:43:48.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.887+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3680686607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe41815ccc0 msgr2=0x7fe418159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.887+0000 7fe41e4a4700 1 --2- 172.21.15.16:0/3680686607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe41815ccc0 0x7fe418159540 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe40800b470 tx=0x7fe40800b780 comp rx=0 tx=0).stop 2023-08-25T04:43:48.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.887+0000 7fe41ca41700 1 -- 172.21.15.16:0/3680686607 reap_dead start 2023-08-25T04:43:48.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.888+0000 7fcd2661a700 1 --2- 172.21.15.16:0/1343930172 >> [v2:172.21.15.16:6824/2473914366,v1:172.21.15.16:6825/2473914366] conn(0x7fcd080015e0 0x7fcd08003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:48.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.888+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3680686607 shutdown_connections 2023-08-25T04:43:48.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.888+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3680686607 >> 172.21.15.16:0/3680686607 conn(0x7fe4180cbbe0 msgr2=0x7fe4180af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.889+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3680686607 shutdown_connections 2023-08-25T04:43:48.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.889+0000 7fe41e4a4700 1 -- 172.21.15.16:0/3680686607 wait complete. 2023-08-25T04:43:48.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.889+0000 7f2bb3de0700 1 -- 172.21.15.16:0/334976225 --> [v2:172.21.15.16:6800/3011235108,v1:172.21.15.16:6801/3011235108] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2bac0b0430 con 0x7f2b900729f0 2023-08-25T04:43:48.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.890+0000 7f2ba27fc700 1 -- 172.21.15.16:0/334976225 <== osd.1 v2:172.21.15.16:6800/3011235108 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2bac0b0430 con 0x7f2b900729f0 2023-08-25T04:43:48.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.891+0000 7f0c38039700 1 -- 172.21.15.16:0/4100168632 --> [v2:172.21.15.117:6816/2302216214,v1:172.21.15.117:6817/2302216214] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c3015e150 con 0x7f0c14072970 2023-08-25T04:43:48.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.891+0000 7f0c267fc700 1 -- 172.21.15.16:0/4100168632 <== osd.4 v2:172.21.15.117:6816/2302216214 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0c2c004ab0 con 0x7f0c14072970 2023-08-25T04:43:48.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.892+0000 7f0c38039700 1 -- 172.21.15.16:0/4100168632 >> [v2:172.21.15.117:6816/2302216214,v1:172.21.15.117:6817/2302216214] conn(0x7f0c14072970 msgr2=0x7f0c14074d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.892+0000 7f0c38039700 1 --2- 172.21.15.16:0/4100168632 >> [v2:172.21.15.117:6816/2302216214,v1:172.21.15.117:6817/2302216214] conn(0x7f0c14072970 0x7f0c14074d90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.892+0000 7f0c38039700 1 -- 172.21.15.16:0/4100168632 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0c1406a130 msgr2=0x7f0c1406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.892+0000 7f0c38039700 1 --2- 172.21.15.16:0/4100168632 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0c1406a130 0x7f0c1406c5f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c20013040 tx=0x7f0c20008070 comp rx=0 tx=0).stop 2023-08-25T04:43:48.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.892+0000 7f0c38039700 1 -- 172.21.15.16:0/4100168632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c3006a5e0 msgr2=0x7f0c3015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.892+0000 7f0c38039700 1 --2- 172.21.15.16:0/4100168632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c3006a5e0 0x7f0c3015ecf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800b990 tx=0x7f0c2800bca0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.892+0000 7f0c365d6700 1 -- 172.21.15.16:0/4100168632 reap_dead start 2023-08-25T04:43:48.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.892+0000 7f0c38039700 1 -- 172.21.15.16:0/4100168632 shutdown_connections 2023-08-25T04:43:48.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.892+0000 7f0c38039700 1 -- 172.21.15.16:0/4100168632 >> 172.21.15.16:0/4100168632 conn(0x7f0c300b2480 msgr2=0x7f0c30150eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.892+0000 7f0c38039700 1 -- 172.21.15.16:0/4100168632 shutdown_connections 2023-08-25T04:43:48.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.892+0000 7f0c38039700 1 -- 172.21.15.16:0/4100168632 wait complete. 2023-08-25T04:43:48.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.896+0000 7fc1831be700 1 -- 172.21.15.16:0/627277969 --> [v2:172.21.15.16:6809/1681052994,v1:172.21.15.16:6810/1681052994] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc15c002d40 con 0x7fc164072bb0 2023-08-25T04:43:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.896+0000 7f2bb3de0700 1 -- 172.21.15.16:0/334976225 >> [v2:172.21.15.16:6800/3011235108,v1:172.21.15.16:6801/3011235108] conn(0x7f2b900729f0 msgr2=0x7f2b90074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.896+0000 7f2bb3de0700 1 --2- 172.21.15.16:0/334976225 >> [v2:172.21.15.16:6800/3011235108,v1:172.21.15.16:6801/3011235108] conn(0x7f2b900729f0 0x7f2b90074e10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.896+0000 7f2bb3de0700 1 -- 172.21.15.16:0/334976225 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f2b9006a130 msgr2=0x7f2b9006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.896+0000 7f2bb3de0700 1 --2- 172.21.15.16:0/334976225 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f2b9006a130 0x7f2b9006c5f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8007c60 tx=0x7f2ba8007bb0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.896+0000 7f2bb3de0700 1 -- 172.21.15.16:0/334976225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bac0caf10 msgr2=0x7f2bac14c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.896+0000 7f2bb3de0700 1 --2- 172.21.15.16:0/334976225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bac0caf10 0x7f2bac14c8e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009f80 tx=0x7f2b9c004750 comp rx=0 tx=0).stop 2023-08-25T04:43:48.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.897+0000 7fc1717fa700 1 -- 172.21.15.16:0/627277969 <== osd.0 v2:172.21.15.16:6809/1681052994 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc15c002d40 con 0x7fc164072bb0 2023-08-25T04:43:48.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.897+0000 7fc1831be700 1 -- 172.21.15.16:0/627277969 >> [v2:172.21.15.16:6809/1681052994,v1:172.21.15.16:6810/1681052994] conn(0x7fc164072bb0 msgr2=0x7fc164074fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.897+0000 7fc1831be700 1 --2- 172.21.15.16:0/627277969 >> [v2:172.21.15.16:6809/1681052994,v1:172.21.15.16:6810/1681052994] conn(0x7fc164072bb0 0x7fc164074fd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.898+0000 7fcd167fc700 1 -- 172.21.15.16:0/1343930172 <== osd.2 v2:172.21.15.16:6824/2473914366 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fcd08006bd0 con 0x7fcd080015e0 2023-08-25T04:43:48.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.898+0000 7f50dffac700 1 -- 172.21.15.16:0/1879458892 --> [v2:172.21.15.117:6806/3890202206,v1:172.21.15.117:6808/3890202206] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f50c0002d40 con 0x7f50bc072920 2023-08-25T04:43:48.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.899+0000 7f1afc3f4700 1 -- 172.21.15.16:0/169650902 --> [v2:172.21.15.117:6800/2380390161,v1:172.21.15.117:6801/2380390161] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1af404ee70 con 0x7f1ad8072920 2023-08-25T04:43:48.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.899+0000 7f50ce7fc700 1 -- 172.21.15.16:0/1879458892 <== osd.5 v2:172.21.15.117:6806/3890202206 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f50c0002d40 con 0x7f50bc072920 2023-08-25T04:43:48.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.899+0000 7f1aeaffd700 1 -- 172.21.15.16:0/169650902 <== osd.6 v2:172.21.15.117:6800/2380390161 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1af404ee70 con 0x7f1ad8072920 2023-08-25T04:43:48.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.900+0000 7f1afc3f4700 1 -- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:6800/2380390161,v1:172.21.15.117:6801/2380390161] conn(0x7f1ad8072920 msgr2=0x7f1ad8074d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.900+0000 7f1afc3f4700 1 --2- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:6800/2380390161,v1:172.21.15.117:6801/2380390161] conn(0x7f1ad8072920 0x7f1ad8074d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.900+0000 7f1afc3f4700 1 -- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1ad806a0e0 msgr2=0x7f1ad806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.900+0000 7f1afc3f4700 1 --2- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1ad806a0e0 0x7f1ad806c5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1ae40096d0 tx=0x7f1ae4006c30 comp rx=0 tx=0).stop 2023-08-25T04:43:48.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.900+0000 7f1afc3f4700 1 -- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1af406c960 msgr2=0x7f1af40b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.900+0000 7f1afc3f4700 1 --2- 172.21.15.16:0/169650902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1af406c960 0x7f1af40b3a60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1af40b18b0 tx=0x7f1aec004ad0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.900+0000 7f1afa991700 1 -- 172.21.15.16:0/169650902 reap_dead start 2023-08-25T04:43:48.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.900+0000 7f1afc3f4700 1 -- 172.21.15.16:0/169650902 shutdown_connections 2023-08-25T04:43:48.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.900+0000 7f1afc3f4700 1 -- 172.21.15.16:0/169650902 >> 172.21.15.16:0/169650902 conn(0x7f1af40cecc0 msgr2=0x7f1af40c5440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.900+0000 7f1afc3f4700 1 -- 172.21.15.16:0/169650902 shutdown_connections 2023-08-25T04:43:48.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.900+0000 7f1afc3f4700 1 -- 172.21.15.16:0/169650902 wait complete. 2023-08-25T04:43:48.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.898+0000 7fc1831be700 1 -- 172.21.15.16:0/627277969 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc16406a2f0 msgr2=0x7fc16406c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.898+0000 7fc1831be700 1 --2- 172.21.15.16:0/627277969 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc16406a2f0 0x7fc16406c7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0cfde0 tx=0x7fc16c008030 comp rx=0 tx=0).stop 2023-08-25T04:43:48.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.898+0000 7fc1831be700 1 -- 172.21.15.16:0/627277969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc17c0cf970 msgr2=0x7fc17c1f6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.898+0000 7fc1831be700 1 --2- 172.21.15.16:0/627277969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc17c0cf970 0x7fc17c1f6ec0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc17800b840 tx=0x7fc17800bb50 comp rx=0 tx=0).stop 2023-08-25T04:43:48.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.898+0000 7fc18175b700 1 -- 172.21.15.16:0/627277969 reap_dead start 2023-08-25T04:43:48.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.898+0000 7fc1831be700 1 -- 172.21.15.16:0/627277969 shutdown_connections 2023-08-25T04:43:48.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.898+0000 7fc1831be700 1 -- 172.21.15.16:0/627277969 >> 172.21.15.16:0/627277969 conn(0x7fc17c0b1a10 msgr2=0x7fc17c15f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.901+0000 7fc1831be700 1 -- 172.21.15.16:0/627277969 shutdown_connections 2023-08-25T04:43:48.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.901+0000 7fc1831be700 1 -- 172.21.15.16:0/627277969 wait complete. 2023-08-25T04:43:48.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.901+0000 7f2bb237d700 1 -- 172.21.15.16:0/334976225 reap_dead start 2023-08-25T04:43:48.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.901+0000 7f2bb3de0700 1 -- 172.21.15.16:0/334976225 shutdown_connections 2023-08-25T04:43:48.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.901+0000 7f2bb3de0700 1 -- 172.21.15.16:0/334976225 >> 172.21.15.16:0/334976225 conn(0x7f2bac0b1a10 msgr2=0x7f2bac0b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.902+0000 7f50dffac700 1 -- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:6806/3890202206,v1:172.21.15.117:6808/3890202206] conn(0x7f50bc072920 msgr2=0x7f50bc074d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.902+0000 7f50dffac700 1 --2- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:6806/3890202206,v1:172.21.15.117:6808/3890202206] conn(0x7f50bc072920 0x7f50bc074d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.902+0000 7f50dffac700 1 -- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f50bc06a0e0 msgr2=0x7f50bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.902+0000 7f50dffac700 1 --2- 172.21.15.16:0/1879458892 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f50bc06a0e0 0x7f50bc06c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f50c80090b0 tx=0x7f50c8008030 comp rx=0 tx=0).stop 2023-08-25T04:43:48.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.902+0000 7f50dffac700 1 -- 172.21.15.16:0/1879458892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50d806aa50 msgr2=0x7f50d8159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.902+0000 7f50dffac700 1 --2- 172.21.15.16:0/1879458892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50d806aa50 0x7f50d8159b80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f50d400c480 tx=0x7f50d400c840 comp rx=0 tx=0).stop 2023-08-25T04:43:48.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.902+0000 7eff6f345700 1 -- 172.21.15.16:0/1637427454 --> [v2:172.21.15.117:6824/3606866589,v1:172.21.15.117:6825/3606866589] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7eff680cd340 con 0x7eff4c072920 2023-08-25T04:43:48.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.902+0000 7f50de549700 1 -- 172.21.15.16:0/1879458892 reap_dead start 2023-08-25T04:43:48.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.902+0000 7f50dffac700 1 -- 172.21.15.16:0/1879458892 shutdown_connections 2023-08-25T04:43:48.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.902+0000 7f50dffac700 1 -- 172.21.15.16:0/1879458892 >> 172.21.15.16:0/1879458892 conn(0x7f50d80b1a10 msgr2=0x7f50d80c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.902+0000 7f50dffac700 1 -- 172.21.15.16:0/1879458892 shutdown_connections 2023-08-25T04:43:48.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.902+0000 7f50dffac700 1 -- 172.21.15.16:0/1879458892 wait complete. 2023-08-25T04:43:48.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.902+0000 7eff5dffb700 1 -- 172.21.15.16:0/1637427454 <== osd.7 v2:172.21.15.117:6824/3606866589 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7eff6000f040 con 0x7eff4c072920 2023-08-25T04:43:48.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.903+0000 7eff6f345700 1 -- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:6824/3606866589,v1:172.21.15.117:6825/3606866589] conn(0x7eff4c072920 msgr2=0x7eff4c074d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.903+0000 7eff6f345700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:6824/3606866589,v1:172.21.15.117:6825/3606866589] conn(0x7eff4c072920 0x7eff4c074d40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.903+0000 7eff6f345700 1 -- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7eff4c06a0e0 msgr2=0x7eff4c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.903+0000 7eff6f345700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7eff4c06a0e0 0x7eff4c06c5a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7eff58009b60 tx=0x7eff58008030 comp rx=0 tx=0).stop 2023-08-25T04:43:48.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.903+0000 7eff6f345700 1 -- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff680c2220 msgr2=0x7eff680b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:48.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.903+0000 7eff6f345700 1 --2- 172.21.15.16:0/1637427454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff680c2220 0x7eff680b3b30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7eff6400c730 tx=0x7eff6400caf0 comp rx=0 tx=0).stop 2023-08-25T04:43:48.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.903+0000 7eff6d8e2700 1 -- 172.21.15.16:0/1637427454 reap_dead start 2023-08-25T04:43:48.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.903+0000 7eff6f345700 1 -- 172.21.15.16:0/1637427454 shutdown_connections 2023-08-25T04:43:48.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.903+0000 7eff6f345700 1 -- 172.21.15.16:0/1637427454 >> 172.21.15.16:0/1637427454 conn(0x7eff680cecc0 msgr2=0x7eff681608e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:48.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.903+0000 7eff6f345700 1 -- 172.21.15.16:0/1637427454 shutdown_connections 2023-08-25T04:43:48.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.903+0000 7eff6f345700 1 -- 172.21.15.16:0/1637427454 wait complete. 2023-08-25T04:43:48.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.906+0000 7f2bb3de0700 1 -- 172.21.15.16:0/334976225 shutdown_connections 2023-08-25T04:43:48.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.906+0000 7f2bb3de0700 1 -- 172.21.15.16:0/334976225 wait complete. 2023-08-25T04:43:48.996 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2023-08-25T04:43:48.996 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-25T04:43:48.998 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-08-25T04:43:48.998 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-25T04:43:48.999 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2023-08-25T04:43:49.000 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-25T04:43:49.001 INFO:teuthology.orchestra.run.smithi016.stdout:55834574855 2023-08-25T04:43:49.002 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-25T04:43:49.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.927+0000 7fcd2807d700 1 -- 172.21.15.16:0/1343930172 --> [v2:172.21.15.16:6824/2473914366,v1:172.21.15.16:6825/2473914366] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcd08005c50 con 0x7fcd080015e0 2023-08-25T04:43:49.003 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2023-08-25T04:43:49.004 INFO:teuthology.orchestra.run.smithi016.stdout:55834574855 2023-08-25T04:43:49.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-25T04:43:49.006 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-25T04:43:49.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.928+0000 7fcd167fc700 1 -- 172.21.15.16:0/1343930172 <== osd.2 v2:172.21.15.16:6824/2473914366 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcd08005c50 con 0x7fcd080015e0 2023-08-25T04:43:49.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.928+0000 7fcd2807d700 1 -- 172.21.15.16:0/1343930172 >> [v2:172.21.15.16:6824/2473914366,v1:172.21.15.16:6825/2473914366] conn(0x7fcd080015e0 msgr2=0x7fcd08003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.928+0000 7fcd2807d700 1 --2- 172.21.15.16:0/1343930172 >> [v2:172.21.15.16:6824/2473914366,v1:172.21.15.16:6825/2473914366] conn(0x7fcd080015e0 0x7fcd08003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.928+0000 7fcd2807d700 1 -- 172.21.15.16:0/1343930172 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fcd0406a130 msgr2=0x7fcd0406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.928+0000 7fcd2807d700 1 --2- 172.21.15.16:0/1343930172 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fcd0406a130 0x7fcd0406c5f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd2006bf80 tx=0x7fcd10006cd0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.928+0000 7fcd2807d700 1 -- 172.21.15.16:0/1343930172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd2006d3b0 msgr2=0x7fcd2016a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.928+0000 7fcd2807d700 1 --2- 172.21.15.16:0/1343930172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd2006d3b0 0x7fcd2016a270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00bda0 tx=0x7fcd1c00bdd0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.928+0000 7fcd2661a700 1 -- 172.21.15.16:0/1343930172 reap_dead start 2023-08-25T04:43:49.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.928+0000 7fcd2807d700 1 -- 172.21.15.16:0/1343930172 shutdown_connections 2023-08-25T04:43:49.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.928+0000 7fcd2807d700 1 -- 172.21.15.16:0/1343930172 >> 172.21.15.16:0/1343930172 conn(0x7fcd200cecc0 msgr2=0x7fcd200b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.928+0000 7fcd2807d700 1 -- 172.21.15.16:0/1343930172 shutdown_connections 2023-08-25T04:43:49.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:48.928+0000 7fcd2807d700 1 -- 172.21.15.16:0/1343930172 wait complete. 2023-08-25T04:43:49.016 INFO:teuthology.orchestra.run.smithi016.stdout:55834574855 2023-08-25T04:43:49.017 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-25T04:43:49.018 INFO:teuthology.orchestra.run.smithi016.stdout:55834574855 2023-08-25T04:43:49.019 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-25T04:43:49.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.238+0000 7f14d7394700 1 Processor -- start 2023-08-25T04:43:49.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.239+0000 7f14d7394700 1 -- start start 2023-08-25T04:43:49.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.240+0000 7f14d7394700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f14d00cf7e0 0x7f14d00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.240+0000 7f14d7394700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f14d015da40 0x7f14d00c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.240+0000 7f14d7394700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d006c1e0 con 0x7f14d00c9850 2023-08-25T04:43:49.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.240+0000 7f14d7394700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d00c9c80 con 0x7f14d00cf7e0 2023-08-25T04:43:49.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.240+0000 7f14d7394700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d006b920 con 0x7f14d015da40 2023-08-25T04:43:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.241+0000 7f14d492f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f14d015da40 0x7f14d00c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.241+0000 7f14d492f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f14d015da40 0x7f14d00c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36606/0 (socket says 172.21.15.16:36606) 2023-08-25T04:43:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.241+0000 7f14d492f700 1 -- 172.21.15.16:0/1634045022 learned_addr learned my addr 172.21.15.16:0/1634045022 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.245+0000 7f14d5130700 1 --2- 172.21.15.16:0/1634045022 >> v2:172.21.15.16:3300/0 conn(0x7f14d00cf7e0 0x7f14d00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.245+0000 7f14d5130700 1 -- 172.21.15.16:0/1634045022 >> v2:172.21.15.117:3300/0 conn(0x7f14d015da40 msgr2=0x7f14d00c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.245+0000 7f14d5130700 1 --2- 172.21.15.16:0/1634045022 >> v2:172.21.15.117:3300/0 conn(0x7f14d015da40 0x7f14d00c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.245+0000 7f14d5130700 1 -- 172.21.15.16:0/1634045022 >> v1:172.21.15.16:6789/0 conn(0x7f14d00c9850 legacy=0x7f14d0159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.245+0000 7f14d5130700 1 -- 172.21.15.16:0/1634045022 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d006be70 con 0x7f14d00cf7e0 2023-08-25T04:43:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.246+0000 7f14d5130700 1 --2- 172.21.15.16:0/1634045022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14d00cf7e0 0x7f14d00cc890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f14d00caf10 tx=0x7f14c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23063e8fd1d22b34 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.247+0000 7f14c7fff700 1 -- 172.21.15.16:0/1634045022 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c800e070 con 0x7f14d00cf7e0 2023-08-25T04:43:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.247+0000 7f14c7fff700 1 -- 172.21.15.16:0/1634045022 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c800bb90 con 0x7f14d00cf7e0 2023-08-25T04:43:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.247+0000 7f14c7fff700 1 -- 172.21.15.16:0/1634045022 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8003a20 con 0x7f14d00cf7e0 2023-08-25T04:43:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.248+0000 7f14d7394700 1 -- 172.21.15.16:0/1634045022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14d00cf7e0 msgr2=0x7f14d00cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.248+0000 7f14d7394700 1 --2- 172.21.15.16:0/1634045022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14d00cf7e0 0x7f14d00cc890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f14d00caf10 tx=0x7f14c800b330 comp rx=0 tx=0).stop 2023-08-25T04:43:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.248+0000 7f14d7394700 1 -- 172.21.15.16:0/1634045022 shutdown_connections 2023-08-25T04:43:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.248+0000 7f14d7394700 1 --2- 172.21.15.16:0/1634045022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14d00cf7e0 0x7f14d00cc890 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.248+0000 7f14d7394700 1 --2- 172.21.15.16:0/1634045022 >> v2:172.21.15.117:3300/0 conn(0x7f14d015da40 0x7f14d00c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.248+0000 7f14d7394700 1 -- 172.21.15.16:0/1634045022 >> 172.21.15.16:0/1634045022 conn(0x7f14d00cecc0 msgr2=0x7f14d00cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.249+0000 7f14d7394700 1 -- 172.21.15.16:0/1634045022 shutdown_connections 2023-08-25T04:43:49.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.249+0000 7f14d7394700 1 -- 172.21.15.16:0/1634045022 wait complete. 2023-08-25T04:43:49.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.250+0000 7f14d7394700 1 Processor -- start 2023-08-25T04:43:49.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.253+0000 7f14d7394700 1 -- start start 2023-08-25T04:43:49.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.254+0000 7f14d7394700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14d00c9850 0x7f14d00b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.254+0000 7f14d7394700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d00cf7e0 0x7f14d00c15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.254+0000 7f14d7394700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14d015da40 0x7f14d014c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.254+0000 7f14d7394700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00c2330 con 0x7f14d00c9850 2023-08-25T04:43:49.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.254+0000 7f14d7394700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d0157eb0 con 0x7f14d015da40 2023-08-25T04:43:49.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.254+0000 7f14d7394700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00c1ce0 con 0x7f14d00cf7e0 2023-08-25T04:43:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.254+0000 7f14d5130700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14d00c9850 0x7f14d00b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.254+0000 7f14d5130700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14d00c9850 0x7f14d00b42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49278/0 (socket says 172.21.15.16:49278) 2023-08-25T04:43:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.254+0000 7f14d5130700 1 -- 172.21.15.16:0/86463934 learned_addr learned my addr 172.21.15.16:0/86463934 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.255+0000 7f14d5130700 1 -- 172.21.15.16:0/86463934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d00cf7e0 msgr2=0x7f14d00c15e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:43:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.255+0000 7f14d5130700 1 --2- 172.21.15.16:0/86463934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d00cf7e0 0x7f14d00c15e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.255+0000 7f14d5130700 1 -- 172.21.15.16:0/86463934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14d015da40 msgr2=0x7f14d014c0e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:43:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.255+0000 7f14d5130700 1 --2- 172.21.15.16:0/86463934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14d015da40 0x7f14d014c0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.255+0000 7f14d5130700 1 -- 172.21.15.16:0/86463934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c8009a70 con 0x7f14d00c9850 2023-08-25T04:43:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.255+0000 7f14d5130700 1 --2- 172.21.15.16:0/86463934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14d00c9850 0x7f14d00b42e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14c800b370 tx=0x7f14c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.256+0000 7f14c5ffb700 1 -- 172.21.15.16:0/86463934 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8012630 con 0x7f14d00c9850 2023-08-25T04:43:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.256+0000 7f14c5ffb700 1 -- 172.21.15.16:0/86463934 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c8012790 con 0x7f14d00c9850 2023-08-25T04:43:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.256+0000 7f14c5ffb700 1 -- 172.21.15.16:0/86463934 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8012b40 con 0x7f14d00c9850 2023-08-25T04:43:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.256+0000 7f14d7394700 1 -- 172.21.15.16:0/86463934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d0157580 con 0x7f14d00c9850 2023-08-25T04:43:49.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.256+0000 7f9367b31700 1 Processor -- start 2023-08-25T04:43:49.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.256+0000 7f8034435700 1 Processor -- start 2023-08-25T04:43:49.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.256+0000 7f8034435700 1 -- start start 2023-08-25T04:43:49.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.256+0000 7f14d7394700 1 -- 172.21.15.16:0/86463934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d0157b40 con 0x7f14d00c9850 2023-08-25T04:43:49.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.257+0000 7f8034435700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f802c15d3b0 0x7f802c161780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.257+0000 7f8034435700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802c06c4e0 0x7f802c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.257+0000 7f8034435700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c06c050 con 0x7f802c06c960 2023-08-25T04:43:49.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.257+0000 7f8034435700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c161cc0 con 0x7f802c15d3b0 2023-08-25T04:43:49.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.257+0000 7f8034435700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c06d600 con 0x7f802c06c4e0 2023-08-25T04:43:49.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.258+0000 7f9367b31700 1 -- start start 2023-08-25T04:43:49.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.258+0000 7f14c5ffb700 1 -- 172.21.15.16:0/86463934 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f14c8012ca0 con 0x7f14d00c9850 2023-08-25T04:43:49.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7fc8ecf00700 1 Processor -- start 2023-08-25T04:43:49.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7fc8ecf00700 1 -- start start 2023-08-25T04:43:49.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7f14c5ffb700 1 --2- 172.21.15.16:0/86463934 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f14b406a0e0 0x7f14b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7f14d7394700 1 -- 172.21.15.16:0/86463934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b00052f0 con 0x7f14d00c9850 2023-08-25T04:43:49.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7f14c5ffb700 1 -- 172.21.15.16:0/86463934 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14c808a660 con 0x7f14d00c9850 2023-08-25T04:43:49.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7f80329d2700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f802c06c960 0x7f802c0ac850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39698/0 (socket says 172.21.15.16:39698) 2023-08-25T04:43:49.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7f80329d2700 1 -- 172.21.15.16:0/220605280 learned_addr learned my addr 172.21.15.16:0/220605280 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:49.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7f80319d0700 1 --2- 172.21.15.16:0/220605280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802c06c4e0 0x7f802c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7f80321d1700 1 --2- 172.21.15.16:0/220605280 >> v2:172.21.15.117:3300/0 conn(0x7f802c15d3b0 0x7f802c161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.260+0000 7f14d492f700 1 --2- 172.21.15.16:0/86463934 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f14b406a0e0 0x7f14b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.260+0000 7f80319d0700 1 -- 172.21.15.16:0/220605280 >> v2:172.21.15.117:3300/0 conn(0x7f802c15d3b0 msgr2=0x7f802c161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:49.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.260+0000 7f80319d0700 1 --2- 172.21.15.16:0/220605280 >> v2:172.21.15.117:3300/0 conn(0x7f802c15d3b0 0x7f802c161780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.260+0000 7f80319d0700 1 -- 172.21.15.16:0/220605280 >> v1:172.21.15.16:6789/0 conn(0x7f802c06c960 legacy=0x7f802c0ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.260+0000 7f80319d0700 1 -- 172.21.15.16:0/220605280 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c06ba00 con 0x7f802c06c4e0 2023-08-25T04:43:49.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7f9367b31700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f936006c4e0 0x7f93600cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7f9367b31700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f936006c960 0x7f93600ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7f9367b31700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936006c050 con 0x7f936015d3b0 2023-08-25T04:43:49.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7f9367b31700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936006d600 con 0x7f936006c960 2023-08-25T04:43:49.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7f9367b31700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936006ba00 con 0x7f936006c4e0 2023-08-25T04:43:49.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7f93658cd700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f936015d3b0 0x7f9360161780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.16:47798/0 (socket says 172.21.15.16:47798) 2023-08-25T04:43:49.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.259+0000 7f93658cd700 1 -- 172.21.15.16:0/847773281 learned_addr learned my addr 172.21.15.16:0/847773281 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:49.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.260+0000 7f93648cb700 1 -- 172.21.15.16:0/847773281 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433328833 0 0) 0x7f936006c050 con 0x7f936015d3b0 2023-08-25T04:43:49.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.260+0000 7f93648cb700 1 -- 172.21.15.16:0/847773281 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f934c0035b0 con 0x7f936015d3b0 2023-08-25T04:43:49.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7f93650cc700 1 --2- 172.21.15.16:0/847773281 >> v2:172.21.15.117:3300/0 conn(0x7f936006c4e0 0x7f93600cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7fc8ecf00700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc8e8161b30 0x7fc8e80cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7fc8ecf00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8e80cc890 0x7fc8e8161f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7fc8ecf00700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e8162a40 con 0x7fc8e81651c0 2023-08-25T04:43:49.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7fc8ecf00700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e80cce30 con 0x7fc8e8161b30 2023-08-25T04:43:49.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7fc8ecf00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e80cd110 con 0x7fc8e80cc890 2023-08-25T04:43:49.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7fc8e5d9b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8e80cc890 0x7fc8e8161f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7fc8e5d9b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8e80cc890 0x7fc8e8161f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36628/0 (socket says 172.21.15.16:36628) 2023-08-25T04:43:49.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7fc8e5d9b700 1 -- 172.21.15.16:0/3366474914 learned_addr learned my addr 172.21.15.16:0/3366474914 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:49.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7f93650cc700 1 -- 172.21.15.16:0/847773281 >> v2:172.21.15.16:3300/0 conn(0x7f936006c960 msgr2=0x7f93600ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:49.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7f93650cc700 1 --2- 172.21.15.16:0/847773281 >> v2:172.21.15.16:3300/0 conn(0x7f936006c960 0x7f93600ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7f93650cc700 1 -- 172.21.15.16:0/847773281 >> v1:172.21.15.117:6789/0 conn(0x7f936015d3b0 legacy=0x7f9360161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7f93650cc700 1 -- 172.21.15.16:0/847773281 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936006bce0 con 0x7f936006c4e0 2023-08-25T04:43:49.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7f80319d0700 1 --2- 172.21.15.16:0/220605280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802c06c4e0 0x7f802c0cc890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8024009d90 tx=0x7f802400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c5a7340db3b528 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7fc8e5d9b700 1 -- 172.21.15.16:0/3366474914 >> v2:172.21.15.16:3300/0 conn(0x7fc8e8161b30 msgr2=0x7fc8e80cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:49.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7fc8e5d9b700 1 --2- 172.21.15.16:0/3366474914 >> v2:172.21.15.16:3300/0 conn(0x7fc8e8161b30 0x7fc8e80cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7fc8e5d9b700 1 -- 172.21.15.16:0/3366474914 >> v1:172.21.15.16:6789/0 conn(0x7fc8e81651c0 legacy=0x7fc8e8165650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:49.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7fc8e5d9b700 1 -- 172.21.15.16:0/3366474914 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80cd3f0 con 0x7fc8e80cc890 2023-08-25T04:43:49.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7f14d492f700 1 --2- 172.21.15.16:0/86463934 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f14b406a0e0 0x7f14b406c5a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f14d00ca4c0 tx=0x7f14c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.261+0000 7f93650cc700 1 --2- 172.21.15.16:0/847773281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f936006c4e0 0x7f93600cc890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f936015e8f0 tx=0x7f9350009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=463cca4be918ac9d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.262+0000 7f80311cf700 1 -- 172.21.15.16:0/220605280 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802400e070 con 0x7f802c06c4e0 2023-08-25T04:43:49.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.262+0000 7fc8e5d9b700 1 --2- 172.21.15.16:0/3366474914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8e80cc890 0x7fc8e8161f10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80cf9b0 tx=0x7fc8dc009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ef0d2b4ad6fe8b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.262+0000 7fc8e559a700 1 -- 172.21.15.16:0/3366474914 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc004230 con 0x7fc8e80cc890 2023-08-25T04:43:49.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.262+0000 7fc8e559a700 1 -- 172.21.15.16:0/3366474914 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc004390 con 0x7fc8e80cc890 2023-08-25T04:43:49.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.262+0000 7fc8e559a700 1 -- 172.21.15.16:0/3366474914 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc0036a0 con 0x7fc8e80cc890 2023-08-25T04:43:49.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.262+0000 7f80311cf700 1 -- 172.21.15.16:0/220605280 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802400bbd0 con 0x7f802c06c4e0 2023-08-25T04:43:49.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.262+0000 7f80311cf700 1 -- 172.21.15.16:0/220605280 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8024012430 con 0x7f802c06c4e0 2023-08-25T04:43:49.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.263+0000 7f8034435700 1 -- 172.21.15.16:0/220605280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802c06c4e0 msgr2=0x7f802c0cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.263+0000 7f8034435700 1 --2- 172.21.15.16:0/220605280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802c06c4e0 0x7f802c0cc890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8024009d90 tx=0x7f802400b330 comp rx=0 tx=0).stop 2023-08-25T04:43:49.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.263+0000 7fc8ecf00700 1 -- 172.21.15.16:0/3366474914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8e80cc890 msgr2=0x7fc8e8161f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.263+0000 7fc8ecf00700 1 --2- 172.21.15.16:0/3366474914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8e80cc890 0x7fc8e8161f10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80cf9b0 tx=0x7fc8dc009bd0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.263+0000 7f8034435700 1 -- 172.21.15.16:0/220605280 shutdown_connections 2023-08-25T04:43:49.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.263+0000 7f8034435700 1 --2- 172.21.15.16:0/220605280 >> v2:172.21.15.117:3300/0 conn(0x7f802c15d3b0 0x7f802c161780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.263+0000 7f8034435700 1 --2- 172.21.15.16:0/220605280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802c06c4e0 0x7f802c0cc890 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.263+0000 7f8034435700 1 -- 172.21.15.16:0/220605280 >> 172.21.15.16:0/220605280 conn(0x7f802c0cecc0 msgr2=0x7f802c0cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.263+0000 7f93648cb700 1 -- 172.21.15.16:0/847773281 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350011830 con 0x7f936006c4e0 2023-08-25T04:43:49.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.263+0000 7f93648cb700 1 -- 172.21.15.16:0/847773281 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9350011990 con 0x7f936006c4e0 2023-08-25T04:43:49.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.263+0000 7f93648cb700 1 -- 172.21.15.16:0/847773281 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350011d00 con 0x7f936006c4e0 2023-08-25T04:43:49.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.263+0000 7f8034435700 1 -- 172.21.15.16:0/220605280 shutdown_connections 2023-08-25T04:43:49.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.264+0000 7f9367b31700 1 -- 172.21.15.16:0/847773281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f936006c4e0 msgr2=0x7f93600cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.264+0000 7f9367b31700 1 --2- 172.21.15.16:0/847773281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f936006c4e0 0x7f93600cc890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f936015e8f0 tx=0x7f9350009b20 comp rx=0 tx=0).stop 2023-08-25T04:43:49.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.264+0000 7f9367b31700 1 -- 172.21.15.16:0/847773281 shutdown_connections 2023-08-25T04:43:49.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.264+0000 7f9367b31700 1 --2- 172.21.15.16:0/847773281 >> v2:172.21.15.16:3300/0 conn(0x7f936006c960 0x7f93600ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.264+0000 7f9367b31700 1 --2- 172.21.15.16:0/847773281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f936006c4e0 0x7f93600cc890 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f936015e8f0 tx=0x7f9350009b20 comp rx=0 tx=0).stop 2023-08-25T04:43:49.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.264+0000 7f9367b31700 1 -- 172.21.15.16:0/847773281 >> 172.21.15.16:0/847773281 conn(0x7f93600cecc0 msgr2=0x7f93600cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.263+0000 7f8034435700 1 -- 172.21.15.16:0/220605280 wait complete. 2023-08-25T04:43:49.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.265+0000 7f8034435700 1 Processor -- start 2023-08-25T04:43:49.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.266+0000 7f9367b31700 1 -- 172.21.15.16:0/847773281 shutdown_connections 2023-08-25T04:43:49.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.266+0000 7fc8ecf00700 1 -- 172.21.15.16:0/3366474914 shutdown_connections 2023-08-25T04:43:49.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.266+0000 7fc8ecf00700 1 --2- 172.21.15.16:0/3366474914 >> v2:172.21.15.16:3300/0 conn(0x7fc8e8161b30 0x7fc8e80cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.266+0000 7fc8ecf00700 1 --2- 172.21.15.16:0/3366474914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8e80cc890 0x7fc8e8161f10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.266+0000 7fc8ecf00700 1 -- 172.21.15.16:0/3366474914 >> 172.21.15.16:0/3366474914 conn(0x7fc8e80cecc0 msgr2=0x7fc8e80cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.265+0000 7f8034435700 1 -- start start 2023-08-25T04:43:49.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.266+0000 7f9367b31700 1 -- 172.21.15.16:0/847773281 wait complete. 2023-08-25T04:43:49.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f8034435700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f802c06c4e0 0x7f802c0c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f8034435700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802c06c960 0x7f802c0c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f8034435700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c15d3b0 0x7f802c1500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f8034435700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0c7b00 con 0x7f802c15d3b0 2023-08-25T04:43:49.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f8034435700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0c62c0 con 0x7f802c06c4e0 2023-08-25T04:43:49.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f8034435700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0c71d0 con 0x7f802c06c960 2023-08-25T04:43:49.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f80329d2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c15d3b0 0x7f802c1500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f80329d2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c15d3b0 0x7f802c1500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49302/0 (socket says 172.21.15.16:49302) 2023-08-25T04:43:49.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f80329d2700 1 -- 172.21.15.16:0/1920492296 learned_addr learned my addr 172.21.15.16:0/1920492296 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:49.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f80319d0700 1 --2- 172.21.15.16:0/1920492296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802c06c960 0x7f802c0c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7fc8ecf00700 1 -- 172.21.15.16:0/3366474914 shutdown_connections 2023-08-25T04:43:49.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.268+0000 7f9367b31700 1 Processor -- start 2023-08-25T04:43:49.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.268+0000 7f92a42f1700 1 Processor -- start 2023-08-25T04:43:49.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.268+0000 7fab62370700 1 Processor -- start 2023-08-25T04:43:49.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.268+0000 7f9367b31700 1 -- start start 2023-08-25T04:43:49.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.269+0000 7f9367b31700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f936006c960 0x7f936014b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.269+0000 7f9367b31700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f936015d3b0 0x7f9360152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.269+0000 7f9367b31700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9360151760 0x7f9360151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.269+0000 7f9367b31700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93600c6bc0 con 0x7f9360151760 2023-08-25T04:43:49.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.269+0000 7f9367b31700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9360153070 con 0x7f936006c960 2023-08-25T04:43:49.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.269+0000 7f9367b31700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936014ddc0 con 0x7f936015d3b0 2023-08-25T04:43:49.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f80321d1700 1 --2- 172.21.15.16:0/1920492296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f802c06c4e0 0x7f802c0c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f80329d2700 1 -- 172.21.15.16:0/1920492296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802c06c960 msgr2=0x7f802c0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f80329d2700 1 --2- 172.21.15.16:0/1920492296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802c06c960 0x7f802c0c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f80329d2700 1 -- 172.21.15.16:0/1920492296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f802c06c4e0 msgr2=0x7f802c0c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.267+0000 7f80329d2700 1 --2- 172.21.15.16:0/1920492296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f802c06c4e0 0x7f802c0c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.268+0000 7f80329d2700 1 -- 172.21.15.16:0/1920492296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8024009a70 con 0x7f802c15d3b0 2023-08-25T04:43:49.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.268+0000 7f80329d2700 1 --2- 172.21.15.16:0/1920492296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c15d3b0 0x7f802c1500d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f802800c400 tx=0x7f802800c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.268+0000 7fc8ecf00700 1 -- 172.21.15.16:0/3366474914 wait complete. 2023-08-25T04:43:49.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7fc8ecf00700 1 Processor -- start 2023-08-25T04:43:49.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.269+0000 7f14c5ffb700 1 -- 172.21.15.16:0/86463934 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f14c8055de0 con 0x7f14d00c9850 2023-08-25T04:43:49.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.269+0000 7f93658cd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f936006c960 0x7f936014b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f93658cd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f936006c960 0x7f936014b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36638/0 (socket says 172.21.15.16:36638) 2023-08-25T04:43:49.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f93658cd700 1 -- 172.21.15.16:0/2969411808 learned_addr learned my addr 172.21.15.16:0/2969411808 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:49.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f93650cc700 1 --2- 172.21.15.16:0/2969411808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f936015d3b0 0x7f9360152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f93660ce700 1 --2- 172.21.15.16:0/2969411808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9360151760 0x7f9360151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7f93660ce700 1 -- 172.21.15.16:0/2969411808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f936015d3b0 msgr2=0x7f9360152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7f93660ce700 1 --2- 172.21.15.16:0/2969411808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f936015d3b0 0x7f9360152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7f93660ce700 1 -- 172.21.15.16:0/2969411808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f936006c960 msgr2=0x7f936014b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7f93660ce700 1 --2- 172.21.15.16:0/2969411808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f936006c960 0x7f936014b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7f93660ce700 1 -- 172.21.15.16:0/2969411808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93500094a0 con 0x7f9360151760 2023-08-25T04:43:49.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.268+0000 7f92a42f1700 1 -- start start 2023-08-25T04:43:49.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f92a42f1700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae6d0 0x7f929c06bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f92a42f1700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f929c06c4c0 0x7f929c0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f92a42f1700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929c0b11e0 con 0x7f929c071cc0 2023-08-25T04:43:49.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f92a42f1700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c06e100 con 0x7f929c06c4c0 2023-08-25T04:43:49.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f92a42f1700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c06db80 con 0x7f929c0ae6d0 2023-08-25T04:43:49.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f92a288e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f929c06c4c0 0x7f929c0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f92a288e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f929c06c4c0 0x7f929c0b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36652/0 (socket says 172.21.15.16:36652) 2023-08-25T04:43:49.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f92a288e700 1 -- 172.21.15.16:0/3639137638 learned_addr learned my addr 172.21.15.16:0/3639137638 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:49.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f92a188c700 1 --2- 172.21.15.16:0/3639137638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae6d0 0x7f929c06bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f92a288e700 1 -- 172.21.15.16:0/3639137638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae6d0 msgr2=0x7f929c06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:49.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f92a288e700 1 --2- 172.21.15.16:0/3639137638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae6d0 0x7f929c06bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f92a288e700 1 -- 172.21.15.16:0/3639137638 >> v1:172.21.15.16:6789/0 conn(0x7f929c071cc0 legacy=0x7f929c0720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:49.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f92a288e700 1 -- 172.21.15.16:0/3639137638 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c06a340 con 0x7f929c06c4c0 2023-08-25T04:43:49.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7f92a288e700 1 --2- 172.21.15.16:0/3639137638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c06c4c0 0x7f929c0b1670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9294009e50 tx=0x7f929400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbfe4753f6046ee6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7f92a108b700 1 -- 172.21.15.16:0/3639137638 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929400e070 con 0x7f929c06c4c0 2023-08-25T04:43:49.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.268+0000 7fab62370700 1 -- start start 2023-08-25T04:43:49.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.269+0000 7fab62370700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fab5c0caf10 0x7fab5c0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7fab62370700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c070eb0 0x7fab5c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7fab62370700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5c0cbfe0 con 0x7fab5c0cc830 2023-08-25T04:43:49.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7fab62370700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5c0cb3d0 con 0x7fab5c0caf10 2023-08-25T04:43:49.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7fab62370700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0cb6b0 con 0x7fab5c070eb0 2023-08-25T04:43:49.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7fab6090d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c070eb0 0x7fab5c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7fab6090d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c070eb0 0x7fab5c0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:49856/0 (socket says 172.21.15.16:49856) 2023-08-25T04:43:49.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7fab5bfff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fab5c0cc830 0x7fab5c0ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39728/0 (socket says 172.21.15.16:39728) 2023-08-25T04:43:49.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7fab6090d700 1 -- 172.21.15.16:0/494199767 learned_addr learned my addr 172.21.15.16:0/494199767 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:49.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7fab5b7fe700 1 --2- 172.21.15.16:0/494199767 >> v2:172.21.15.117:3300/0 conn(0x7fab5c0caf10 0x7fab5c0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7fab6090d700 1 -- 172.21.15.16:0/494199767 >> v2:172.21.15.117:3300/0 conn(0x7fab5c0caf10 msgr2=0x7fab5c0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:49.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7fab6090d700 1 --2- 172.21.15.16:0/494199767 >> v2:172.21.15.117:3300/0 conn(0x7fab5c0caf10 0x7fab5c0cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7fab6090d700 1 -- 172.21.15.16:0/494199767 >> v1:172.21.15.16:6789/0 conn(0x7fab5c0cc830 legacy=0x7fab5c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:49.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7fab6090d700 1 -- 172.21.15.16:0/494199767 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c0cb990 con 0x7fab5c070eb0 2023-08-25T04:43:49.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7fab6090d700 1 --2- 172.21.15.16:0/494199767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c070eb0 0x7fab5c0ce2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00bb90 tx=0x7fab4c00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33010296c29ebc44 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f8022ffd700 1 -- 172.21.15.16:0/1920492296 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028005d70 con 0x7f802c15d3b0 2023-08-25T04:43:49.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f8022ffd700 1 -- 172.21.15.16:0/1920492296 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80280070d0 con 0x7f802c15d3b0 2023-08-25T04:43:49.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f8022ffd700 1 -- 172.21.15.16:0/1920492296 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028007480 con 0x7f802c15d3b0 2023-08-25T04:43:49.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f8034435700 1 -- 172.21.15.16:0/1920492296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802c0c74b0 con 0x7f802c15d3b0 2023-08-25T04:43:49.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7f8034435700 1 -- 172.21.15.16:0/1920492296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c151330 con 0x7f802c15d3b0 2023-08-25T04:43:49.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.270+0000 7fc8ecf00700 1 -- start start 2023-08-25T04:43:49.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7fc8ecf00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8e80cc890 0x7fc8e8157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7fc8ecf00700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e8161b30 0x7fc8e81f8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7fc8ecf00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8e81651c0 0x7fc8e815d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7fc8ecf00700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e8157790 con 0x7fc8e8161b30 2023-08-25T04:43:49.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7fc8ecf00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e8157b30 con 0x7fc8e81651c0 2023-08-25T04:43:49.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7fc8ecf00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e8157dd0 con 0x7fc8e80cc890 2023-08-25T04:43:49.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7f93660ce700 1 --2- 172.21.15.16:0/2969411808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9360151760 0x7f9360151bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f936006cd70 tx=0x7f935c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7fc8e659c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8e80cc890 0x7fc8e8157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7fc8e659c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8e80cc890 0x7fc8e8157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:49870/0 (socket says 172.21.15.16:49870) 2023-08-25T04:43:49.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7fc8e659c700 1 -- 172.21.15.16:0/1070334965 learned_addr learned my addr 172.21.15.16:0/1070334965 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:49.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7fc8e6d9d700 1 --2- 172.21.15.16:0/1070334965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8e81651c0 0x7fc8e815d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7f8034435700 1 -- 172.21.15.16:0/1920492296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802c0c7c70 con 0x7f802c15d3b0 2023-08-25T04:43:49.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7f92a108b700 1 -- 172.21.15.16:0/3639137638 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9294003a20 con 0x7f929c06c4c0 2023-08-25T04:43:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.271+0000 7f92a108b700 1 -- 172.21.15.16:0/3639137638 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294003dd0 con 0x7f929c06c4c0 2023-08-25T04:43:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7f71415d1700 1 Processor -- start 2023-08-25T04:43:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7f71415d1700 1 -- start start 2023-08-25T04:43:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7fc8e5d9b700 1 --2- 172.21.15.16:0/1070334965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e8161b30 0x7fc8e81f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7f93567fc700 1 -- 172.21.15.16:0/2969411808 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c011830 con 0x7f9360151760 2023-08-25T04:43:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7f93567fc700 1 -- 172.21.15.16:0/2969411808 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c011990 con 0x7f9360151760 2023-08-25T04:43:49.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7f93567fc700 1 -- 172.21.15.16:0/2969411808 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c011d40 con 0x7f9360151760 2023-08-25T04:43:49.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7f92a42f1700 1 -- 172.21.15.16:0/3639137638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c06c4c0 msgr2=0x7f929c0b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7f92a42f1700 1 --2- 172.21.15.16:0/3639137638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c06c4c0 0x7f929c0b1670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9294009e50 tx=0x7f929400b330 comp rx=0 tx=0).stop 2023-08-25T04:43:49.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7f92a42f1700 1 -- 172.21.15.16:0/3639137638 shutdown_connections 2023-08-25T04:43:49.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7f92a42f1700 1 --2- 172.21.15.16:0/3639137638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c06c4c0 0x7f929c0b1670 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7f92a42f1700 1 --2- 172.21.15.16:0/3639137638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae6d0 0x7f929c06bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7f92a42f1700 1 -- 172.21.15.16:0/3639137638 >> 172.21.15.16:0/3639137638 conn(0x7f929c0b2480 msgr2=0x7f929c0b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7f92a42f1700 1 -- 172.21.15.16:0/3639137638 shutdown_connections 2023-08-25T04:43:49.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7f92a42f1700 1 -- 172.21.15.16:0/3639137638 wait complete. 2023-08-25T04:43:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7fab5affd700 1 -- 172.21.15.16:0/494199767 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c00dd10 con 0x7fab5c070eb0 2023-08-25T04:43:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7fab5affd700 1 -- 172.21.15.16:0/494199767 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c00de70 con 0x7fab5c070eb0 2023-08-25T04:43:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.272+0000 7fab5affd700 1 -- 172.21.15.16:0/494199767 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c004230 con 0x7fab5c070eb0 2023-08-25T04:43:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7fab62370700 1 -- 172.21.15.16:0/494199767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c070eb0 msgr2=0x7fab5c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7fab62370700 1 --2- 172.21.15.16:0/494199767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c070eb0 0x7fab5c0ce2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00bb90 tx=0x7fab4c00bea0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7fab62370700 1 -- 172.21.15.16:0/494199767 shutdown_connections 2023-08-25T04:43:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7fab62370700 1 --2- 172.21.15.16:0/494199767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c070eb0 0x7fab5c0ce2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7fab62370700 1 --2- 172.21.15.16:0/494199767 >> v2:172.21.15.117:3300/0 conn(0x7fab5c0caf10 0x7fab5c0cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7fab62370700 1 -- 172.21.15.16:0/494199767 >> 172.21.15.16:0/494199767 conn(0x7fab5c0b1a10 msgr2=0x7fab5c0b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7f71415d1700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713c0cc890 0x7f713c0cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7f71415d1700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f713c06fdb0 0x7f713c070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7f71415d1700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c162a40 con 0x7f713c161b30 2023-08-25T04:43:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7f71415d1700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c162620 con 0x7f713c06fdb0 2023-08-25T04:43:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7f71415d1700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0cce30 con 0x7f713c0cc890 2023-08-25T04:43:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7f713b7fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f713c06fdb0 0x7f713c070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7f713a7fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713c0cc890 0x7f713c0cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7f713a7fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713c0cc890 0x7f713c0cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:49876/0 (socket says 172.21.15.16:49876) 2023-08-25T04:43:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.273+0000 7f713a7fc700 1 -- 172.21.15.16:0/2085514686 learned_addr learned my addr 172.21.15.16:0/2085514686 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7f713b7fe700 1 -- 172.21.15.16:0/2085514686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713c0cc890 msgr2=0x7f713c0cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7f713b7fe700 1 --2- 172.21.15.16:0/2085514686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713c0cc890 0x7f713c0cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7f713b7fe700 1 -- 172.21.15.16:0/2085514686 >> v1:172.21.15.16:6789/0 conn(0x7f713c161b30 legacy=0x7f713c161f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7f713b7fe700 1 -- 172.21.15.16:0/2085514686 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c0cd110 con 0x7f713c06fdb0 2023-08-25T04:43:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7f713b7fe700 1 --2- 172.21.15.16:0/2085514686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c06fdb0 0x7f713c070240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7134009d90 tx=0x7f713400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc9a945a1e9c0050 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7fc8e5d9b700 1 -- 172.21.15.16:0/1070334965 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8e80cc890 msgr2=0x7fc8e8157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7fc8e5d9b700 1 --2- 172.21.15.16:0/1070334965 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8e80cc890 0x7fc8e8157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7fc8e5d9b700 1 -- 172.21.15.16:0/1070334965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8e81651c0 msgr2=0x7fc8e815d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7fc8e5d9b700 1 --2- 172.21.15.16:0/1070334965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8e81651c0 0x7fc8e815d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7fc8e5d9b700 1 -- 172.21.15.16:0/1070334965 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc009550 con 0x7fc8e8161b30 2023-08-25T04:43:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7f92a42f1700 1 Processor -- start 2023-08-25T04:43:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7f9367b31700 1 -- 172.21.15.16:0/2969411808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93600c6570 con 0x7f9360151760 2023-08-25T04:43:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7fc8e5d9b700 1 --2- 172.21.15.16:0/1070334965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e8161b30 0x7fc8e81f8660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc015000 tx=0x7fc8dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.275+0000 7f8022ffd700 1 -- 172.21.15.16:0/1920492296 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f80280075e0 con 0x7f802c15d3b0 2023-08-25T04:43:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.275+0000 7f8022ffd700 1 --2- 172.21.15.16:0/1920492296 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f801006a1b0 0x7f801006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.275+0000 7f8022ffd700 1 -- 172.21.15.16:0/1920492296 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8028087dc0 con 0x7f802c15d3b0 2023-08-25T04:43:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.275+0000 7f80321d1700 1 --2- 172.21.15.16:0/1920492296 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f801006a1b0 0x7f801006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f7139ffb700 1 -- 172.21.15.16:0/2085514686 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400e070 con 0x7f713c06fdb0 2023-08-25T04:43:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f7139ffb700 1 -- 172.21.15.16:0/2085514686 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713400bae0 con 0x7f713c06fdb0 2023-08-25T04:43:49.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f7139ffb700 1 -- 172.21.15.16:0/2085514686 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400be90 con 0x7f713c06fdb0 2023-08-25T04:43:49.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.275+0000 7f9367b31700 1 -- 172.21.15.16:0/2969411808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9360152130 con 0x7f9360151760 2023-08-25T04:43:49.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.275+0000 7fab62370700 1 -- 172.21.15.16:0/494199767 shutdown_connections 2023-08-25T04:43:49.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.275+0000 7fab62370700 1 -- 172.21.15.16:0/494199767 wait complete. 2023-08-25T04:43:49.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7fab62370700 1 Processor -- start 2023-08-25T04:43:49.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.277+0000 7f71415d1700 1 -- 172.21.15.16:0/2085514686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c06fdb0 msgr2=0x7f713c070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.277+0000 7f71415d1700 1 --2- 172.21.15.16:0/2085514686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c06fdb0 0x7f713c070240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7134009d90 tx=0x7f713400b330 comp rx=0 tx=0).stop 2023-08-25T04:43:49.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.274+0000 7f92a42f1700 1 -- start start 2023-08-25T04:43:49.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a42f1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c06c4c0 0x7f929c152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a42f1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c071cc0 0x7f929c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a42f1700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae6d0 0x7f929c0c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a42f1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c159ac0 con 0x7f929c071cc0 2023-08-25T04:43:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a42f1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c159d10 con 0x7f929c06c4c0 2023-08-25T04:43:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a42f1700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c159ff0 con 0x7f929c0ae6d0 2023-08-25T04:43:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a208d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c06c4c0 0x7f929c152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a208d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c06c4c0 0x7f929c152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36670/0 (socket says 172.21.15.16:36670) 2023-08-25T04:43:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a208d700 1 -- 172.21.15.16:0/2970779574 learned_addr learned my addr 172.21.15.16:0/2970779574 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a288e700 1 --2- 172.21.15.16:0/2970779574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae6d0 0x7f929c0c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a208d700 1 -- 172.21.15.16:0/2970779574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae6d0 msgr2=0x7f929c0c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a208d700 1 --2- 172.21.15.16:0/2970779574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae6d0 0x7f929c0c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a208d700 1 -- 172.21.15.16:0/2970779574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c071cc0 msgr2=0x7f929c15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a208d700 1 --2- 172.21.15.16:0/2970779574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c071cc0 0x7f929c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.276+0000 7f92a208d700 1 -- 172.21.15.16:0/2970779574 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9294009b30 con 0x7f929c06c4c0 2023-08-25T04:43:49.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.277+0000 7f92a208d700 1 --2- 172.21.15.16:0/2970779574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c06c4c0 0x7f929c152510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f928c001e50 tx=0x7f928c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.277+0000 7f9292ffd700 1 -- 172.21.15.16:0/2970779574 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c0052e0 con 0x7f929c06c4c0 2023-08-25T04:43:49.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.277+0000 7f9292ffd700 1 -- 172.21.15.16:0/2970779574 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928c005460 con 0x7f929c06c4c0 2023-08-25T04:43:49.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.277+0000 7f9292ffd700 1 -- 172.21.15.16:0/2970779574 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c0038c0 con 0x7f929c06c4c0 2023-08-25T04:43:49.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.277+0000 7f92a42f1700 1 -- 172.21.15.16:0/2970779574 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c15a2d0 con 0x7f929c06c4c0 2023-08-25T04:43:49.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.277+0000 7f9367b31700 1 -- 172.21.15.16:0/2969411808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93600c6d30 con 0x7f9360151760 2023-08-25T04:43:49.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.277+0000 7f80321d1700 1 --2- 172.21.15.16:0/1920492296 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f801006a1b0 0x7f801006c670 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f801c00b9b0 tx=0x7f801c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.277+0000 7f92a42f1700 1 -- 172.21.15.16:0/2970779574 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c15a890 con 0x7f929c06c4c0 2023-08-25T04:43:49.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.277+0000 7fab62370700 1 -- start start 2023-08-25T04:43:49.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7f71415d1700 1 -- 172.21.15.16:0/2085514686 shutdown_connections 2023-08-25T04:43:49.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7f71415d1700 1 --2- 172.21.15.16:0/2085514686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c06fdb0 0x7f713c070240 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7f71415d1700 1 --2- 172.21.15.16:0/2085514686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713c0cc890 0x7f713c0cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7f71415d1700 1 -- 172.21.15.16:0/2085514686 >> 172.21.15.16:0/2085514686 conn(0x7f713c0cecc0 msgr2=0x7f713c0cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7f71415d1700 1 -- 172.21.15.16:0/2085514686 shutdown_connections 2023-08-25T04:43:49.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7f71415d1700 1 -- 172.21.15.16:0/2085514686 wait complete. 2023-08-25T04:43:49.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7fab62370700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab5c070eb0 0x7fab5c15ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7fab62370700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab5c0caf10 0x7fab5c14f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7fab62370700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c0cc830 0x7fab5c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7fab62370700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c15b660 con 0x7fab5c070eb0 2023-08-25T04:43:49.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7fab62370700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c15b940 con 0x7fab5c0caf10 2023-08-25T04:43:49.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7fab62370700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c15bc20 con 0x7fab5c0cc830 2023-08-25T04:43:49.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7fab5b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab5c0caf10 0x7fab5c14f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7fab5b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab5c0caf10 0x7fab5c14f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36676/0 (socket says 172.21.15.16:36676) 2023-08-25T04:43:49.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.278+0000 7fab5b7fe700 1 -- 172.21.15.16:0/1420634975 learned_addr learned my addr 172.21.15.16:0/1420634975 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:49.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.279+0000 7fab6090d700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c0cc830 0x7fab5c06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.279+0000 7fab5bfff700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab5c070eb0 0x7fab5c15ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.279+0000 7fab5b7fe700 1 -- 172.21.15.16:0/1420634975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c0cc830 msgr2=0x7fab5c06d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.279+0000 7fab5b7fe700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c0cc830 0x7fab5c06d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.279+0000 7fab5b7fe700 1 -- 172.21.15.16:0/1420634975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab5c070eb0 msgr2=0x7fab5c15ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.279+0000 7fab5b7fe700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab5c070eb0 0x7fab5c15ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.279+0000 7fab5b7fe700 1 -- 172.21.15.16:0/1420634975 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c00b7f0 con 0x7fab5c0caf10 2023-08-25T04:43:49.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.279+0000 7fab5bfff700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab5c070eb0 0x7fab5c15ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:49.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.279+0000 7fab5b7fe700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab5c0caf10 0x7fab5c14f1d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fab5000d800 tx=0x7fab5000db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.279+0000 7fab58ff9700 1 -- 172.21.15.16:0/1420634975 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab500125f0 con 0x7fab5c0caf10 2023-08-25T04:43:49.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.279+0000 7fab58ff9700 1 -- 172.21.15.16:0/1420634975 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab50012750 con 0x7fab5c0caf10 2023-08-25T04:43:49.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.279+0000 7fab62370700 1 -- 172.21.15.16:0/1420634975 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5c15bf00 con 0x7fab5c0caf10 2023-08-25T04:43:49.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.279+0000 7fab62370700 1 -- 172.21.15.16:0/1420634975 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5c15b350 con 0x7fab5c0caf10 2023-08-25T04:43:49.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.280+0000 7fab58ff9700 1 -- 172.21.15.16:0/1420634975 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50012ae0 con 0x7fab5c0caf10 2023-08-25T04:43:49.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.280+0000 7f71415d1700 1 Processor -- start 2023-08-25T04:43:49.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.281+0000 7fab62370700 1 -- 172.21.15.16:0/1420634975 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3c0052f0 con 0x7fab5c0caf10 2023-08-25T04:43:49.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.281+0000 7fab58ff9700 1 -- 172.21.15.16:0/1420634975 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fab50012c40 con 0x7fab5c0caf10 2023-08-25T04:43:49.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.281+0000 7f9292ffd700 1 -- 172.21.15.16:0/2970779574 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f928c003a20 con 0x7f929c06c4c0 2023-08-25T04:43:49.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.281+0000 7f71415d1700 1 -- start start 2023-08-25T04:43:49.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.282+0000 7fab58ff9700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fab4806a0e0 0x7fab4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.282+0000 7fab58ff9700 1 -- 172.21.15.16:0/1420634975 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab500886e0 con 0x7fab5c0caf10 2023-08-25T04:43:49.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.282+0000 7f9292ffd700 1 --2- 172.21.15.16:0/2970779574 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f928006a130 0x7f928006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.282+0000 7f9292ffd700 1 -- 172.21.15.16:0/2970779574 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f928c0a9780 con 0x7f929c06c4c0 2023-08-25T04:43:49.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.282+0000 7f8022ffd700 1 -- 172.21.15.16:0/1920492296 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8028053490 con 0x7f802c15d3b0 2023-08-25T04:43:49.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.282+0000 7fab5bfff700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fab4806a0e0 0x7fab4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.282+0000 7fc8d6ffd700 1 -- 172.21.15.16:0/1070334965 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc003c90 con 0x7fc8e8161b30 2023-08-25T04:43:49.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.282+0000 7fc8ecf00700 1 -- 172.21.15.16:0/1070334965 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e81580b0 con 0x7fc8e8161b30 2023-08-25T04:43:49.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.282+0000 7fc8ecf00700 1 -- 172.21.15.16:0/1070334965 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e8158670 con 0x7fc8e8161b30 2023-08-25T04:43:49.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f71415d1700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713c06fdb0 0x7f713c159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f71415d1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f713c0cc890 0x7f713c1600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7fab5bfff700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fab4806a0e0 0x7fab4806c5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab5c152f40 tx=0x7fab54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f71415d1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c161b30 0x7f713c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f71415d1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0c3a70 con 0x7f713c0cc890 2023-08-25T04:43:49.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f71415d1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c1609c0 con 0x7f713c161b30 2023-08-25T04:43:49.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f71415d1700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0c3ce0 con 0x7f713c06fdb0 2023-08-25T04:43:49.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f713affd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713c06fdb0 0x7f713c159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f713affd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713c06fdb0 0x7f713c159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:49898/0 (socket says 172.21.15.16:49898) 2023-08-25T04:43:49.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f713affd700 1 -- 172.21.15.16:0/1106072563 learned_addr learned my addr 172.21.15.16:0/1106072563 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:49.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f713b7fe700 1 --2- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c161b30 0x7f713c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f713affd700 1 -- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c161b30 msgr2=0x7f713c0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f713affd700 1 --2- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c161b30 0x7f713c0b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f713affd700 1 -- 172.21.15.16:0/1106072563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f713c0cc890 msgr2=0x7f713c1600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f713affd700 1 --2- 172.21.15.16:0/1106072563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f713c0cc890 0x7f713c1600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f713affd700 1 -- 172.21.15.16:0/1106072563 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7134009a70 con 0x7f713c06fdb0 2023-08-25T04:43:49.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.282+0000 7fc8d6ffd700 1 -- 172.21.15.16:0/1070334965 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc01f070 con 0x7fc8e8161b30 2023-08-25T04:43:49.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.282+0000 7fc8d6ffd700 1 -- 172.21.15.16:0/1070334965 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc011630 con 0x7fc8e8161b30 2023-08-25T04:43:49.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f713b7fe700 1 --2- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c161b30 0x7f713c0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:49.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f92a188c700 1 --2- 172.21.15.16:0/2970779574 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f928006a130 0x7f928006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.283+0000 7f713affd700 1 --2- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713c06fdb0 0x7f713c159590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f713000c4a0 tx=0x7f713000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.284+0000 7f93567fc700 1 -- 172.21.15.16:0/2969411808 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f935c01a400 con 0x7f9360151760 2023-08-25T04:43:49.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.284+0000 7f71237fe700 1 -- 172.21.15.16:0/1106072563 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300054e0 con 0x7f713c06fdb0 2023-08-25T04:43:49.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.284+0000 7f71237fe700 1 -- 172.21.15.16:0/1106072563 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7130003680 con 0x7f713c06fdb0 2023-08-25T04:43:49.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.284+0000 7f71237fe700 1 -- 172.21.15.16:0/1106072563 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130003a30 con 0x7f713c06fdb0 2023-08-25T04:43:49.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.284+0000 7f71415d1700 1 -- 172.21.15.16:0/1106072563 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c0c3fc0 con 0x7f713c06fdb0 2023-08-25T04:43:49.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.284+0000 7f71415d1700 1 -- 172.21.15.16:0/1106072563 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c159ad0 con 0x7f713c06fdb0 2023-08-25T04:43:49.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.284+0000 7f92a188c700 1 --2- 172.21.15.16:0/2970779574 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f928006a130 0x7f928006c5f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f929c0cb9c0 tx=0x7f92980095a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.284+0000 7f93567fc700 1 --2- 172.21.15.16:0/2969411808 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f934406a160 0x7f934406c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.284+0000 7f93567fc700 1 -- 172.21.15.16:0/2969411808 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f935c088900 con 0x7f9360151760 2023-08-25T04:43:49.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.284+0000 7f93658cd700 1 --2- 172.21.15.16:0/2969411808 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f934406a160 0x7f934406c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.285+0000 7fc8ecf00700 1 -- 172.21.15.16:0/1070334965 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc0052f0 con 0x7fc8e8161b30 2023-08-25T04:43:49.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.285+0000 7f93658cd700 1 --2- 172.21.15.16:0/2969411808 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f934406a160 0x7f934406c620 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f93580012e0 tx=0x7f9358012040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.285+0000 7f71415d1700 1 -- 172.21.15.16:0/1106072563 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c0c41b0 con 0x7f713c06fdb0 2023-08-25T04:43:49.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.286+0000 7f71237fe700 1 -- 172.21.15.16:0/1106072563 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7130003b90 con 0x7f713c06fdb0 2023-08-25T04:43:49.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.286+0000 7f71237fe700 1 --2- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f712806a0e0 0x7f712806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.286+0000 7f71237fe700 1 -- 172.21.15.16:0/1106072563 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7130087540 con 0x7f713c06fdb0 2023-08-25T04:43:49.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.286+0000 7f713a7fc700 1 --2- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f712806a0e0 0x7f712806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.287+0000 7f92a42f1700 1 -- 172.21.15.16:0/2970779574 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92840052f0 con 0x7f929c06c4c0 2023-08-25T04:43:49.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.287+0000 7f713a7fc700 1 --2- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f712806a0e0 0x7f712806c5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f712c006fd0 tx=0x7f712c006f20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.287+0000 7fab58ff9700 1 -- 172.21.15.16:0/1420634975 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fab50053e60 con 0x7fab5c0caf10 2023-08-25T04:43:49.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.291+0000 7f71237fe700 1 -- 172.21.15.16:0/1106072563 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7130052c30 con 0x7f713c06fdb0 2023-08-25T04:43:49.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.292+0000 7f9292ffd700 1 -- 172.21.15.16:0/2970779574 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f928c074f50 con 0x7f929c06c4c0 2023-08-25T04:43:49.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.293+0000 7f93567fc700 1 -- 172.21.15.16:0/2969411808 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f935c054180 con 0x7f9360151760 2023-08-25T04:43:49.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.295+0000 7fc8d6ffd700 1 -- 172.21.15.16:0/1070334965 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc8dc021030 con 0x7fc8e8161b30 2023-08-25T04:43:49.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.295+0000 7fc8d6ffd700 1 --2- 172.21.15.16:0/1070334965 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc8c806a0e0 0x7fc8c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.295+0000 7fc8d6ffd700 1 -- 172.21.15.16:0/1070334965 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8dc089ef0 con 0x7fc8e8161b30 2023-08-25T04:43:49.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.296+0000 7fc8e659c700 1 --2- 172.21.15.16:0/1070334965 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc8c806a0e0 0x7fc8c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.296+0000 7fc8e659c700 1 --2- 172.21.15.16:0/1070334965 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc8c806a0e0 0x7fc8c806c5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80bdd50 tx=0x7fc8e000b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.309+0000 7fc8d6ffd700 1 -- 172.21.15.16:0/1070334965 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc8dc055750 con 0x7fc8e8161b30 2023-08-25T04:43:49.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.317+0000 7f48ff84b700 1 Processor -- start 2023-08-25T04:43:49.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.317+0000 7f48ff84b700 1 -- start start 2023-08-25T04:43:49.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.319+0000 7f48ff84b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48f8161b30 0x7f48f80cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.319+0000 7f48ff84b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f48f80cc890 0x7f48f8161f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.319+0000 7f48ff84b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f8162a40 con 0x7f48f81651c0 2023-08-25T04:43:49.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.319+0000 7f48ff84b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f80cce30 con 0x7f48f80cc890 2023-08-25T04:43:49.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.319+0000 7f48ff84b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80cd110 con 0x7f48f8161b30 2023-08-25T04:43:49.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.319+0000 7f48fd5e7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48f8161b30 0x7f48f80cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.320+0000 7f48fd5e7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48f8161b30 0x7f48f80cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:49910/0 (socket says 172.21.15.16:49910) 2023-08-25T04:43:49.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.320+0000 7f48fd5e7700 1 -- 172.21.15.16:0/3920293484 learned_addr learned my addr 172.21.15.16:0/3920293484 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:49.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.320+0000 7f48fd5e7700 1 -- 172.21.15.16:0/3920293484 >> v2:172.21.15.16:3300/0 conn(0x7f48f80cc890 msgr2=0x7f48f8161f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:49.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.320+0000 7f48fd5e7700 1 --2- 172.21.15.16:0/3920293484 >> v2:172.21.15.16:3300/0 conn(0x7f48f80cc890 0x7f48f8161f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.320+0000 7f48fd5e7700 1 -- 172.21.15.16:0/3920293484 >> v1:172.21.15.16:6789/0 conn(0x7f48f81651c0 legacy=0x7f48f8165650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:49.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.320+0000 7f48fd5e7700 1 -- 172.21.15.16:0/3920293484 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f80cd3f0 con 0x7f48f8161b30 2023-08-25T04:43:49.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.321+0000 7f48fd5e7700 1 --2- 172.21.15.16:0/3920293484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48f8161b30 0x7f48f80cb1f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009e50 tx=0x7f48f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1887efbe26fa2362 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.321+0000 7f48effff700 1 -- 172.21.15.16:0/3920293484 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f000e070 con 0x7f48f8161b30 2023-08-25T04:43:49.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.321+0000 7f48effff700 1 -- 172.21.15.16:0/3920293484 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f0003a20 con 0x7f48f8161b30 2023-08-25T04:43:49.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.321+0000 7f48effff700 1 -- 172.21.15.16:0/3920293484 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f0003db0 con 0x7f48f8161b30 2023-08-25T04:43:49.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.322+0000 7f48ff84b700 1 -- 172.21.15.16:0/3920293484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48f8161b30 msgr2=0x7f48f80cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.322+0000 7f48ff84b700 1 --2- 172.21.15.16:0/3920293484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48f8161b30 0x7f48f80cb1f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009e50 tx=0x7f48f000b330 comp rx=0 tx=0).stop 2023-08-25T04:43:49.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.323+0000 7f48ff84b700 1 -- 172.21.15.16:0/3920293484 shutdown_connections 2023-08-25T04:43:49.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.323+0000 7f48ff84b700 1 --2- 172.21.15.16:0/3920293484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48f8161b30 0x7f48f80cb1f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.323+0000 7f48ff84b700 1 --2- 172.21.15.16:0/3920293484 >> v2:172.21.15.16:3300/0 conn(0x7f48f80cc890 0x7f48f8161f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.323+0000 7f48ff84b700 1 -- 172.21.15.16:0/3920293484 >> 172.21.15.16:0/3920293484 conn(0x7f48f80cecc0 msgr2=0x7f48f80cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.323+0000 7f48ff84b700 1 -- 172.21.15.16:0/3920293484 shutdown_connections 2023-08-25T04:43:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.324+0000 7f48ff84b700 1 -- 172.21.15.16:0/3920293484 wait complete. 2023-08-25T04:43:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.326+0000 7f48ff84b700 1 Processor -- start 2023-08-25T04:43:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.326+0000 7f48ff84b700 1 -- start start 2023-08-25T04:43:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.327+0000 7f48ff84b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f80cc890 0x7f48f80a8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.327+0000 7f48ff84b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48f8161b30 0x7f48f80c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.327+0000 7f48ff84b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48f81651c0 0x7f48f80a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.327+0000 7f48ff84b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f81533f0 con 0x7f48f80cc890 2023-08-25T04:43:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.327+0000 7f48ff84b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80a9630 con 0x7f48f81651c0 2023-08-25T04:43:49.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.327+0000 7f48ff84b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80c9e30 con 0x7f48f8161b30 2023-08-25T04:43:49.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.328+0000 7f48fcde6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48f8161b30 0x7f48f80c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.328+0000 7f48fcde6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48f8161b30 0x7f48f80c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:49916/0 (socket says 172.21.15.16:49916) 2023-08-25T04:43:49.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.328+0000 7f48fcde6700 1 -- 172.21.15.16:0/977466724 learned_addr learned my addr 172.21.15.16:0/977466724 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:49.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.328+0000 7f48fd5e7700 1 --2- 172.21.15.16:0/977466724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f80cc890 0x7f48f80a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.328+0000 7f48fdde8700 1 --2- 172.21.15.16:0/977466724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48f81651c0 0x7f48f80a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.328+0000 7f48fd5e7700 1 -- 172.21.15.16:0/977466724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48f8161b30 msgr2=0x7f48f80c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.328+0000 7f48fd5e7700 1 --2- 172.21.15.16:0/977466724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48f8161b30 0x7f48f80c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.328+0000 7f48fd5e7700 1 -- 172.21.15.16:0/977466724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48f81651c0 msgr2=0x7f48f80a9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.328+0000 7f48fd5e7700 1 --2- 172.21.15.16:0/977466724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48f81651c0 0x7f48f80a9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.328+0000 7f48fd5e7700 1 -- 172.21.15.16:0/977466724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f0009b30 con 0x7f48f80cc890 2023-08-25T04:43:49.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.329+0000 7f48fd5e7700 1 --2- 172.21.15.16:0/977466724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f80cc890 0x7f48f80a8440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f48f0014000 tx=0x7f48f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.331+0000 7f48edffb700 1 -- 172.21.15.16:0/977466724 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00044c0 con 0x7f48f80cc890 2023-08-25T04:43:49.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.331+0000 7f48edffb700 1 -- 172.21.15.16:0/977466724 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f0004640 con 0x7f48f80cc890 2023-08-25T04:43:49.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.331+0000 7f48edffb700 1 -- 172.21.15.16:0/977466724 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f0012430 con 0x7f48f80cc890 2023-08-25T04:43:49.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.332+0000 7f48ff84b700 1 -- 172.21.15.16:0/977466724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f80a8a20 con 0x7f48f80cc890 2023-08-25T04:43:49.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.332+0000 7f48ff84b700 1 -- 172.21.15.16:0/977466724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f80a8fe0 con 0x7f48f80cc890 2023-08-25T04:43:49.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.337+0000 7f48edffb700 1 -- 172.21.15.16:0/977466724 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f48f0012590 con 0x7f48f80cc890 2023-08-25T04:43:49.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.337+0000 7f48edffb700 1 --2- 172.21.15.16:0/977466724 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f48dc06a180 0x7f48dc06c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:49.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.338+0000 7f48edffb700 1 -- 172.21.15.16:0/977466724 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f48f0089ce0 con 0x7f48f80cc890 2023-08-25T04:43:49.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.338+0000 7f48fcde6700 1 --2- 172.21.15.16:0/977466724 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f48dc06a180 0x7f48dc06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:49.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.339+0000 7f48ff84b700 1 -- 172.21.15.16:0/977466724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d80052f0 con 0x7f48f80cc890 2023-08-25T04:43:49.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.349+0000 7f48edffb700 1 -- 172.21.15.16:0/977466724 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f48f0055440 con 0x7f48f80cc890 2023-08-25T04:43:49.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.349+0000 7f48fcde6700 1 --2- 172.21.15.16:0/977466724 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f48dc06a180 0x7f48dc06c640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f48e8006fd0 tx=0x7f48e8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:49.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.682+0000 7f14d7394700 1 -- 172.21.15.16:0/86463934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f14b0005870 con 0x7f14d00c9850 2023-08-25T04:43:49.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.683+0000 7f14c5ffb700 1 -- 172.21.15.16:0/86463934 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f14c802a070 con 0x7f14d00c9850 2023-08-25T04:43:49.687 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-08-25T04:43:49.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.686+0000 7f14d7394700 1 -- 172.21.15.16:0/86463934 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f14b406a0e0 msgr2=0x7f14b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.686+0000 7f14d7394700 1 --2- 172.21.15.16:0/86463934 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f14b406a0e0 0x7f14b406c5a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f14d00ca4c0 tx=0x7f14c0008040 comp rx=0 tx=0).stop 2023-08-25T04:43:49.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.686+0000 7f14d7394700 1 -- 172.21.15.16:0/86463934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14d00c9850 msgr2=0x7f14d00b42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.686+0000 7f14d7394700 1 --2- 172.21.15.16:0/86463934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14d00c9850 0x7f14d00b42e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14c800b370 tx=0x7f14c8004ad0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.687+0000 7f14d7394700 1 -- 172.21.15.16:0/86463934 shutdown_connections 2023-08-25T04:43:49.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.687+0000 7f14d7394700 1 --2- 172.21.15.16:0/86463934 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f14b406a0e0 0x7f14b406c5a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.687+0000 7f14d7394700 1 --2- 172.21.15.16:0/86463934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14d015da40 0x7f14d014c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.687+0000 7f14d7394700 1 --2- 172.21.15.16:0/86463934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14d00c9850 0x7f14d00b42e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.687+0000 7f14d7394700 1 --2- 172.21.15.16:0/86463934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d00cf7e0 0x7f14d00c15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.687+0000 7f14d7394700 1 -- 172.21.15.16:0/86463934 >> 172.21.15.16:0/86463934 conn(0x7f14d00cecc0 msgr2=0x7f14d00cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.687+0000 7f14d7394700 1 -- 172.21.15.16:0/86463934 shutdown_connections 2023-08-25T04:43:49.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.687+0000 7f14d7394700 1 -- 172.21.15.16:0/86463934 wait complete. 2023-08-25T04:43:49.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.699+0000 7fab62370700 1 -- 172.21.15.16:0/1420634975 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fab3c005870 con 0x7fab5c0caf10 2023-08-25T04:43:49.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.700+0000 7fab58ff9700 1 -- 172.21.15.16:0/1420634975 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab50057480 con 0x7fab5c0caf10 2023-08-25T04:43:49.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.704+0000 7f8034435700 1 -- 172.21.15.16:0/1920492296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f802c04ee70 con 0x7f802c15d3b0 2023-08-25T04:43:49.706 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-08-25T04:43:49.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.705+0000 7f8022ffd700 1 -- 172.21.15.16:0/1920492296 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8028017020 con 0x7f802c15d3b0 2023-08-25T04:43:49.709 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2023-08-25T04:43:49.709 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2023-08-25T04:43:49.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.707+0000 7f92a42f1700 1 -- 172.21.15.16:0/2970779574 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9284005870 con 0x7f929c06c4c0 2023-08-25T04:43:49.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.707+0000 7f9292ffd700 1 -- 172.21.15.16:0/2970779574 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f928c039070 con 0x7f929c06c4c0 2023-08-25T04:43:49.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-08-25T04:43:49.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.710+0000 7f92a42f1700 1 -- 172.21.15.16:0/2970779574 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f928006a130 msgr2=0x7f928006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.710+0000 7f92a42f1700 1 --2- 172.21.15.16:0/2970779574 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f928006a130 0x7f928006c5f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f929c0cb9c0 tx=0x7f92980095a0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.710+0000 7f92a42f1700 1 -- 172.21.15.16:0/2970779574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c06c4c0 msgr2=0x7f929c152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.710+0000 7f92a42f1700 1 --2- 172.21.15.16:0/2970779574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c06c4c0 0x7f929c152510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f928c001e50 tx=0x7f928c00c800 comp rx=0 tx=0).stop 2023-08-25T04:43:49.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.710+0000 7f71415d1700 1 -- 172.21.15.16:0/1106072563 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f713c0c3e20 con 0x7f713c06fdb0 2023-08-25T04:43:49.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.710+0000 7f92a42f1700 1 -- 172.21.15.16:0/2970779574 shutdown_connections 2023-08-25T04:43:49.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.710+0000 7f92a42f1700 1 --2- 172.21.15.16:0/2970779574 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f928006a130 0x7f928006c5f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.710+0000 7f92a42f1700 1 --2- 172.21.15.16:0/2970779574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f929c0ae6d0 0x7f929c0c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.710+0000 7f92a42f1700 1 --2- 172.21.15.16:0/2970779574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c06c4c0 0x7f929c152510 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.710+0000 7f92a42f1700 1 --2- 172.21.15.16:0/2970779574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c071cc0 0x7f929c15db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.710+0000 7f92a42f1700 1 -- 172.21.15.16:0/2970779574 >> 172.21.15.16:0/2970779574 conn(0x7f929c0b2480 msgr2=0x7f929c0ac140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.710+0000 7f92a42f1700 1 -- 172.21.15.16:0/2970779574 shutdown_connections 2023-08-25T04:43:49.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.710+0000 7f92a42f1700 1 -- 172.21.15.16:0/2970779574 wait complete. 2023-08-25T04:43:49.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.710+0000 7f71237fe700 1 -- 172.21.15.16:0/1106072563 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f713c0c3e20 con 0x7f713c06fdb0 2023-08-25T04:43:49.714 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2023-08-25T04:43:49.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7f8034435700 1 -- 172.21.15.16:0/1920492296 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f801006a1b0 msgr2=0x7f801006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7f8034435700 1 --2- 172.21.15.16:0/1920492296 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f801006a1b0 0x7f801006c670 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f801c00b9b0 tx=0x7f801c008040 comp rx=0 tx=0).stop 2023-08-25T04:43:49.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7f8034435700 1 -- 172.21.15.16:0/1920492296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c15d3b0 msgr2=0x7f802c1500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7f8034435700 1 --2- 172.21.15.16:0/1920492296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c15d3b0 0x7f802c1500d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f802800c400 tx=0x7f802800c710 comp rx=0 tx=0).stop 2023-08-25T04:43:49.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7fab62370700 1 -- 172.21.15.16:0/1420634975 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fab4806a0e0 msgr2=0x7fab4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7fab62370700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fab4806a0e0 0x7fab4806c5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab5c152f40 tx=0x7fab54009040 comp rx=0 tx=0).stop 2023-08-25T04:43:49.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7fab62370700 1 -- 172.21.15.16:0/1420634975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab5c0caf10 msgr2=0x7fab5c14f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7fab62370700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab5c0caf10 0x7fab5c14f1d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fab5000d800 tx=0x7fab5000db10 comp rx=0 tx=0).stop 2023-08-25T04:43:49.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7fab62370700 1 -- 172.21.15.16:0/1420634975 shutdown_connections 2023-08-25T04:43:49.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7fab62370700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fab4806a0e0 0x7fab4806c5a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7fab62370700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab5c0cc830 0x7fab5c06d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7fab62370700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab5c070eb0 0x7fab5c15ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7fab62370700 1 --2- 172.21.15.16:0/1420634975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab5c0caf10 0x7fab5c14f1d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7fab62370700 1 -- 172.21.15.16:0/1420634975 >> 172.21.15.16:0/1420634975 conn(0x7fab5c0b1a10 msgr2=0x7fab5c0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7fab62370700 1 -- 172.21.15.16:0/1420634975 shutdown_connections 2023-08-25T04:43:49.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.712+0000 7fab62370700 1 -- 172.21.15.16:0/1420634975 wait complete. 2023-08-25T04:43:49.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.713+0000 7f71415d1700 1 -- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f712806a0e0 msgr2=0x7f712806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.713+0000 7f71415d1700 1 --2- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f712806a0e0 0x7f712806c5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f712c006fd0 tx=0x7f712c006f20 comp rx=0 tx=0).stop 2023-08-25T04:43:49.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.713+0000 7f71415d1700 1 -- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713c06fdb0 msgr2=0x7f713c159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.713+0000 7f71415d1700 1 --2- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713c06fdb0 0x7f713c159590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f713000c4a0 tx=0x7f713000c7b0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.715+0000 7f71415d1700 1 -- 172.21.15.16:0/1106072563 shutdown_connections 2023-08-25T04:43:49.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.715+0000 7f71415d1700 1 --2- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f712806a0e0 0x7f712806c5a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.715+0000 7f71415d1700 1 --2- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c161b30 0x7f713c0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.715+0000 7f71415d1700 1 --2- 172.21.15.16:0/1106072563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f713c06fdb0 0x7f713c159590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.715+0000 7f71415d1700 1 --2- 172.21.15.16:0/1106072563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f713c0cc890 0x7f713c1600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.715+0000 7f71415d1700 1 -- 172.21.15.16:0/1106072563 >> 172.21.15.16:0/1106072563 conn(0x7f713c0cecc0 msgr2=0x7f713c0aec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.715+0000 7f8034435700 1 -- 172.21.15.16:0/1920492296 shutdown_connections 2023-08-25T04:43:49.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.715+0000 7f8034435700 1 --2- 172.21.15.16:0/1920492296 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f801006a1b0 0x7f801006c670 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.715+0000 7f8034435700 1 --2- 172.21.15.16:0/1920492296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c15d3b0 0x7f802c1500d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.715+0000 7f8034435700 1 --2- 172.21.15.16:0/1920492296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f802c06c4e0 0x7f802c0c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.715+0000 7f8034435700 1 --2- 172.21.15.16:0/1920492296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802c06c960 0x7f802c0c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.715+0000 7f8034435700 1 -- 172.21.15.16:0/1920492296 >> 172.21.15.16:0/1920492296 conn(0x7f802c0cecc0 msgr2=0x7f802c1602b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.716+0000 7f71415d1700 1 -- 172.21.15.16:0/1106072563 shutdown_connections 2023-08-25T04:43:49.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.716+0000 7f71415d1700 1 -- 172.21.15.16:0/1106072563 wait complete. 2023-08-25T04:43:49.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.717+0000 7f8034435700 1 -- 172.21.15.16:0/1920492296 shutdown_connections 2023-08-25T04:43:49.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.717+0000 7f8034435700 1 -- 172.21.15.16:0/1920492296 wait complete. 2023-08-25T04:43:49.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.719+0000 7f9367b31700 1 -- 172.21.15.16:0/2969411808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f936004ee70 con 0x7f9360151760 2023-08-25T04:43:49.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.720+0000 7f93567fc700 1 -- 172.21.15.16:0/2969411808 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f935c0577a0 con 0x7f9360151760 2023-08-25T04:43:49.721 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-08-25T04:43:49.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.722+0000 7f9367b31700 1 -- 172.21.15.16:0/2969411808 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f934406a160 msgr2=0x7f934406c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.722+0000 7f9367b31700 1 --2- 172.21.15.16:0/2969411808 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f934406a160 0x7f934406c620 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f93580012e0 tx=0x7f9358012040 comp rx=0 tx=0).stop 2023-08-25T04:43:49.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.722+0000 7f9367b31700 1 -- 172.21.15.16:0/2969411808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9360151760 msgr2=0x7f9360151bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.722+0000 7f9367b31700 1 --2- 172.21.15.16:0/2969411808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9360151760 0x7f9360151bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f936006cd70 tx=0x7f935c00b6a0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.723+0000 7fc8ecf00700 1 -- 172.21.15.16:0/1070334965 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc8cc005870 con 0x7fc8e8161b30 2023-08-25T04:43:49.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.723+0000 7fc8d6ffd700 1 -- 172.21.15.16:0/1070334965 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc8dc058d70 con 0x7fc8e8161b30 2023-08-25T04:43:49.724 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2023-08-25T04:43:49.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.726+0000 7fc8ecf00700 1 -- 172.21.15.16:0/1070334965 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc8c806a0e0 msgr2=0x7fc8c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.726+0000 7fc8ecf00700 1 --2- 172.21.15.16:0/1070334965 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc8c806a0e0 0x7fc8c806c5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80bdd50 tx=0x7fc8e000b040 comp rx=0 tx=0).stop 2023-08-25T04:43:49.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.726+0000 7fc8ecf00700 1 -- 172.21.15.16:0/1070334965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e8161b30 msgr2=0x7fc8e81f8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.726+0000 7fc8ecf00700 1 --2- 172.21.15.16:0/1070334965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e8161b30 0x7fc8e81f8660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc015000 tx=0x7fc8dc004750 comp rx=0 tx=0).stop 2023-08-25T04:43:49.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.726+0000 7f9367b31700 1 -- 172.21.15.16:0/2969411808 shutdown_connections 2023-08-25T04:43:49.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.726+0000 7f9367b31700 1 --2- 172.21.15.16:0/2969411808 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f934406a160 0x7f934406c620 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.726+0000 7f9367b31700 1 --2- 172.21.15.16:0/2969411808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9360151760 0x7f9360151bf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.726+0000 7f9367b31700 1 --2- 172.21.15.16:0/2969411808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f936006c960 0x7f936014b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.726+0000 7f9367b31700 1 --2- 172.21.15.16:0/2969411808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f936015d3b0 0x7f9360152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.726+0000 7f9367b31700 1 -- 172.21.15.16:0/2969411808 >> 172.21.15.16:0/2969411808 conn(0x7f93600cecc0 msgr2=0x7f936015f780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.726+0000 7f9367b31700 1 -- 172.21.15.16:0/2969411808 shutdown_connections 2023-08-25T04:43:49.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.726+0000 7f9367b31700 1 -- 172.21.15.16:0/2969411808 wait complete. 2023-08-25T04:43:49.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-08-25T04:43:49.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.732+0000 7fc8ecf00700 1 -- 172.21.15.16:0/1070334965 shutdown_connections 2023-08-25T04:43:49.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.732+0000 7fc8ecf00700 1 --2- 172.21.15.16:0/1070334965 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc8c806a0e0 0x7fc8c806c5a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.732+0000 7fc8ecf00700 1 --2- 172.21.15.16:0/1070334965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8e81651c0 0x7fc8e815d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.732+0000 7fc8ecf00700 1 --2- 172.21.15.16:0/1070334965 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8e80cc890 0x7fc8e8157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.732+0000 7fc8ecf00700 1 --2- 172.21.15.16:0/1070334965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e8161b30 0x7fc8e81f8660 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.732+0000 7fc8ecf00700 1 -- 172.21.15.16:0/1070334965 >> 172.21.15.16:0/1070334965 conn(0x7fc8e80cecc0 msgr2=0x7fc8e8161f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.734+0000 7fc8ecf00700 1 -- 172.21.15.16:0/1070334965 shutdown_connections 2023-08-25T04:43:49.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.734+0000 7fc8ecf00700 1 -- 172.21.15.16:0/1070334965 wait complete. 2023-08-25T04:43:49.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-08-25T04:43:49.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-08-25T04:43:49.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-08-25T04:43:49.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-08-25T04:43:49.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.749+0000 7f48ff84b700 1 -- 172.21.15.16:0/977466724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f48d80055a0 con 0x7f48f80cc890 2023-08-25T04:43:49.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.750+0000 7f48edffb700 1 -- 172.21.15.16:0/977466724 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48f0017070 con 0x7f48f80cc890 2023-08-25T04:43:49.751 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-08-25T04:43:49.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.752+0000 7f48ff84b700 1 -- 172.21.15.16:0/977466724 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f48dc06a180 msgr2=0x7f48dc06c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.752+0000 7f48ff84b700 1 --2- 172.21.15.16:0/977466724 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f48dc06a180 0x7f48dc06c640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f48e8006fd0 tx=0x7f48e8008040 comp rx=0 tx=0).stop 2023-08-25T04:43:49.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.752+0000 7f48ff84b700 1 -- 172.21.15.16:0/977466724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f80cc890 msgr2=0x7f48f80a8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:49.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.752+0000 7f48ff84b700 1 --2- 172.21.15.16:0/977466724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f80cc890 0x7f48f80a8440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f48f0014000 tx=0x7f48f0004ad0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.752+0000 7f48ff84b700 1 -- 172.21.15.16:0/977466724 shutdown_connections 2023-08-25T04:43:49.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.752+0000 7f48ff84b700 1 --2- 172.21.15.16:0/977466724 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f48dc06a180 0x7f48dc06c640 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.752+0000 7f48ff84b700 1 --2- 172.21.15.16:0/977466724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48f81651c0 0x7f48f80a9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.752+0000 7f48ff84b700 1 --2- 172.21.15.16:0/977466724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f80cc890 0x7f48f80a8440 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.752+0000 7f48ff84b700 1 --2- 172.21.15.16:0/977466724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48f8161b30 0x7f48f80c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:49.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.752+0000 7f48ff84b700 1 -- 172.21.15.16:0/977466724 >> 172.21.15.16:0/977466724 conn(0x7f48f80cecc0 msgr2=0x7f48f8161100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:49.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.752+0000 7f48ff84b700 1 -- 172.21.15.16:0/977466724 shutdown_connections 2023-08-25T04:43:49.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:49.752+0000 7f48ff84b700 1 -- 172.21.15.16:0/977466724 wait complete. 2023-08-25T04:43:49.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2023-08-25T04:43:49.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-08-25T04:43:50.711 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-25T04:43:50.732 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-25T04:43:50.738 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-25T04:43:50.745 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-25T04:43:50.746 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-25T04:43:50.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-25T04:43:50.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-25T04:43:50.768 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-25T04:43:50.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.950+0000 7fd4af11e700 1 Processor -- start 2023-08-25T04:43:50.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.951+0000 7fd4af11e700 1 -- start start 2023-08-25T04:43:50.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.952+0000 7fd4af11e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a80cc890 0x7fd4a8159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.952+0000 7fd4af11e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd4a8159fc0 0x7fd4a806c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.952+0000 7fd4af11e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a806c1e0 con 0x7fd4a80c9310 2023-08-25T04:43:50.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.952+0000 7fd4af11e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a806b920 con 0x7fd4a8159fc0 2023-08-25T04:43:50.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.952+0000 7fd4af11e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a806bb90 con 0x7fd4a80cc890 2023-08-25T04:43:50.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.953+0000 7fd4ad6bb700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd4a8159fc0 0x7fd4a806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:50.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.954+0000 7fd4ad6bb700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd4a8159fc0 0x7fd4a806c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49382/0 (socket says 172.21.15.16:49382) 2023-08-25T04:43:50.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.954+0000 7fd4ad6bb700 1 -- 172.21.15.16:0/793534358 learned_addr learned my addr 172.21.15.16:0/793534358 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:50.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.954+0000 7fd4a7fff700 1 --2- 172.21.15.16:0/793534358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a80cc890 0x7fd4a8159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:50.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.954+0000 7fd4ad6bb700 1 -- 172.21.15.16:0/793534358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a80cc890 msgr2=0x7fd4a8159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:50.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.954+0000 7fd4ad6bb700 1 --2- 172.21.15.16:0/793534358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a80cc890 0x7fd4a8159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.954+0000 7fd4ad6bb700 1 -- 172.21.15.16:0/793534358 >> v1:172.21.15.16:6789/0 conn(0x7fd4a80c9310 legacy=0x7fd4a80c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:50.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.954+0000 7fd4ad6bb700 1 -- 172.21.15.16:0/793534358 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a806be70 con 0x7fd4a8159fc0 2023-08-25T04:43:50.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.955+0000 7fd4ad6bb700 1 --2- 172.21.15.16:0/793534358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a8159fc0 0x7fd4a806c670 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000c110 tx=0x7fd4a000ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e952ddaed981c64 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:50.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.955+0000 7fd4a77fe700 1 -- 172.21.15.16:0/793534358 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000ce70 con 0x7fd4a8159fc0 2023-08-25T04:43:50.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.955+0000 7fd4a77fe700 1 -- 172.21.15.16:0/793534358 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a0003a20 con 0x7fd4a8159fc0 2023-08-25T04:43:50.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.955+0000 7fd4a77fe700 1 -- 172.21.15.16:0/793534358 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0003dd0 con 0x7fd4a8159fc0 2023-08-25T04:43:50.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.956+0000 7fd4af11e700 1 -- 172.21.15.16:0/793534358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a8159fc0 msgr2=0x7fd4a806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:50.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.956+0000 7fd4af11e700 1 --2- 172.21.15.16:0/793534358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a8159fc0 0x7fd4a806c670 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000c110 tx=0x7fd4a000ace0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.957+0000 7fd4af11e700 1 -- 172.21.15.16:0/793534358 shutdown_connections 2023-08-25T04:43:50.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.957+0000 7fd4af11e700 1 --2- 172.21.15.16:0/793534358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a8159fc0 0x7fd4a806c670 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.957+0000 7fd4af11e700 1 --2- 172.21.15.16:0/793534358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a80cc890 0x7fd4a8159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.957+0000 7fd4af11e700 1 -- 172.21.15.16:0/793534358 >> 172.21.15.16:0/793534358 conn(0x7fd4a80cecc0 msgr2=0x7fd4a80cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:50.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.957+0000 7fd4af11e700 1 -- 172.21.15.16:0/793534358 shutdown_connections 2023-08-25T04:43:50.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.957+0000 7fd4af11e700 1 -- 172.21.15.16:0/793534358 wait complete. 2023-08-25T04:43:50.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.959+0000 7fd4af11e700 1 Processor -- start 2023-08-25T04:43:50.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.960+0000 7fd4af11e700 1 -- start start 2023-08-25T04:43:50.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.961+0000 7fd4af11e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a80c9310 0x7fd4a80b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.961+0000 7fd4af11e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a8159fc0 0x7fd4a814c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.961+0000 7fd4af11e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a8159050 0x7fd4a815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.961+0000 7fd4af11e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a8151870 con 0x7fd4a8159fc0 2023-08-25T04:43:50.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.961+0000 7fd4af11e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a8151ac0 con 0x7fd4a8159050 2023-08-25T04:43:50.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.961+0000 7fd4af11e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a8151da0 con 0x7fd4a80c9310 2023-08-25T04:43:50.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.962+0000 7fd4a7fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a8159fc0 0x7fd4a814c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:50.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.962+0000 7fd4a7fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a8159fc0 0x7fd4a814c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49392/0 (socket says 172.21.15.16:49392) 2023-08-25T04:43:50.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.962+0000 7fd4a7fff700 1 -- 172.21.15.16:0/3588325639 learned_addr learned my addr 172.21.15.16:0/3588325639 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:50.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.963+0000 7fd4a7fff700 1 -- 172.21.15.16:0/3588325639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a80c9310 msgr2=0x7fd4a80b18e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:43:50.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.963+0000 7fd4a7fff700 1 --2- 172.21.15.16:0/3588325639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a80c9310 0x7fd4a80b18e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.963+0000 7fd4a7fff700 1 -- 172.21.15.16:0/3588325639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a8159050 msgr2=0x7fd4a815bab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:43:50.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.963+0000 7fd4a7fff700 1 --2- 172.21.15.16:0/3588325639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a8159050 0x7fd4a815bab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.963+0000 7fd4a7fff700 1 -- 172.21.15.16:0/3588325639 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a0007790 con 0x7fd4a8159fc0 2023-08-25T04:43:50.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.964+0000 7fd4a7fff700 1 --2- 172.21.15.16:0/3588325639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a8159fc0 0x7fd4a814c970 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd49800a6f0 tx=0x7fd49800aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:50.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.965+0000 7fd4a57fa700 1 -- 172.21.15.16:0/3588325639 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498013710 con 0x7fd4a8159fc0 2023-08-25T04:43:50.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.965+0000 7fd4a57fa700 1 -- 172.21.15.16:0/3588325639 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49800c030 con 0x7fd4a8159fc0 2023-08-25T04:43:50.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.965+0000 7fd4a57fa700 1 -- 172.21.15.16:0/3588325639 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498013a90 con 0x7fd4a8159fc0 2023-08-25T04:43:50.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.965+0000 7fd4af11e700 1 -- 172.21.15.16:0/3588325639 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a8152080 con 0x7fd4a8159fc0 2023-08-25T04:43:50.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.965+0000 7fd4af11e700 1 -- 172.21.15.16:0/3588325639 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a81526d0 con 0x7fd4a8159fc0 2023-08-25T04:43:50.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.968+0000 7fd4a57fa700 1 -- 172.21.15.16:0/3588325639 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd498013bf0 con 0x7fd4a8159fc0 2023-08-25T04:43:50.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.969+0000 7fd4a57fa700 1 --2- 172.21.15.16:0/3588325639 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd49406a1b0 0x7fd49406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.969+0000 7fd4a57fa700 1 -- 172.21.15.16:0/3588325639 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd498088170 con 0x7fd4a8159fc0 2023-08-25T04:43:50.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.971+0000 7fd4aceba700 1 --2- 172.21.15.16:0/3588325639 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd49406a1b0 0x7fd49406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:50.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.971+0000 7fd4af11e700 1 -- 172.21.15.16:0/3588325639 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4880052f0 con 0x7fd4a8159fc0 2023-08-25T04:43:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.973+0000 7fd4aceba700 1 --2- 172.21.15.16:0/3588325639 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd49406a1b0 0x7fd49406c670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd49c001660 tx=0x7fd49c007a40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.971+0000 7fc5350bb700 1 Processor -- start 2023-08-25T04:43:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.971+0000 7fc5350bb700 1 -- start start 2023-08-25T04:43:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.973+0000 7fc5350bb700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc530161b30 0x7fc5300cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.973+0000 7fc5350bb700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc53006fdb0 0x7fc530070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.973+0000 7fc5350bb700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc530162a40 con 0x7fc5300cc890 2023-08-25T04:43:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.973+0000 7fc5350bb700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc530162620 con 0x7fc53006fdb0 2023-08-25T04:43:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.973+0000 7fc5350bb700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5300cce30 con 0x7fc530161b30 2023-08-25T04:43:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.973+0000 7fc52f59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc53006fdb0 0x7fc530070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.973+0000 7fc52f59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc53006fdb0 0x7fc530070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49396/0 (socket says 172.21.15.16:49396) 2023-08-25T04:43:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.973+0000 7fc52f59e700 1 -- 172.21.15.16:0/215295618 learned_addr learned my addr 172.21.15.16:0/215295618 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.973+0000 7fc52f59e700 1 -- 172.21.15.16:0/215295618 >> v2:172.21.15.117:3300/0 conn(0x7fc530161b30 msgr2=0x7fc5300cb1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:43:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.973+0000 7fc52f59e700 1 --2- 172.21.15.16:0/215295618 >> v2:172.21.15.117:3300/0 conn(0x7fc530161b30 0x7fc5300cb1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.973+0000 7fc52f59e700 1 -- 172.21.15.16:0/215295618 >> v1:172.21.15.117:6789/0 conn(0x7fc5300cc890 legacy=0x7fc530161f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:43:50.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.973+0000 7fc52f59e700 1 -- 172.21.15.16:0/215295618 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5300cd110 con 0x7fc53006fdb0 2023-08-25T04:43:50.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.974+0000 7fc52f59e700 1 --2- 172.21.15.16:0/215295618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc53006fdb0 0x7fc530070240 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc5300b1830 tx=0x7fc52800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67ed025c52eb76f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:50.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.978+0000 7fc52dd9b700 1 -- 172.21.15.16:0/215295618 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52800e070 con 0x7fc53006fdb0 2023-08-25T04:43:50.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.978+0000 7fc52dd9b700 1 -- 172.21.15.16:0/215295618 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc528003a20 con 0x7fc53006fdb0 2023-08-25T04:43:50.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.978+0000 7fc52dd9b700 1 -- 172.21.15.16:0/215295618 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528003dd0 con 0x7fc53006fdb0 2023-08-25T04:43:50.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.979+0000 7f33b227d700 1 Processor -- start 2023-08-25T04:43:50.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.980+0000 7fd4a57fa700 1 -- 172.21.15.16:0/3588325639 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd498053840 con 0x7fd4a8159fc0 2023-08-25T04:43:50.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.979+0000 7fc5350bb700 1 -- 172.21.15.16:0/215295618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc53006fdb0 msgr2=0x7fc530070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:50.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.979+0000 7fc5350bb700 1 --2- 172.21.15.16:0/215295618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc53006fdb0 0x7fc530070240 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc5300b1830 tx=0x7fc52800b330 comp rx=0 tx=0).stop 2023-08-25T04:43:50.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.979+0000 7fc5350bb700 1 -- 172.21.15.16:0/215295618 shutdown_connections 2023-08-25T04:43:50.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.979+0000 7fc5350bb700 1 --2- 172.21.15.16:0/215295618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc53006fdb0 0x7fc530070240 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.979+0000 7fc5350bb700 1 --2- 172.21.15.16:0/215295618 >> v2:172.21.15.117:3300/0 conn(0x7fc530161b30 0x7fc5300cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.979+0000 7fc5350bb700 1 -- 172.21.15.16:0/215295618 >> 172.21.15.16:0/215295618 conn(0x7fc5300cecc0 msgr2=0x7fc5300cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:50.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.979+0000 7f33b227d700 1 -- start start 2023-08-25T04:43:50.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.980+0000 7f33b227d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f33ac0c9310 0x7f33ac0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.980+0000 7f33b227d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f33ac0c96f0 0x7f33ac159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.980+0000 7f33b227d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ac06c1e0 con 0x7f33ac159fc0 2023-08-25T04:43:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.980+0000 7f33b227d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ac06b920 con 0x7f33ac0c9310 2023-08-25T04:43:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.980+0000 7f33b227d700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ac06bb90 con 0x7f33ac0c96f0 2023-08-25T04:43:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.981+0000 7f33b081a700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f33ac159fc0 0x7f33ac06c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39812/0 (socket says 172.21.15.16:39812) 2023-08-25T04:43:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.981+0000 7f33b081a700 1 -- 172.21.15.16:0/2002780689 learned_addr learned my addr 172.21.15.16:0/2002780689 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:50.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.981+0000 7fc5350bb700 1 -- 172.21.15.16:0/215295618 shutdown_connections 2023-08-25T04:43:50.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.981+0000 7fc5350bb700 1 -- 172.21.15.16:0/215295618 wait complete. 2023-08-25T04:43:50.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.981+0000 7f33aaffd700 1 -- 172.21.15.16:0/2002780689 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694245394 0 0) 0x7f33ac06c1e0 con 0x7f33ac159fc0 2023-08-25T04:43:50.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.981+0000 7f33aaffd700 1 -- 172.21.15.16:0/2002780689 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33940035b0 con 0x7f33ac159fc0 2023-08-25T04:43:50.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33ab7fe700 1 --2- 172.21.15.16:0/2002780689 >> v2:172.21.15.117:3300/0 conn(0x7f33ac0c96f0 0x7f33ac159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:50.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33aaffd700 1 -- 172.21.15.16:0/2002780689 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3948424996 0 0) 0x7f33940035b0 con 0x7f33ac159fc0 2023-08-25T04:43:50.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33aaffd700 1 -- 172.21.15.16:0/2002780689 >> v2:172.21.15.117:3300/0 conn(0x7f33ac0c96f0 msgr2=0x7f33ac159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:50.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33aaffd700 1 --2- 172.21.15.16:0/2002780689 >> v2:172.21.15.117:3300/0 conn(0x7f33ac0c96f0 0x7f33ac159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33aaffd700 1 -- 172.21.15.16:0/2002780689 >> v2:172.21.15.16:3300/0 conn(0x7f33ac0c9310 msgr2=0x7f33ac0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:50.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33aaffd700 1 --2- 172.21.15.16:0/2002780689 >> v2:172.21.15.16:3300/0 conn(0x7f33ac0c9310 0x7f33ac0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33aaffd700 1 -- 172.21.15.16:0/2002780689 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac06be70 con 0x7f33ac159fc0 2023-08-25T04:43:50.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33aaffd700 1 -- 172.21.15.16:0/2002780689 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f339c001670 con 0x7f33ac159fc0 2023-08-25T04:43:50.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33aaffd700 1 -- 172.21.15.16:0/2002780689 >> v1:172.21.15.16:6789/0 conn(0x7f33ac159fc0 legacy=0x7f33ac06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:50.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33aaffd700 1 --2- 172.21.15.16:0/2002780689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3394003ac0 0x7f3394003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33aaffd700 1 --2- 172.21.15.16:0/2002780689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3394004850 0x7f3394004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33aaffd700 1 --2- 172.21.15.16:0/2002780689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3394005410 0x7f339400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33aaffd700 1 -- 172.21.15.16:0/2002780689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac06b920 con 0x7f3394003ac0 2023-08-25T04:43:50.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33aaffd700 1 -- 172.21.15.16:0/2002780689 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac06bb90 con 0x7f3394005410 2023-08-25T04:43:50.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33aaffd700 1 -- 172.21.15.16:0/2002780689 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339400c370 con 0x7f3394004850 2023-08-25T04:43:50.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.982+0000 7f33abfff700 1 --2- 172.21.15.16:0/2002780689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3394003ac0 0x7f3394003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:50.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.983+0000 7f33abfff700 1 -- 172.21.15.16:0/2002780689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3394004850 msgr2=0x7f3394004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:50.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.983+0000 7f33abfff700 1 --2- 172.21.15.16:0/2002780689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3394004850 0x7f3394004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.983+0000 7f33abfff700 1 -- 172.21.15.16:0/2002780689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3394005410 msgr2=0x7f339400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:50.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.983+0000 7f33abfff700 1 --2- 172.21.15.16:0/2002780689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3394005410 0x7f339400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.983+0000 7f33abfff700 1 -- 172.21.15.16:0/2002780689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33940035b0 con 0x7f3394003ac0 2023-08-25T04:43:50.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.983+0000 7f33b081a700 1 -- 172.21.15.16:0/2002780689 reap_dead start 2023-08-25T04:43:50.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.983+0000 7f33abfff700 1 --2- 172.21.15.16:0/2002780689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3394003ac0 0x7f3394003ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009e40 tx=0x7f3394005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b2bf29ab7ec775 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:50.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.983+0000 7f33aaffd700 1 -- 172.21.15.16:0/2002780689 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a40098b0 con 0x7f3394003ac0 2023-08-25T04:43:50.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.983+0000 7f33aaffd700 1 -- 172.21.15.16:0/2002780689 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a4003c00 con 0x7f3394003ac0 2023-08-25T04:43:50.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.983+0000 7f33aaffd700 1 -- 172.21.15.16:0/2002780689 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a400b8a0 con 0x7f3394003ac0 2023-08-25T04:43:50.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.983+0000 7fc5350bb700 1 Processor -- start 2023-08-25T04:43:50.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.983+0000 7fc5350bb700 1 -- start start 2023-08-25T04:43:50.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.984+0000 7f33b227d700 1 -- 172.21.15.16:0/2002780689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3394003ac0 msgr2=0x7f3394003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:50.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.984+0000 7f33b227d700 1 --2- 172.21.15.16:0/2002780689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3394003ac0 0x7f3394003ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009e40 tx=0x7f3394005880 comp rx=0 tx=0).stop 2023-08-25T04:43:50.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.984+0000 7f33b227d700 1 -- 172.21.15.16:0/2002780689 shutdown_connections 2023-08-25T04:43:50.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.984+0000 7f33b227d700 1 --2- 172.21.15.16:0/2002780689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3394003ac0 0x7f3394003ee0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.984+0000 7f33b227d700 1 -- 172.21.15.16:0/2002780689 >> 172.21.15.16:0/2002780689 conn(0x7f33ac0cecc0 msgr2=0x7f33ac0cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:50.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.984+0000 7f33b227d700 1 -- 172.21.15.16:0/2002780689 shutdown_connections 2023-08-25T04:43:50.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.984+0000 7f33b227d700 1 -- 172.21.15.16:0/2002780689 wait complete. 2023-08-25T04:43:50.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.985+0000 7fc5350bb700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc53006fdb0 0x7fc530152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.985+0000 7fc5350bb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5300cc890 0x7fc5300b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.985+0000 7fc5350bb700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc530161b30 0x7fc5300c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.985+0000 7fc5350bb700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5300b0f00 con 0x7fc530161b30 2023-08-25T04:43:50.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.985+0000 7fc5350bb700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc530152d00 con 0x7fc5300cc890 2023-08-25T04:43:50.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.985+0000 7fc5350bb700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc530152fe0 con 0x7fc53006fdb0 2023-08-25T04:43:50.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.985+0000 7fc52ed9d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc53006fdb0 0x7fc530152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:50.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.985+0000 7fc52ed9d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc53006fdb0 0x7fc530152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:49952/0 (socket says 172.21.15.16:49952) 2023-08-25T04:43:50.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.985+0000 7fc52ed9d700 1 -- 172.21.15.16:0/2512694102 learned_addr learned my addr 172.21.15.16:0/2512694102 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:50.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.985+0000 7fc52e59c700 1 --2- 172.21.15.16:0/2512694102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5300cc890 0x7fc5300b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:50.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.986+0000 7fc52f59e700 1 --2- 172.21.15.16:0/2512694102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc530161b30 0x7fc5300c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:50.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.986+0000 7f33b227d700 1 Processor -- start 2023-08-25T04:43:50.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.986+0000 7fc52f59e700 1 -- 172.21.15.16:0/2512694102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc53006fdb0 msgr2=0x7fc530152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:50.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.986+0000 7fc52f59e700 1 --2- 172.21.15.16:0/2512694102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc53006fdb0 0x7fc530152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.986+0000 7fc52f59e700 1 -- 172.21.15.16:0/2512694102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5300cc890 msgr2=0x7fc5300b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.986+0000 7fc52f59e700 1 --2- 172.21.15.16:0/2512694102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5300cc890 0x7fc5300b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.986+0000 7fc52f59e700 1 -- 172.21.15.16:0/2512694102 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc528009b30 con 0x7fc530161b30 2023-08-25T04:43:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.987+0000 7fc52f59e700 1 --2- 172.21.15.16:0/2512694102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc530161b30 0x7fc5300c91d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc528014000 tx=0x7fc528004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.987+0000 7fc5177fe700 1 -- 172.21.15.16:0/2512694102 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5280092e0 con 0x7fc530161b30 2023-08-25T04:43:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.987+0000 7fc5177fe700 1 -- 172.21.15.16:0/2512694102 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc528004240 con 0x7fc530161b30 2023-08-25T04:43:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.987+0000 7fc5177fe700 1 -- 172.21.15.16:0/2512694102 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5280045f0 con 0x7fc530161b30 2023-08-25T04:43:50.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.988+0000 7f0a974e3700 1 Processor -- start 2023-08-25T04:43:50.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.987+0000 7f33b227d700 1 -- start start 2023-08-25T04:43:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.988+0000 7f33b227d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3394003ac0 0x7f33ac154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.988+0000 7f33b227d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33ac15c1a0 0x7f33ac14f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.988+0000 7f33b227d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac1ee8a0 0x7f33ac1eed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.988+0000 7f33b227d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac15b3e0 con 0x7f33ac15c1a0 2023-08-25T04:43:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.988+0000 7f33b227d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac15b6c0 con 0x7f3394003ac0 2023-08-25T04:43:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.988+0000 7f33b227d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac15b9a0 con 0x7f33ac1ee8a0 2023-08-25T04:43:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.988+0000 7f33b081a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac1ee8a0 0x7f33ac1eed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.988+0000 7f33b081a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac1ee8a0 0x7f33ac1eed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:49958/0 (socket says 172.21.15.16:49958) 2023-08-25T04:43:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.988+0000 7f33b081a700 1 -- 172.21.15.16:0/365329605 learned_addr learned my addr 172.21.15.16:0/365329605 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.989+0000 7f33b081a700 1 -- 172.21.15.16:0/365329605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3394003ac0 msgr2=0x7f33ac154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.989+0000 7f33b081a700 1 --2- 172.21.15.16:0/365329605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3394003ac0 0x7f33ac154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.989+0000 7f33b081a700 1 -- 172.21.15.16:0/365329605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33ac15c1a0 msgr2=0x7f33ac14f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.989+0000 7f33b081a700 1 --2- 172.21.15.16:0/365329605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33ac15c1a0 0x7f33ac14f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.989+0000 7f33b081a700 1 -- 172.21.15.16:0/365329605 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac15bc80 con 0x7f33ac1ee8a0 2023-08-25T04:43:50.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.987+0000 7fc5350bb700 1 -- 172.21.15.16:0/2512694102 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5301532c0 con 0x7fc530161b30 2023-08-25T04:43:50.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.987+0000 7fc5350bb700 1 -- 172.21.15.16:0/2512694102 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc530153880 con 0x7fc530161b30 2023-08-25T04:43:50.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.989+0000 7fc5350bb700 1 -- 172.21.15.16:0/2512694102 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc530153aa0 con 0x7fc530161b30 2023-08-25T04:43:50.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.988+0000 7f0a974e3700 1 -- start start 2023-08-25T04:43:50.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.989+0000 7f0a974e3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0a900c9310 0x7f0a900cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.989+0000 7f0a974e3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a9015a190 0x7f0a9006c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:50.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.989+0000 7f0a974e3700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9006c1e0 con 0x7f0a900c96f0 2023-08-25T04:43:50.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.989+0000 7f0a974e3700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9015a5c0 con 0x7f0a9015a190 2023-08-25T04:43:50.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.989+0000 7f0a974e3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9006b920 con 0x7f0a900c9310 2023-08-25T04:43:51.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.990+0000 7f0a94a7e700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0a900c96f0 0x7f0a90159a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39840/0 (socket says 172.21.15.16:39840) 2023-08-25T04:43:51.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.990+0000 7f0a94a7e700 1 -- 172.21.15.16:0/4193864830 learned_addr learned my addr 172.21.15.16:0/4193864830 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:51.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.990+0000 7f0a95a80700 1 --2- 172.21.15.16:0/4193864830 >> v2:172.21.15.16:3300/0 conn(0x7f0a9015a190 0x7f0a9006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.991+0000 7f0a95a80700 1 -- 172.21.15.16:0/4193864830 >> v2:172.21.15.117:3300/0 conn(0x7f0a900c9310 msgr2=0x7f0a900cc890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T04:43:51.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.991+0000 7f0a95a80700 1 --2- 172.21.15.16:0/4193864830 >> v2:172.21.15.117:3300/0 conn(0x7f0a900c9310 0x7f0a900cc890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.991+0000 7f0a95a80700 1 -- 172.21.15.16:0/4193864830 >> v1:172.21.15.16:6789/0 conn(0x7f0a900c96f0 legacy=0x7f0a90159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.991+0000 7f0a95a80700 1 -- 172.21.15.16:0/4193864830 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9006bb90 con 0x7f0a9015a190 2023-08-25T04:43:51.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.991+0000 7f0a95a80700 1 --2- 172.21.15.16:0/4193864830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a9015a190 0x7f0a9006c670 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0a9006b280 tx=0x7f0a88009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818d2848ae6d0ee3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.992+0000 7f33b081a700 1 --2- 172.21.15.16:0/365329605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac1ee8a0 0x7f33ac1eed20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0b1860 tx=0x7f339c00c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.992+0000 7fc5177fe700 1 -- 172.21.15.16:0/2512694102 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc528019070 con 0x7fc530161b30 2023-08-25T04:43:51.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.993+0000 7fc5177fe700 1 --2- 172.21.15.16:0/2512694102 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc51c06a1b0 0x7fc51c06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.993+0000 7fc5177fe700 1 -- 172.21.15.16:0/2512694102 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc528089800 con 0x7fc530161b30 2023-08-25T04:43:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.993+0000 7fc52ed9d700 1 --2- 172.21.15.16:0/2512694102 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc51c06a1b0 0x7fc51c06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.993+0000 7f6bc3582700 1 Processor -- start 2023-08-25T04:43:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.992+0000 7f33a8ff9700 1 -- 172.21.15.16:0/365329605 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c004a70 con 0x7f33ac1ee8a0 2023-08-25T04:43:51.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.992+0000 7f33a8ff9700 1 -- 172.21.15.16:0/365329605 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c004bd0 con 0x7f33ac1ee8a0 2023-08-25T04:43:51.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.992+0000 7f33a8ff9700 1 -- 172.21.15.16:0/365329605 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c007070 con 0x7f33ac1ee8a0 2023-08-25T04:43:51.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.992+0000 7f33b227d700 1 -- 172.21.15.16:0/365329605 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ac154d60 con 0x7f33ac1ee8a0 2023-08-25T04:43:51.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.992+0000 7f33b227d700 1 -- 172.21.15.16:0/365329605 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ac0b2d90 con 0x7f33ac1ee8a0 2023-08-25T04:43:51.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.993+0000 7f6bc3582700 1 -- start start 2023-08-25T04:43:51.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.993+0000 7f33b227d700 1 -- 172.21.15.16:0/365329605 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ac04ee70 con 0x7f33ac1ee8a0 2023-08-25T04:43:51.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.994+0000 7fc52ed9d700 1 --2- 172.21.15.16:0/2512694102 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc51c06a1b0 0x7fc51c06c670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc53016cfa0 tx=0x7fc520009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.994+0000 7f6bc3582700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6bbc15d3b0 0x7f6bbc161780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.994+0000 7f6bc3582700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bbc0ccfa0 0x7f6bbc0ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.994+0000 7f6bc3582700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bbc06c050 con 0x7f6bbc06c4e0 2023-08-25T04:43:51.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.994+0000 7f6bc3582700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc161cc0 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.994+0000 7f6bc3582700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc06d600 con 0x7f6bbc0ccfa0 2023-08-25T04:43:51.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.995+0000 7f6bc131e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6bbc15d3b0 0x7f6bbc161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.995+0000 7f6bc131e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6bbc15d3b0 0x7f6bbc161780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49430/0 (socket says 172.21.15.16:49430) 2023-08-25T04:43:51.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.995+0000 7f6bc131e700 1 -- 172.21.15.16:0/1696910668 learned_addr learned my addr 172.21.15.16:0/1696910668 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:51.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.995+0000 7f6bc131e700 1 -- 172.21.15.16:0/1696910668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bbc0ccfa0 msgr2=0x7f6bbc0ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:51.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.995+0000 7f6bc1b1f700 1 --2- 172.21.15.16:0/1696910668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bbc0ccfa0 0x7f6bbc0ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.995+0000 7f6bc131e700 1 --2- 172.21.15.16:0/1696910668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bbc0ccfa0 0x7f6bbc0ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.995+0000 7f6bc131e700 1 -- 172.21.15.16:0/1696910668 >> v1:172.21.15.16:6789/0 conn(0x7f6bbc06c4e0 legacy=0x7f6bbc0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:51.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.995+0000 7f6bc131e700 1 -- 172.21.15.16:0/1696910668 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc06ba00 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.995+0000 7f6bc1b1f700 1 --2- 172.21.15.16:0/1696910668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bbc0ccfa0 0x7f6bbc0ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:51.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.995+0000 7f33a8ff9700 1 -- 172.21.15.16:0/365329605 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f339c0073e0 con 0x7f33ac1ee8a0 2023-08-25T04:43:51.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.995+0000 7f6bc131e700 1 --2- 172.21.15.16:0/1696910668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bbc15d3b0 0x7f6bbc161780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80098f0 tx=0x7f6bb8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9537d8eab65f829 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.996+0000 7f33a8ff9700 1 --2- 172.21.15.16:0/365329605 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f339806a0e0 0x7f339806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.996+0000 7f33a8ff9700 1 -- 172.21.15.16:0/365329605 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f339c087e30 con 0x7f33ac1ee8a0 2023-08-25T04:43:51.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.996+0000 7f33abfff700 1 --2- 172.21.15.16:0/365329605 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f339806a0e0 0x7f339806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.996+0000 7f33abfff700 1 --2- 172.21.15.16:0/365329605 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f339806a0e0 0x7f339806c5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f33a4000f80 tx=0x7f33a4010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.997+0000 7f09d8c7a700 1 Processor -- start 2023-08-25T04:43:51.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.997+0000 7f09d8c7a700 1 -- start start 2023-08-25T04:43:51.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f09d8c7a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f09d415f730 0x7f09d4071910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f09d8c7a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d415fbb0 con 0x7f09d40cac10 2023-08-25T04:43:51.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f09d8c7a700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d406c3c0 con 0x7f09d415b120 2023-08-25T04:43:51.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f09d8c7a700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d406b880 con 0x7f09d415f730 2023-08-25T04:43:51.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f7302347700 1 Processor -- start 2023-08-25T04:43:51.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f09d1d9b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f09d415f730 0x7f09d4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f09d1d9b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f09d415f730 0x7f09d4071910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36770/0 (socket says 172.21.15.16:36770) 2023-08-25T04:43:51.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f09d1d9b700 1 -- 172.21.15.16:0/3923650383 learned_addr learned my addr 172.21.15.16:0/3923650383 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:51.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f7302347700 1 -- start start 2023-08-25T04:43:51.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f6bb3fff700 1 -- 172.21.15.16:0/1696910668 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8004230 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f6bb3fff700 1 -- 172.21.15.16:0/1696910668 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb8004390 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f6bb3fff700 1 -- 172.21.15.16:0/1696910668 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80036a0 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f09d1d9b700 1 -- 172.21.15.16:0/3923650383 >> v1:172.21.15.117:6789/0 conn(0x7f09d415b120 legacy=0x7f09d40b1af0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T04:43:51.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f09d1d9b700 1 -- 172.21.15.16:0/3923650383 >> v1:172.21.15.16:6789/0 conn(0x7f09d40cac10 legacy=0x7f09d406c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:51.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f09d1d9b700 1 -- 172.21.15.16:0/3923650383 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d415b500 con 0x7f09d415f730 2023-08-25T04:43:51.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7fc5177fe700 1 -- 172.21.15.16:0/2512694102 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc5280589f0 con 0x7fc530161b30 2023-08-25T04:43:51.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f09d1d9b700 1 --2- 172.21.15.16:0/3923650383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09d415f730 0x7f09d4071910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f09c80098f0 tx=0x7f09c8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74b741a383926a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f09d159a700 1 -- 172.21.15.16:0/3923650383 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8004230 con 0x7f09d415f730 2023-08-25T04:43:51.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f09d159a700 1 -- 172.21.15.16:0/3923650383 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c8004390 con 0x7f09d415f730 2023-08-25T04:43:51.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f09d159a700 1 -- 172.21.15.16:0/3923650383 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c80036a0 con 0x7f09d415f730 2023-08-25T04:43:51.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f6bc3582700 1 -- 172.21.15.16:0/1696910668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bbc15d3b0 msgr2=0x7f6bbc161780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f6bc3582700 1 --2- 172.21.15.16:0/1696910668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bbc15d3b0 0x7f6bbc161780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80098f0 tx=0x7f6bb8009c00 comp rx=0 tx=0).stop 2023-08-25T04:43:51.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f0a87fff700 1 -- 172.21.15.16:0/4193864830 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8800ca80 con 0x7f0a9015a190 2023-08-25T04:43:51.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f0a87fff700 1 -- 172.21.15.16:0/4193864830 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8800cbe0 con 0x7f0a9015a190 2023-08-25T04:43:51.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.998+0000 7f0a87fff700 1 -- 172.21.15.16:0/4193864830 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88011400 con 0x7f0a9015a190 2023-08-25T04:43:51.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f0a974e3700 1 -- 172.21.15.16:0/4193864830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a9015a190 msgr2=0x7f0a9006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f0a974e3700 1 --2- 172.21.15.16:0/4193864830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a9015a190 0x7f0a9006c670 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0a9006b280 tx=0x7f0a88009f60 comp rx=0 tx=0).stop 2023-08-25T04:43:51.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f6bc3582700 1 -- 172.21.15.16:0/1696910668 shutdown_connections 2023-08-25T04:43:51.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f6bc3582700 1 --2- 172.21.15.16:0/1696910668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bbc15d3b0 0x7f6bbc161780 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f6bc3582700 1 --2- 172.21.15.16:0/1696910668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bbc0ccfa0 0x7f6bbc0ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f6bc3582700 1 -- 172.21.15.16:0/1696910668 >> 172.21.15.16:0/1696910668 conn(0x7f6bbc0cecc0 msgr2=0x7f6bbc0cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f0a974e3700 1 -- 172.21.15.16:0/4193864830 shutdown_connections 2023-08-25T04:43:51.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f0a974e3700 1 --2- 172.21.15.16:0/4193864830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a9015a190 0x7f0a9006c670 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f0a974e3700 1 --2- 172.21.15.16:0/4193864830 >> v2:172.21.15.117:3300/0 conn(0x7f0a900c9310 0x7f0a900cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f0a974e3700 1 -- 172.21.15.16:0/4193864830 >> 172.21.15.16:0/4193864830 conn(0x7f0a900cecc0 msgr2=0x7f0a900cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f6bc3582700 1 -- 172.21.15.16:0/1696910668 shutdown_connections 2023-08-25T04:43:51.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f7302347700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc0c2220 0x7f72fc15e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f7302347700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f72fc1651b0 0x7f72fc165640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f7302347700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc0c2600 con 0x7f72fc0caf60 2023-08-25T04:43:51.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f7302347700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72fc06c890 con 0x7f72fc1651b0 2023-08-25T04:43:51.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:50.999+0000 7f7302347700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0cd8e0 con 0x7f72fc0c2220 2023-08-25T04:43:51.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f6bc3582700 1 -- 172.21.15.16:0/1696910668 wait complete. 2023-08-25T04:43:51.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f0a974e3700 1 -- 172.21.15.16:0/4193864830 shutdown_connections 2023-08-25T04:43:51.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f0a974e3700 1 -- 172.21.15.16:0/4193864830 wait complete. 2023-08-25T04:43:51.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f09d8c7a700 1 -- 172.21.15.16:0/3923650383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09d415f730 msgr2=0x7f09d4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f09d8c7a700 1 --2- 172.21.15.16:0/3923650383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09d415f730 0x7f09d4071910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f09c80098f0 tx=0x7f09c8009c00 comp rx=0 tx=0).stop 2023-08-25T04:43:51.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f73008e4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f72fc1651b0 0x7f72fc165640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f73008e4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f72fc1651b0 0x7f72fc165640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36776/0 (socket says 172.21.15.16:36776) 2023-08-25T04:43:51.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f73008e4700 1 -- 172.21.15.16:0/1948455681 learned_addr learned my addr 172.21.15.16:0/1948455681 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:51.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f72fbfff700 1 --2- 172.21.15.16:0/1948455681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc0c2220 0x7f72fc15e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f09d8c7a700 1 -- 172.21.15.16:0/3923650383 shutdown_connections 2023-08-25T04:43:51.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f09d8c7a700 1 --2- 172.21.15.16:0/3923650383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09d415f730 0x7f09d4071910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f09d8c7a700 1 -- 172.21.15.16:0/3923650383 >> 172.21.15.16:0/3923650383 conn(0x7f09d40cecc0 msgr2=0x7f09d40cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f73008e4700 1 -- 172.21.15.16:0/1948455681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc0c2220 msgr2=0x7f72fc15e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:51.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f73008e4700 1 --2- 172.21.15.16:0/1948455681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc0c2220 0x7f72fc15e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f73008e4700 1 -- 172.21.15.16:0/1948455681 >> v1:172.21.15.117:6789/0 conn(0x7f72fc0caf60 legacy=0x7f72fc15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:51.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.000+0000 7f73008e4700 1 -- 172.21.15.16:0/1948455681 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc0c9440 con 0x7f72fc1651b0 2023-08-25T04:43:51.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.001+0000 7f33a8ff9700 1 -- 172.21.15.16:0/365329605 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f339c053600 con 0x7f33ac1ee8a0 2023-08-25T04:43:51.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.001+0000 7f73008e4700 1 --2- 172.21.15.16:0/1948455681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc1651b0 0x7f72fc165640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009e50 tx=0x7f72f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7e80492236bf98 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.001+0000 7f09d8c7a700 1 -- 172.21.15.16:0/3923650383 shutdown_connections 2023-08-25T04:43:51.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.001+0000 7f09d8c7a700 1 -- 172.21.15.16:0/3923650383 wait complete. 2023-08-25T04:43:51.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.002+0000 7f6bc3582700 1 Processor -- start 2023-08-25T04:43:51.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.002+0000 7f72faffd700 1 -- 172.21.15.16:0/1948455681 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f400e070 con 0x7f72fc1651b0 2023-08-25T04:43:51.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.002+0000 7f72faffd700 1 -- 172.21.15.16:0/1948455681 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f4003a20 con 0x7f72fc1651b0 2023-08-25T04:43:51.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.002+0000 7f72faffd700 1 -- 172.21.15.16:0/1948455681 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4003dd0 con 0x7f72fc1651b0 2023-08-25T04:43:51.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.002+0000 7f0a974e3700 1 Processor -- start 2023-08-25T04:43:51.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f7302347700 1 -- 172.21.15.16:0/1948455681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc1651b0 msgr2=0x7f72fc165640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f7302347700 1 --2- 172.21.15.16:0/1948455681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc1651b0 0x7f72fc165640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009e50 tx=0x7f72f400b330 comp rx=0 tx=0).stop 2023-08-25T04:43:51.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f7302347700 1 -- 172.21.15.16:0/1948455681 shutdown_connections 2023-08-25T04:43:51.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f7302347700 1 --2- 172.21.15.16:0/1948455681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc1651b0 0x7f72fc165640 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f7302347700 1 --2- 172.21.15.16:0/1948455681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc0c2220 0x7f72fc15e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f7302347700 1 -- 172.21.15.16:0/1948455681 >> 172.21.15.16:0/1948455681 conn(0x7f72fc0cecc0 msgr2=0x7f72fc0cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f09d8c7a700 1 Processor -- start 2023-08-25T04:43:51.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.002+0000 7f6bc3582700 1 -- start start 2023-08-25T04:43:51.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f6bc3582700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bbc06c4e0 0x7f6bbc157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f6bc3582700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bbc0ccfa0 0x7f6bbc0c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f6bc3582700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bbc15d3b0 0x7f6bbc0c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f6bc3582700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0afd60 con 0x7f6bbc06c4e0 2023-08-25T04:43:51.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f6bc3582700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0af340 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f6bc3582700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc157ab0 con 0x7f6bbc0ccfa0 2023-08-25T04:43:51.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f6bc1b1f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bbc15d3b0 0x7f6bbc0c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f6bc1b1f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bbc15d3b0 0x7f6bbc0c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36784/0 (socket says 172.21.15.16:36784) 2023-08-25T04:43:51.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f6bc1b1f700 1 -- 172.21.15.16:0/3214132614 learned_addr learned my addr 172.21.15.16:0/3214132614 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:51.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f6bc0b1d700 1 --2- 172.21.15.16:0/3214132614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bbc0ccfa0 0x7f6bbc0c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f6bc131e700 1 --2- 172.21.15.16:0/3214132614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bbc06c4e0 0x7f6bbc157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f6bc1b1f700 1 -- 172.21.15.16:0/3214132614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bbc0ccfa0 msgr2=0x7f6bbc0c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f6bc1b1f700 1 --2- 172.21.15.16:0/3214132614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bbc0ccfa0 0x7f6bbc0c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f6bc1b1f700 1 -- 172.21.15.16:0/3214132614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bbc06c4e0 msgr2=0x7f6bbc157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f6bc1b1f700 1 --2- 172.21.15.16:0/3214132614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bbc06c4e0 0x7f6bbc157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f6bc1b1f700 1 -- 172.21.15.16:0/3214132614 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8009550 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f6bc1b1f700 1 --2- 172.21.15.16:0/3214132614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bbc15d3b0 0x7f6bbc0c9850 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400cf20 tx=0x7f6bb4007f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f0a974e3700 1 -- start start 2023-08-25T04:43:51.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f0a974e3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a900c9310 0x7f0a901f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f0a974e3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a900c96f0 0x7f0a900b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f0a974e3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a9015a190 0x7f0a90071480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f0a974e3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a90157f40 con 0x7f0a900c9310 2023-08-25T04:43:51.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f0a974e3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900c1d00 con 0x7f0a9015a190 2023-08-25T04:43:51.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f0a974e3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900b42d0 con 0x7f0a900c96f0 2023-08-25T04:43:51.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f0a9527f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a900c9310 0x7f0a901f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f0a9527f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a900c9310 0x7f0a901f68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49456/0 (socket says 172.21.15.16:49456) 2023-08-25T04:43:51.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f0a9527f700 1 -- 172.21.15.16:0/1676086119 learned_addr learned my addr 172.21.15.16:0/1676086119 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:51.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f0a95a80700 1 --2- 172.21.15.16:0/1676086119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a9015a190 0x7f0a90071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f0a94a7e700 1 --2- 172.21.15.16:0/1676086119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a900c96f0 0x7f0a900b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f6bb1ffb700 1 -- 172.21.15.16:0/3214132614 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400ade0 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.005+0000 7f6bb1ffb700 1 -- 172.21.15.16:0/3214132614 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb4015440 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.005+0000 7f6bb1ffb700 1 -- 172.21.15.16:0/3214132614 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb40157f0 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.005+0000 7f0a9527f700 1 -- 172.21.15.16:0/1676086119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a900c96f0 msgr2=0x7f0a900b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.005+0000 7f0a9527f700 1 --2- 172.21.15.16:0/1676086119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a900c96f0 0x7f0a900b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.005+0000 7f0a9527f700 1 -- 172.21.15.16:0/1676086119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a9015a190 msgr2=0x7f0a90071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.005+0000 7f0a9527f700 1 --2- 172.21.15.16:0/1676086119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a9015a190 0x7f0a90071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.005+0000 7f0a9527f700 1 -- 172.21.15.16:0/1676086119 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8800d040 con 0x7f0a900c9310 2023-08-25T04:43:51.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.005+0000 7f6bc3582700 1 -- 172.21.15.16:0/3214132614 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc0af6e0 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.005+0000 7f6bc3582700 1 -- 172.21.15.16:0/3214132614 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc0af980 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.005+0000 7f0a9527f700 1 --2- 172.21.15.16:0/1676086119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a900c9310 0x7f0a901f68a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00b550 tx=0x7f0a8c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.003+0000 7f09d8c7a700 1 -- start start 2023-08-25T04:43:51.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f09d8c7a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d40cac10 0x7f09d40b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f09d8c7a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09d415b120 0x7f09d4151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f09d8c7a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09d415f730 0x7f09d40aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f09d8c7a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d415e260 con 0x7f09d40cac10 2023-08-25T04:43:51.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f09d8c7a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d40b4aa0 con 0x7f09d415f730 2023-08-25T04:43:51.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.004+0000 7f09d8c7a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d415cb60 con 0x7f09d415b120 2023-08-25T04:43:51.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.005+0000 7f09d2d9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09d415f730 0x7f09d40aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.005+0000 7f09d2d9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09d415f730 0x7f09d40aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:36792/0 (socket says 172.21.15.16:36792) 2023-08-25T04:43:51.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.005+0000 7f09d2d9d700 1 -- 172.21.15.16:0/1124869074 learned_addr learned my addr 172.21.15.16:0/1124869074 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:51.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.006+0000 7f09d1d9b700 1 --2- 172.21.15.16:0/1124869074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09d415b120 0x7f09d4151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.006+0000 7f09d2d9d700 1 -- 172.21.15.16:0/1124869074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09d415b120 msgr2=0x7f09d4151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.006+0000 7f09d2d9d700 1 --2- 172.21.15.16:0/1124869074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09d415b120 0x7f09d4151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.006+0000 7f09d2d9d700 1 -- 172.21.15.16:0/1124869074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d40cac10 msgr2=0x7f09d40b4560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:43:51.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.006+0000 7f09d2d9d700 1 --2- 172.21.15.16:0/1124869074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d40cac10 0x7f09d40b4560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.006+0000 7f09d2d9d700 1 -- 172.21.15.16:0/1124869074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c8009550 con 0x7f09d415f730 2023-08-25T04:43:51.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.006+0000 7f09d2d9d700 1 --2- 172.21.15.16:0/1124869074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09d415f730 0x7f09d40aeae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09c400c490 tx=0x7f09c4001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.007+0000 7f6bb1ffb700 1 -- 172.21.15.16:0/3214132614 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6bb400d430 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.006+0000 7f0a85ffb700 1 -- 172.21.15.16:0/1676086119 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c011830 con 0x7f0a900c9310 2023-08-25T04:43:51.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.006+0000 7f0a85ffb700 1 -- 172.21.15.16:0/1676086119 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c0119b0 con 0x7f0a900c9310 2023-08-25T04:43:51.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.006+0000 7f0a85ffb700 1 -- 172.21.15.16:0/1676086119 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c011d60 con 0x7f0a900c9310 2023-08-25T04:43:51.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.006+0000 7f0a974e3700 1 -- 172.21.15.16:0/1676086119 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a900b45b0 con 0x7f0a900c9310 2023-08-25T04:43:51.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.007+0000 7f0a974e3700 1 -- 172.21.15.16:0/1676086119 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a901f6de0 con 0x7f0a900c9310 2023-08-25T04:43:51.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.006+0000 7f09c2ffd700 1 -- 172.21.15.16:0/1124869074 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c40054e0 con 0x7f09d415f730 2023-08-25T04:43:51.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.006+0000 7f09c2ffd700 1 -- 172.21.15.16:0/1124869074 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c4003680 con 0x7f09d415f730 2023-08-25T04:43:51.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.006+0000 7f09c2ffd700 1 -- 172.21.15.16:0/1124869074 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c4003a30 con 0x7f09d415f730 2023-08-25T04:43:51.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.008+0000 7f6bb1ffb700 1 --2- 172.21.15.16:0/3214132614 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6ba006a1b0 0x7f6ba006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.008+0000 7f6bc3582700 1 -- 172.21.15.16:0/3214132614 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc0afea0 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.008+0000 7f6bb1ffb700 1 -- 172.21.15.16:0/3214132614 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6bb4088b40 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.009+0000 7f7302347700 1 -- 172.21.15.16:0/1948455681 shutdown_connections 2023-08-25T04:43:51.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.009+0000 7f6bc131e700 1 --2- 172.21.15.16:0/3214132614 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6ba006a1b0 0x7f6ba006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.007+0000 7f09d8c7a700 1 -- 172.21.15.16:0/1124869074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d415ce40 con 0x7f09d415f730 2023-08-25T04:43:51.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.008+0000 7f09d8c7a700 1 -- 172.21.15.16:0/1124869074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d415d400 con 0x7f09d415f730 2023-08-25T04:43:51.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.009+0000 7f09d8c7a700 1 -- 172.21.15.16:0/1124869074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d40cb5b0 con 0x7f09d415f730 2023-08-25T04:43:51.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.009+0000 7f0a85ffb700 1 -- 172.21.15.16:0/1676086119 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0a8c01a400 con 0x7f0a900c9310 2023-08-25T04:43:51.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.009+0000 7f0a974e3700 1 -- 172.21.15.16:0/1676086119 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a90157a30 con 0x7f0a900c9310 2023-08-25T04:43:51.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.009+0000 7f6bc131e700 1 --2- 172.21.15.16:0/3214132614 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6ba006a1b0 0x7f6ba006c670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8000c00 tx=0x7f6bb8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.009+0000 7f0a85ffb700 1 --2- 172.21.15.16:0/1676086119 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0a7406a130 0x7f0a7406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.010+0000 7f0a85ffb700 1 -- 172.21.15.16:0/1676086119 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a8c0883a0 con 0x7f0a900c9310 2023-08-25T04:43:51.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.010+0000 7f7302347700 1 -- 172.21.15.16:0/1948455681 wait complete. 2023-08-25T04:43:51.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.010+0000 7f0a94a7e700 1 --2- 172.21.15.16:0/1676086119 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0a7406a130 0x7f0a7406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.011+0000 7f0a94a7e700 1 --2- 172.21.15.16:0/1676086119 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0a7406a130 0x7f0a7406c5f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a90155440 tx=0x7f0a80005fa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.012+0000 7f7302347700 1 Processor -- start 2023-08-25T04:43:51.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.013+0000 7f6bb1ffb700 1 -- 172.21.15.16:0/3214132614 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6bbc0afea0 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.014+0000 7f09c2ffd700 1 -- 172.21.15.16:0/1124869074 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f09c4003b90 con 0x7f09d415f730 2023-08-25T04:43:51.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.015+0000 7f09c2ffd700 1 --2- 172.21.15.16:0/1124869074 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f09b406a130 0x7f09b406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.015+0000 7f09c2ffd700 1 -- 172.21.15.16:0/1124869074 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09c4087dc0 con 0x7f09d415f730 2023-08-25T04:43:51.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.012+0000 7f7302347700 1 -- start start 2023-08-25T04:43:51.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.013+0000 7f7302347700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc0c2220 0x7f72fc0c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.013+0000 7f7302347700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72fc1651b0 0x7f72fc0c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.013+0000 7f7302347700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc14cac0 0x7f72fc1fa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.013+0000 7f7302347700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc14d060 con 0x7f72fc1651b0 2023-08-25T04:43:51.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.013+0000 7f7302347700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0c9100 con 0x7f72fc0c2220 2023-08-25T04:43:51.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.013+0000 7f7302347700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0b2da0 con 0x7f72fc14cac0 2023-08-25T04:43:51.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.014+0000 7f73008e4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc14cac0 0x7f72fc1fa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.014+0000 7f73008e4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc14cac0 0x7f72fc1fa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:50016/0 (socket says 172.21.15.16:50016) 2023-08-25T04:43:51.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.014+0000 7f73008e4700 1 -- 172.21.15.16:0/2246854957 learned_addr learned my addr 172.21.15.16:0/2246854957 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:51.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.014+0000 7f72fbfff700 1 --2- 172.21.15.16:0/2246854957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc0c2220 0x7f72fc0c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.014+0000 7f72fb7fe700 1 --2- 172.21.15.16:0/2246854957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72fc1651b0 0x7f72fc0c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.015+0000 7f72fb7fe700 1 -- 172.21.15.16:0/2246854957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc14cac0 msgr2=0x7f72fc1fa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.015+0000 7f72fb7fe700 1 --2- 172.21.15.16:0/2246854957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc14cac0 0x7f72fc1fa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.015+0000 7f72fb7fe700 1 -- 172.21.15.16:0/2246854957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc0c2220 msgr2=0x7f72fc0c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.015+0000 7f72fb7fe700 1 --2- 172.21.15.16:0/2246854957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc0c2220 0x7f72fc0c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.015+0000 7f72fb7fe700 1 -- 172.21.15.16:0/2246854957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4009b30 con 0x7f72fc1651b0 2023-08-25T04:43:51.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.015+0000 7f72fb7fe700 1 --2- 172.21.15.16:0/2246854957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72fc1651b0 0x7f72fc0c5f80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0ce6c0 tx=0x7f72f000c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.018+0000 7f09d259c700 1 --2- 172.21.15.16:0/1124869074 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f09b406a130 0x7f09b406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.018+0000 7f09c2ffd700 1 -- 172.21.15.16:0/1124869074 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f09c4053620 con 0x7f09d415f730 2023-08-25T04:43:51.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.018+0000 7f09d259c700 1 --2- 172.21.15.16:0/1124869074 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f09b406a130 0x7f09b406c5f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00abb0 tx=0x7f09cc009250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.019+0000 7f0a85ffb700 1 -- 172.21.15.16:0/1676086119 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0a90157a30 con 0x7f0a900c9310 2023-08-25T04:43:51.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.019+0000 7f72f8ff9700 1 -- 172.21.15.16:0/2246854957 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000ce60 con 0x7f72fc1651b0 2023-08-25T04:43:51.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.019+0000 7f72f8ff9700 1 -- 172.21.15.16:0/2246854957 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f00335a0 con 0x7f72fc1651b0 2023-08-25T04:43:51.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.019+0000 7f7302347700 1 -- 172.21.15.16:0/2246854957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc0c8b40 con 0x7f72fc1651b0 2023-08-25T04:43:51.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.019+0000 7f72f8ff9700 1 -- 172.21.15.16:0/2246854957 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0033930 con 0x7f72fc1651b0 2023-08-25T04:43:51.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.019+0000 7f7302347700 1 -- 172.21.15.16:0/2246854957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc0b2a30 con 0x7f72fc1651b0 2023-08-25T04:43:51.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.020+0000 7f7302347700 1 -- 172.21.15.16:0/2246854957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc0b2f10 con 0x7f72fc1651b0 2023-08-25T04:43:51.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.022+0000 7f72f8ff9700 1 -- 172.21.15.16:0/2246854957 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f72f0033a90 con 0x7f72fc1651b0 2023-08-25T04:43:51.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.022+0000 7f72f8ff9700 1 --2- 172.21.15.16:0/2246854957 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f72e806a0e0 0x7f72e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.023+0000 7f72f8ff9700 1 -- 172.21.15.16:0/2246854957 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f72f00aaab0 con 0x7f72fc1651b0 2023-08-25T04:43:51.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.023+0000 7f72fbfff700 1 --2- 172.21.15.16:0/2246854957 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f72e806a0e0 0x7f72e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.023+0000 7f72fbfff700 1 --2- 172.21.15.16:0/2246854957 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f72e806a0e0 0x7f72e806c5a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009b40 tx=0x7f72ec009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.029+0000 7f72f8ff9700 1 -- 172.21.15.16:0/2246854957 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f72f0076210 con 0x7f72fc1651b0 2023-08-25T04:43:51.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.051+0000 7fbf4c7d4700 1 Processor -- start 2023-08-25T04:43:51.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.051+0000 7fbf4c7d4700 1 -- start start 2023-08-25T04:43:51.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.053+0000 7fbf4c7d4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf440cc890 0x7fbf44159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.053+0000 7fbf4c7d4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbf44159fc0 0x7fbf4406c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.053+0000 7fbf4c7d4700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4406c1e0 con 0x7fbf440c9310 2023-08-25T04:43:51.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.053+0000 7fbf4c7d4700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4406b920 con 0x7fbf44159fc0 2023-08-25T04:43:51.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.053+0000 7fbf4c7d4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4406bb90 con 0x7fbf440cc890 2023-08-25T04:43:51.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.054+0000 7fbf4a570700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fbf440c9310 0x7fbf440c96f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39896/0 (socket says 172.21.15.16:39896) 2023-08-25T04:43:51.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.054+0000 7fbf4ad71700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbf44159fc0 0x7fbf4406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.054+0000 7fbf4a570700 1 -- 172.21.15.16:0/2277487550 learned_addr learned my addr 172.21.15.16:0/2277487550 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:51.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.054+0000 7fbf49d6f700 1 --2- 172.21.15.16:0/2277487550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf440cc890 0x7fbf44159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.054+0000 7fbf4ad71700 1 -- 172.21.15.16:0/2277487550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf440cc890 msgr2=0x7fbf44159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:51.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.054+0000 7fbf4ad71700 1 --2- 172.21.15.16:0/2277487550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf440cc890 0x7fbf44159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.054+0000 7fbf4ad71700 1 -- 172.21.15.16:0/2277487550 >> v1:172.21.15.16:6789/0 conn(0x7fbf440c9310 legacy=0x7fbf440c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.054+0000 7fbf4ad71700 1 -- 172.21.15.16:0/2277487550 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4406be70 con 0x7fbf44159fc0 2023-08-25T04:43:51.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.055+0000 7fbf4ad71700 1 --2- 172.21.15.16:0/2277487550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf44159fc0 0x7fbf4406c670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c006600 tx=0x7fbf3c007ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a4519f1f440b28d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.056+0000 7fbf4956e700 1 -- 172.21.15.16:0/2277487550 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c00ece0 con 0x7fbf44159fc0 2023-08-25T04:43:51.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.056+0000 7fbf4956e700 1 -- 172.21.15.16:0/2277487550 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c00ee40 con 0x7fbf44159fc0 2023-08-25T04:43:51.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.056+0000 7fbf4956e700 1 -- 172.21.15.16:0/2277487550 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c003c60 con 0x7fbf44159fc0 2023-08-25T04:43:51.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.057+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/2277487550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf44159fc0 msgr2=0x7fbf4406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.057+0000 7fbf4c7d4700 1 --2- 172.21.15.16:0/2277487550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf44159fc0 0x7fbf4406c670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c006600 tx=0x7fbf3c007ef0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.057+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/2277487550 shutdown_connections 2023-08-25T04:43:51.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.057+0000 7fbf4c7d4700 1 --2- 172.21.15.16:0/2277487550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf44159fc0 0x7fbf4406c670 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.057+0000 7fbf4c7d4700 1 --2- 172.21.15.16:0/2277487550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf440cc890 0x7fbf44159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.057+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/2277487550 >> 172.21.15.16:0/2277487550 conn(0x7fbf440cecc0 msgr2=0x7fbf440cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.058+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/2277487550 shutdown_connections 2023-08-25T04:43:51.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.058+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/2277487550 wait complete. 2023-08-25T04:43:51.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.060+0000 7fbf4c7d4700 1 Processor -- start 2023-08-25T04:43:51.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.060+0000 7fbf4c7d4700 1 -- start start 2023-08-25T04:43:51.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.061+0000 7fbf4c7d4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf440c9310 0x7fbf4415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.061+0000 7fbf4c7d4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf440cc890 0x7fbf44154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.061+0000 7fbf4c7d4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf44159fc0 0x7fbf44154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.061+0000 7fbf4c7d4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf441f7d40 con 0x7fbf440cc890 2023-08-25T04:43:51.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.061+0000 7fbf4c7d4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4415d150 con 0x7fbf44159fc0 2023-08-25T04:43:51.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.061+0000 7fbf4c7d4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf441f7410 con 0x7fbf440c9310 2023-08-25T04:43:51.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.062+0000 7fbf49d6f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf440cc890 0x7fbf44154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.062+0000 7fbf49d6f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf440cc890 0x7fbf44154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49488/0 (socket says 172.21.15.16:49488) 2023-08-25T04:43:51.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.062+0000 7fbf49d6f700 1 -- 172.21.15.16:0/1077427345 learned_addr learned my addr 172.21.15.16:0/1077427345 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:51.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.062+0000 7fbf49d6f700 1 -- 172.21.15.16:0/1077427345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf440c9310 msgr2=0x7fbf4415cc10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:43:51.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.062+0000 7fbf49d6f700 1 --2- 172.21.15.16:0/1077427345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf440c9310 0x7fbf4415cc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.062+0000 7fbf49d6f700 1 -- 172.21.15.16:0/1077427345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf44159fc0 msgr2=0x7fbf44154640 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:43:51.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.062+0000 7fbf49d6f700 1 --2- 172.21.15.16:0/1077427345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf44159fc0 0x7fbf44154640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.062+0000 7fbf49d6f700 1 -- 172.21.15.16:0/1077427345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c007870 con 0x7fbf440cc890 2023-08-25T04:43:51.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.063+0000 7fbf49d6f700 1 --2- 172.21.15.16:0/1077427345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf440cc890 0x7fbf44154100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400d800 tx=0x7fbf3400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.064+0000 7fbf3affd700 1 -- 172.21.15.16:0/1077427345 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34012630 con 0x7fbf440cc890 2023-08-25T04:43:51.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.064+0000 7fbf3affd700 1 -- 172.21.15.16:0/1077427345 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf34012790 con 0x7fbf440cc890 2023-08-25T04:43:51.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.064+0000 7fbf3affd700 1 -- 172.21.15.16:0/1077427345 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34012b20 con 0x7fbf440cc890 2023-08-25T04:43:51.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.064+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/1077427345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf441f76f0 con 0x7fbf440cc890 2023-08-25T04:43:51.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.064+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/1077427345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf441f70e0 con 0x7fbf440cc890 2023-08-25T04:43:51.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.069+0000 7fbf3affd700 1 -- 172.21.15.16:0/1077427345 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbf34012c80 con 0x7fbf440cc890 2023-08-25T04:43:51.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.070+0000 7fbf3affd700 1 --2- 172.21.15.16:0/1077427345 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fbf3006a370 0x7fbf3006c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.070+0000 7fbf3affd700 1 -- 172.21.15.16:0/1077427345 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf34088770 con 0x7fbf440cc890 2023-08-25T04:43:51.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.071+0000 7fbf4a570700 1 --2- 172.21.15.16:0/1077427345 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fbf3006a370 0x7fbf3006c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.072+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/1077427345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2c0052f0 con 0x7fbf440cc890 2023-08-25T04:43:51.082 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.081+0000 7fbf3affd700 1 -- 172.21.15.16:0/1077427345 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbf34053e40 con 0x7fbf440cc890 2023-08-25T04:43:51.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.090+0000 7fbf4a570700 1 --2- 172.21.15.16:0/1077427345 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fbf3006a370 0x7fbf3006c830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbf40000f60 tx=0x7fbf40007b10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.405+0000 7fd4af11e700 1 -- 172.21.15.16:0/3588325639 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd4880055a0 con 0x7fd4a8159fc0 2023-08-25T04:43:51.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.405+0000 7fc5350bb700 1 -- 172.21.15.16:0/2512694102 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc530153120 con 0x7fc530161b30 2023-08-25T04:43:51.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.406+0000 7fc5177fe700 1 -- 172.21.15.16:0/2512694102 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc528017020 con 0x7fc530161b30 2023-08-25T04:43:51.408 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-08-25T04:43:51.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.407+0000 7fd4a57fa700 1 -- 172.21.15.16:0/3588325639 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd498056e60 con 0x7fd4a8159fc0 2023-08-25T04:43:51.410 INFO:teuthology.orchestra.run.smithi016.stdout:55834574856 2023-08-25T04:43:51.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.409+0000 7fc5350bb700 1 -- 172.21.15.16:0/2512694102 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc51c06a1b0 msgr2=0x7fc51c06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.409+0000 7fc5350bb700 1 --2- 172.21.15.16:0/2512694102 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc51c06a1b0 0x7fc51c06c670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc53016cfa0 tx=0x7fc520009190 comp rx=0 tx=0).stop 2023-08-25T04:43:51.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.409+0000 7fc5350bb700 1 -- 172.21.15.16:0/2512694102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc530161b30 msgr2=0x7fc5300c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.409+0000 7fc5350bb700 1 --2- 172.21.15.16:0/2512694102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc530161b30 0x7fc5300c91d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc528014000 tx=0x7fc528004ad0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.410+0000 7fc5350bb700 1 -- 172.21.15.16:0/2512694102 shutdown_connections 2023-08-25T04:43:51.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.410+0000 7fc5350bb700 1 --2- 172.21.15.16:0/2512694102 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc51c06a1b0 0x7fc51c06c670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.410+0000 7fc5350bb700 1 --2- 172.21.15.16:0/2512694102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc530161b30 0x7fc5300c91d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.410+0000 7fc5350bb700 1 --2- 172.21.15.16:0/2512694102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc53006fdb0 0x7fc530152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.410+0000 7fc5350bb700 1 --2- 172.21.15.16:0/2512694102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5300cc890 0x7fc5300b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.410+0000 7fc5350bb700 1 -- 172.21.15.16:0/2512694102 >> 172.21.15.16:0/2512694102 conn(0x7fc5300cecc0 msgr2=0x7fc5300b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.410+0000 7fd4af11e700 1 -- 172.21.15.16:0/3588325639 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd49406a1b0 msgr2=0x7fd49406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.410+0000 7fd4af11e700 1 --2- 172.21.15.16:0/3588325639 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd49406a1b0 0x7fd49406c670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd49c001660 tx=0x7fd49c007a40 comp rx=0 tx=0).stop 2023-08-25T04:43:51.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.410+0000 7fd4af11e700 1 -- 172.21.15.16:0/3588325639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a8159fc0 msgr2=0x7fd4a814c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.410+0000 7fd4af11e700 1 --2- 172.21.15.16:0/3588325639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a8159fc0 0x7fd4a814c970 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd49800a6f0 tx=0x7fd49800aab0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.410+0000 7fd4af11e700 1 -- 172.21.15.16:0/3588325639 shutdown_connections 2023-08-25T04:43:51.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.410+0000 7fd4af11e700 1 --2- 172.21.15.16:0/3588325639 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd49406a1b0 0x7fd49406c670 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.411+0000 7fd4af11e700 1 --2- 172.21.15.16:0/3588325639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a8159050 0x7fd4a815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.411+0000 7fd4af11e700 1 --2- 172.21.15.16:0/3588325639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a80c9310 0x7fd4a80b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.411+0000 7fd4af11e700 1 --2- 172.21.15.16:0/3588325639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a8159fc0 0x7fd4a814c970 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.411+0000 7fd4af11e700 1 -- 172.21.15.16:0/3588325639 >> 172.21.15.16:0/3588325639 conn(0x7fd4a80cecc0 msgr2=0x7fd4a806cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.411+0000 7fc5350bb700 1 -- 172.21.15.16:0/2512694102 shutdown_connections 2023-08-25T04:43:51.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.411+0000 7fc5350bb700 1 -- 172.21.15.16:0/2512694102 wait complete. 2023-08-25T04:43:51.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.411+0000 7fd4af11e700 1 -- 172.21.15.16:0/3588325639 shutdown_connections 2023-08-25T04:43:51.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.411+0000 7fd4af11e700 1 -- 172.21.15.16:0/3588325639 wait complete. 2023-08-25T04:43:51.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.419+0000 7f33b227d700 1 -- 172.21.15.16:0/365329605 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f33ac15bae0 con 0x7f33ac1ee8a0 2023-08-25T04:43:51.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.426+0000 7f6bc3582700 1 -- 172.21.15.16:0/3214132614 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6bbc0afea0 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.426+0000 7f33a8ff9700 1 -- 172.21.15.16:0/365329605 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f33ac15bae0 con 0x7f33ac1ee8a0 2023-08-25T04:43:51.428 INFO:teuthology.orchestra.run.smithi016.stdout:55834574856 2023-08-25T04:43:51.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.430+0000 7f6bb1ffb700 1 -- 172.21.15.16:0/3214132614 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bbc0afea0 con 0x7f6bbc15d3b0 2023-08-25T04:43:51.433 INFO:teuthology.orchestra.run.smithi016.stdout:55834574856 2023-08-25T04:43:51.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.430+0000 7f33b227d700 1 -- 172.21.15.16:0/365329605 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f339806a0e0 msgr2=0x7f339806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.430+0000 7f33b227d700 1 --2- 172.21.15.16:0/365329605 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f339806a0e0 0x7f339806c5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f33a4000f80 tx=0x7f33a4010000 comp rx=0 tx=0).stop 2023-08-25T04:43:51.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.430+0000 7f33b227d700 1 -- 172.21.15.16:0/365329605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac1ee8a0 msgr2=0x7f33ac1eed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.430+0000 7f33b227d700 1 --2- 172.21.15.16:0/365329605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac1ee8a0 0x7f33ac1eed20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0b1860 tx=0x7f339c00c720 comp rx=0 tx=0).stop 2023-08-25T04:43:51.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.431+0000 7f33b227d700 1 -- 172.21.15.16:0/365329605 shutdown_connections 2023-08-25T04:43:51.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.431+0000 7f33b227d700 1 --2- 172.21.15.16:0/365329605 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f339806a0e0 0x7f339806c5a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.431+0000 7f33b227d700 1 --2- 172.21.15.16:0/365329605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac1ee8a0 0x7f33ac1eed20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.431+0000 7f33b227d700 1 --2- 172.21.15.16:0/365329605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3394003ac0 0x7f33ac154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.431+0000 7f33b227d700 1 --2- 172.21.15.16:0/365329605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33ac15c1a0 0x7f33ac14f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.431+0000 7f33b227d700 1 -- 172.21.15.16:0/365329605 >> 172.21.15.16:0/365329605 conn(0x7f33ac0cecc0 msgr2=0x7f33ac06fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2023-08-25T04:43:51.435 DEBUG:teuthology.parallel:result is None 2023-08-25T04:43:51.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.6 2023-08-25T04:43:51.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.432+0000 7f33b227d700 1 -- 172.21.15.16:0/365329605 shutdown_connections 2023-08-25T04:43:51.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.432+0000 7f33b227d700 1 -- 172.21.15.16:0/365329605 wait complete. 2023-08-25T04:43:51.437 DEBUG:teuthology.parallel:result is None 2023-08-25T04:43:51.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.434+0000 7f6bc3582700 1 -- 172.21.15.16:0/3214132614 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6ba006a1b0 msgr2=0x7f6ba006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.434+0000 7f6bc3582700 1 --2- 172.21.15.16:0/3214132614 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6ba006a1b0 0x7f6ba006c670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8000c00 tx=0x7f6bb8008030 comp rx=0 tx=0).stop 2023-08-25T04:43:51.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.434+0000 7f6bc3582700 1 -- 172.21.15.16:0/3214132614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bbc15d3b0 msgr2=0x7f6bbc0c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.434+0000 7f6bc3582700 1 --2- 172.21.15.16:0/3214132614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bbc15d3b0 0x7f6bbc0c9850 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400cf20 tx=0x7f6bb4007f60 comp rx=0 tx=0).stop 2023-08-25T04:43:51.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.434+0000 7f6bc3582700 1 -- 172.21.15.16:0/3214132614 shutdown_connections 2023-08-25T04:43:51.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.434+0000 7f6bc3582700 1 --2- 172.21.15.16:0/3214132614 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6ba006a1b0 0x7f6ba006c670 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.434+0000 7f6bc3582700 1 --2- 172.21.15.16:0/3214132614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bbc15d3b0 0x7f6bbc0c9850 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.434+0000 7f6bc3582700 1 --2- 172.21.15.16:0/3214132614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bbc06c4e0 0x7f6bbc157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.434+0000 7f6bc3582700 1 --2- 172.21.15.16:0/3214132614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bbc0ccfa0 0x7f6bbc0c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.434+0000 7f6bc3582700 1 -- 172.21.15.16:0/3214132614 >> 172.21.15.16:0/3214132614 conn(0x7f6bbc0cecc0 msgr2=0x7f6bbc06fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.434+0000 7f0a974e3700 1 -- 172.21.15.16:0/1676086119 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0a90157a30 con 0x7f0a900c9310 2023-08-25T04:43:51.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.435+0000 7f0a85ffb700 1 -- 172.21.15.16:0/1676086119 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a90157a30 con 0x7f0a900c9310 2023-08-25T04:43:51.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.435+0000 7f6bc3582700 1 -- 172.21.15.16:0/3214132614 shutdown_connections 2023-08-25T04:43:51.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.435+0000 7f6bc3582700 1 -- 172.21.15.16:0/3214132614 wait complete. 2023-08-25T04:43:51.440 INFO:teuthology.orchestra.run.smithi016.stdout:55834574855 2023-08-25T04:43:51.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.438+0000 7f0a974e3700 1 -- 172.21.15.16:0/1676086119 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0a7406a130 msgr2=0x7f0a7406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.438+0000 7f0a974e3700 1 --2- 172.21.15.16:0/1676086119 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0a7406a130 0x7f0a7406c5f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a90155440 tx=0x7f0a80005fa0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.438+0000 7f0a974e3700 1 -- 172.21.15.16:0/1676086119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a900c9310 msgr2=0x7f0a901f68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.438+0000 7f0a974e3700 1 --2- 172.21.15.16:0/1676086119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a900c9310 0x7f0a901f68a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00b550 tx=0x7f0a8c00b860 comp rx=0 tx=0).stop 2023-08-25T04:43:51.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.438+0000 7f09d8c7a700 1 -- 172.21.15.16:0/1124869074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f09d404ee70 con 0x7f09d415f730 2023-08-25T04:43:51.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.439+0000 7f0a974e3700 1 -- 172.21.15.16:0/1676086119 shutdown_connections 2023-08-25T04:43:51.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.439+0000 7f0a974e3700 1 --2- 172.21.15.16:0/1676086119 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0a7406a130 0x7f0a7406c5f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.439+0000 7f0a974e3700 1 --2- 172.21.15.16:0/1676086119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a9015a190 0x7f0a90071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.439+0000 7f0a974e3700 1 --2- 172.21.15.16:0/1676086119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a900c9310 0x7f0a901f68a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.439+0000 7f0a974e3700 1 --2- 172.21.15.16:0/1676086119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a900c96f0 0x7f0a900b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.439+0000 7f0a974e3700 1 -- 172.21.15.16:0/1676086119 >> 172.21.15.16:0/1676086119 conn(0x7f0a900cecc0 msgr2=0x7f0a90155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.439+0000 7f0a974e3700 1 -- 172.21.15.16:0/1676086119 shutdown_connections 2023-08-25T04:43:51.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.439+0000 7f0a974e3700 1 -- 172.21.15.16:0/1676086119 wait complete. 2023-08-25T04:43:51.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.441+0000 7f09c2ffd700 1 -- 172.21.15.16:0/1124869074 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09c4017020 con 0x7f09d415f730 2023-08-25T04:43:51.444 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2023-08-25T04:43:51.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.446+0000 7f09d8c7a700 1 -- 172.21.15.16:0/1124869074 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f09b406a130 msgr2=0x7f09b406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.446+0000 7f09d8c7a700 1 --2- 172.21.15.16:0/1124869074 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f09b406a130 0x7f09b406c5f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00abb0 tx=0x7f09cc009250 comp rx=0 tx=0).stop 2023-08-25T04:43:51.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.446+0000 7f09d8c7a700 1 -- 172.21.15.16:0/1124869074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09d415f730 msgr2=0x7f09d40aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.446+0000 7f09d8c7a700 1 --2- 172.21.15.16:0/1124869074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09d415f730 0x7f09d40aeae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09c400c490 tx=0x7f09c4001e70 comp rx=0 tx=0).stop 2023-08-25T04:43:51.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.446+0000 7f09d8c7a700 1 -- 172.21.15.16:0/1124869074 shutdown_connections 2023-08-25T04:43:51.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.446+0000 7f09d8c7a700 1 --2- 172.21.15.16:0/1124869074 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f09b406a130 0x7f09b406c5f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.446+0000 7f09d8c7a700 1 --2- 172.21.15.16:0/1124869074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09d415f730 0x7f09d40aeae0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.446+0000 7f09d8c7a700 1 --2- 172.21.15.16:0/1124869074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d40cac10 0x7f09d40b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.446+0000 7f09d8c7a700 1 --2- 172.21.15.16:0/1124869074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09d415b120 0x7f09d4151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.446+0000 7f09d8c7a700 1 -- 172.21.15.16:0/1124869074 >> 172.21.15.16:0/1124869074 conn(0x7f09d40cecc0 msgr2=0x7f09d40cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.447+0000 7f09d8c7a700 1 -- 172.21.15.16:0/1124869074 shutdown_connections 2023-08-25T04:43:51.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.448+0000 7f09d8c7a700 1 -- 172.21.15.16:0/1124869074 wait complete. 2023-08-25T04:43:51.450 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-08-25T04:43:51.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.449+0000 7f7302347700 1 -- 172.21.15.16:0/2246854957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f72fc04ee70 con 0x7f72fc1651b0 2023-08-25T04:43:51.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.449+0000 7f72f8ff9700 1 -- 172.21.15.16:0/2246854957 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72f003b310 con 0x7f72fc1651b0 2023-08-25T04:43:51.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.452+0000 7f7302347700 1 -- 172.21.15.16:0/2246854957 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f72e806a0e0 msgr2=0x7f72e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.452+0000 7f7302347700 1 --2- 172.21.15.16:0/2246854957 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f72e806a0e0 0x7f72e806c5a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009b40 tx=0x7f72ec009210 comp rx=0 tx=0).stop 2023-08-25T04:43:51.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.452+0000 7f7302347700 1 -- 172.21.15.16:0/2246854957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72fc1651b0 msgr2=0x7f72fc0c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.452+0000 7f7302347700 1 --2- 172.21.15.16:0/2246854957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72fc1651b0 0x7f72fc0c5f80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0ce6c0 tx=0x7f72f000c6e0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.454+0000 7f7302347700 1 -- 172.21.15.16:0/2246854957 shutdown_connections 2023-08-25T04:43:51.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.454+0000 7f7302347700 1 --2- 172.21.15.16:0/2246854957 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f72e806a0e0 0x7f72e806c5a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.454+0000 7f7302347700 1 --2- 172.21.15.16:0/2246854957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc14cac0 0x7f72fc1fa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.454+0000 7f7302347700 1 --2- 172.21.15.16:0/2246854957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc0c2220 0x7f72fc0c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.454+0000 7f7302347700 1 --2- 172.21.15.16:0/2246854957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72fc1651b0 0x7f72fc0c5f80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.454+0000 7f7302347700 1 -- 172.21.15.16:0/2246854957 >> 172.21.15.16:0/2246854957 conn(0x7f72fc0cecc0 msgr2=0x7f72fc1645d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.5 2023-08-25T04:43:51.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.454+0000 7f7302347700 1 -- 172.21.15.16:0/2246854957 shutdown_connections 2023-08-25T04:43:51.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.454+0000 7f7302347700 1 -- 172.21.15.16:0/2246854957 wait complete. 2023-08-25T04:43:51.457 DEBUG:teuthology.parallel:result is None 2023-08-25T04:43:51.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2023-08-25T04:43:51.458 DEBUG:teuthology.parallel:result is None 2023-08-25T04:43:51.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.2 2023-08-25T04:43:51.459 DEBUG:teuthology.parallel:result is None 2023-08-25T04:43:51.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.0 2023-08-25T04:43:51.470 DEBUG:teuthology.parallel:result is None 2023-08-25T04:43:51.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.471+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/1077427345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbf2c0055a0 con 0x7fbf440cc890 2023-08-25T04:43:51.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2023-08-25T04:43:51.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.471+0000 7fbf3affd700 1 -- 172.21.15.16:0/1077427345 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf34057460 con 0x7fbf440cc890 2023-08-25T04:43:51.473 INFO:teuthology.orchestra.run.smithi016.stdout:55834574856 2023-08-25T04:43:51.473 DEBUG:teuthology.parallel:result is None 2023-08-25T04:43:51.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.473+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/1077427345 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fbf3006a370 msgr2=0x7fbf3006c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.473+0000 7fbf4c7d4700 1 --2- 172.21.15.16:0/1077427345 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fbf3006a370 0x7fbf3006c830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbf40000f60 tx=0x7fbf40007b10 comp rx=0 tx=0).stop 2023-08-25T04:43:51.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.473+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/1077427345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf440cc890 msgr2=0x7fbf44154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.473+0000 7fbf4c7d4700 1 --2- 172.21.15.16:0/1077427345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf440cc890 0x7fbf44154100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400d800 tx=0x7fbf3400dbc0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.473+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/1077427345 shutdown_connections 2023-08-25T04:43:51.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.473+0000 7fbf4c7d4700 1 --2- 172.21.15.16:0/1077427345 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fbf3006a370 0x7fbf3006c830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.473+0000 7fbf4c7d4700 1 --2- 172.21.15.16:0/1077427345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf44159fc0 0x7fbf44154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.473+0000 7fbf4c7d4700 1 --2- 172.21.15.16:0/1077427345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf440c9310 0x7fbf4415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.473+0000 7fbf4c7d4700 1 --2- 172.21.15.16:0/1077427345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf440cc890 0x7fbf44154100 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.473+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/1077427345 >> 172.21.15.16:0/1077427345 conn(0x7fbf440cecc0 msgr2=0x7fbf4406fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.473+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/1077427345 shutdown_connections 2023-08-25T04:43:51.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.473+0000 7fbf4c7d4700 1 -- 172.21.15.16:0/1077427345 wait complete. 2023-08-25T04:43:51.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.7 2023-08-25T04:43:51.487 DEBUG:teuthology.parallel:result is None 2023-08-25T04:43:51.487 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-25T04:43:51.488 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:43:51.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.651+0000 7f50e6385700 1 Processor -- start 2023-08-25T04:43:51.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.651+0000 7f50e6385700 1 -- start start 2023-08-25T04:43:51.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50e6385700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e00cf970 0x7f50e006a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50e6385700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50e015d320 0x7f50e006a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50e6385700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e00ac850 con 0x7f50e015cf40 2023-08-25T04:43:51.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50e6385700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e00ce240 con 0x7f50e015d320 2023-08-25T04:43:51.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50e6385700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e0071a60 con 0x7f50e00cf970 2023-08-25T04:43:51.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50dffff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f50e015cf40 0x7f50e00cda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39908/0 (socket says 172.21.15.16:39908) 2023-08-25T04:43:51.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50dffff700 1 -- 172.21.15.16:0/1908976936 learned_addr learned my addr 172.21.15.16:0/1908976936 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:51.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50e4922700 1 --2- 172.21.15.16:0/1908976936 >> v2:172.21.15.117:3300/0 conn(0x7f50e015d320 0x7f50e006a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50df7fe700 1 --2- 172.21.15.16:0/1908976936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e00cf970 0x7f50e006a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50deffd700 1 -- 172.21.15.16:0/1908976936 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537676499 0 0) 0x7f50e00ac850 con 0x7f50e015cf40 2023-08-25T04:43:51.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50deffd700 1 -- 172.21.15.16:0/1908976936 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50c80035b0 con 0x7f50e015cf40 2023-08-25T04:43:51.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50deffd700 1 -- 172.21.15.16:0/1908976936 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 213846729 0 0) 0x7f50c80035b0 con 0x7f50e015cf40 2023-08-25T04:43:51.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50e4922700 1 -- 172.21.15.16:0/1908976936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e00cf970 msgr2=0x7f50e006a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:51.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50e4922700 1 --2- 172.21.15.16:0/1908976936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e00cf970 0x7f50e006a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50e4922700 1 -- 172.21.15.16:0/1908976936 >> v1:172.21.15.16:6789/0 conn(0x7f50e015cf40 legacy=0x7f50e00cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50e4922700 1 -- 172.21.15.16:0/1908976936 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e0071d40 con 0x7f50e015d320 2023-08-25T04:43:51.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50df7fe700 1 --2- 172.21.15.16:0/1908976936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e00cf970 0x7f50e006a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:51.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.652+0000 7f50e4922700 1 --2- 172.21.15.16:0/1908976936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e015d320 0x7f50e006a880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009d90 tx=0x7f50d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d0ba55f9affb643 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.653+0000 7f50deffd700 1 -- 172.21.15.16:0/1908976936 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d800e070 con 0x7f50e015d320 2023-08-25T04:43:51.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.653+0000 7f50deffd700 1 -- 172.21.15.16:0/1908976936 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d8003a20 con 0x7f50e015d320 2023-08-25T04:43:51.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.653+0000 7f50deffd700 1 -- 172.21.15.16:0/1908976936 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0001670 con 0x7f50e015d320 2023-08-25T04:43:51.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.653+0000 7f50e6385700 1 -- 172.21.15.16:0/1908976936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e015d320 msgr2=0x7f50e006a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.653+0000 7f50e6385700 1 --2- 172.21.15.16:0/1908976936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e015d320 0x7f50e006a880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009d90 tx=0x7f50d800b330 comp rx=0 tx=0).stop 2023-08-25T04:43:51.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.653+0000 7f50e6385700 1 -- 172.21.15.16:0/1908976936 shutdown_connections 2023-08-25T04:43:51.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.653+0000 7f50e6385700 1 --2- 172.21.15.16:0/1908976936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e015d320 0x7f50e006a880 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.653+0000 7f50e6385700 1 --2- 172.21.15.16:0/1908976936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e00cf970 0x7f50e006a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.653+0000 7f50e6385700 1 -- 172.21.15.16:0/1908976936 >> 172.21.15.16:0/1908976936 conn(0x7f50e00b1a10 msgr2=0x7f50e00b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.653+0000 7f50e6385700 1 -- 172.21.15.16:0/1908976936 shutdown_connections 2023-08-25T04:43:51.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.653+0000 7f50e6385700 1 -- 172.21.15.16:0/1908976936 wait complete. 2023-08-25T04:43:51.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.654+0000 7f50e6385700 1 Processor -- start 2023-08-25T04:43:51.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.655+0000 7f50e6385700 1 -- start start 2023-08-25T04:43:51.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.655+0000 7f50e6385700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e00cf970 0x7f50e0156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.655+0000 7f50e6385700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e015cf40 0x7f50e015f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.655+0000 7f50e6385700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50e015d320 0x7f50e015f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.655+0000 7f50e6385700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e00b3850 con 0x7f50e015d320 2023-08-25T04:43:51.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.655+0000 7f50e6385700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e0156780 con 0x7f50e00cf970 2023-08-25T04:43:51.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.655+0000 7f50e6385700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e00b2980 con 0x7f50e015cf40 2023-08-25T04:43:51.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.655+0000 7f50e4922700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50e015d320 0x7f50e015f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.655+0000 7f50e4922700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50e015d320 0x7f50e015f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49504/0 (socket says 172.21.15.16:49504) 2023-08-25T04:43:51.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.655+0000 7f50e4922700 1 -- 172.21.15.16:0/1121741001 learned_addr learned my addr 172.21.15.16:0/1121741001 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:51.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.655+0000 7f50dffff700 1 --2- 172.21.15.16:0/1121741001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e00cf970 0x7f50e0156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.655+0000 7f50df7fe700 1 --2- 172.21.15.16:0/1121741001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e015cf40 0x7f50e015f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.656+0000 7f50e4922700 1 -- 172.21.15.16:0/1121741001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e015cf40 msgr2=0x7f50e015f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.656+0000 7f50e4922700 1 --2- 172.21.15.16:0/1121741001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e015cf40 0x7f50e015f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.656+0000 7f50e4922700 1 -- 172.21.15.16:0/1121741001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e00cf970 msgr2=0x7f50e0156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.656+0000 7f50e4922700 1 --2- 172.21.15.16:0/1121741001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e00cf970 0x7f50e0156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.656+0000 7f50e4922700 1 -- 172.21.15.16:0/1121741001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40094a0 con 0x7f50e015d320 2023-08-25T04:43:51.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.656+0000 7f50e4922700 1 --2- 172.21.15.16:0/1121741001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50e015d320 0x7f50e015f8d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f50e006cc30 tx=0x7f50d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.656+0000 7f50dcff9700 1 -- 172.21.15.16:0/1121741001 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8004440 con 0x7f50e015d320 2023-08-25T04:43:51.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.656+0000 7f50dcff9700 1 -- 172.21.15.16:0/1121741001 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d80045c0 con 0x7f50e015d320 2023-08-25T04:43:51.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.656+0000 7f50e6385700 1 -- 172.21.15.16:0/1121741001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d8009a70 con 0x7f50e015d320 2023-08-25T04:43:51.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.656+0000 7f50dcff9700 1 -- 172.21.15.16:0/1121741001 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8004970 con 0x7f50e015d320 2023-08-25T04:43:51.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.656+0000 7f50e6385700 1 -- 172.21.15.16:0/1121741001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e00b2bd0 con 0x7f50e015d320 2023-08-25T04:43:51.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.657+0000 7f50e6385700 1 -- 172.21.15.16:0/1121741001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e00b3990 con 0x7f50e015d320 2023-08-25T04:43:51.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.657+0000 7f50dcff9700 1 -- 172.21.15.16:0/1121741001 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f50d8012430 con 0x7f50e015d320 2023-08-25T04:43:51.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.658+0000 7f50dcff9700 1 --2- 172.21.15.16:0/1121741001 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f50cc06a0e0 0x7f50cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:51.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.658+0000 7f50dcff9700 1 -- 172.21.15.16:0/1121741001 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50d8089fb0 con 0x7f50e015d320 2023-08-25T04:43:51.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.658+0000 7f50dffff700 1 --2- 172.21.15.16:0/1121741001 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f50cc06a0e0 0x7f50cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:51.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.659+0000 7f50dffff700 1 --2- 172.21.15.16:0/1121741001 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f50cc06a0e0 0x7f50cc06c5a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f50d0000f60 tx=0x7f50d0001230 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:51.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.663+0000 7f50dcff9700 1 -- 172.21.15.16:0/1121741001 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f50d80591c0 con 0x7f50e015d320 2023-08-25T04:43:51.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.859+0000 7f50e6385700 1 -- 172.21.15.16:0/1121741001 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50e0072020 con 0x7f50cc06a0e0 2023-08-25T04:43:51.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.868+0000 7f50dcff9700 1 -- 172.21.15.16:0/1121741001 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286908 (secure 0 0 0) 0x7f50d000f690 con 0x7f50cc06a0e0 2023-08-25T04:43:51.871 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:51.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.870+0000 7f50e6385700 1 -- 172.21.15.16:0/1121741001 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f50cc06a0e0 msgr2=0x7f50cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.870+0000 7f50e6385700 1 --2- 172.21.15.16:0/1121741001 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f50cc06a0e0 0x7f50cc06c5a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f50d0000f60 tx=0x7f50d0001230 comp rx=0 tx=0).stop 2023-08-25T04:43:51.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.870+0000 7f50e6385700 1 -- 172.21.15.16:0/1121741001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50e015d320 msgr2=0x7f50e015f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:51.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.870+0000 7f50e6385700 1 --2- 172.21.15.16:0/1121741001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50e015d320 0x7f50e015f8d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f50e006cc30 tx=0x7f50d8004ad0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.870+0000 7f50e6385700 1 -- 172.21.15.16:0/1121741001 shutdown_connections 2023-08-25T04:43:51.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.870+0000 7f50e6385700 1 --2- 172.21.15.16:0/1121741001 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f50cc06a0e0 0x7f50cc06c5a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.870+0000 7f50e6385700 1 --2- 172.21.15.16:0/1121741001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50e015d320 0x7f50e015f8d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.870+0000 7f50e6385700 1 --2- 172.21.15.16:0/1121741001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e00cf970 0x7f50e0156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.870+0000 7f50e6385700 1 --2- 172.21.15.16:0/1121741001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e015cf40 0x7f50e015f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:51.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.870+0000 7f50e6385700 1 -- 172.21.15.16:0/1121741001 >> 172.21.15.16:0/1121741001 conn(0x7f50e00b1a10 msgr2=0x7f50e00b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:51.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.870+0000 7f50e6385700 1 -- 172.21.15.16:0/1121741001 shutdown_connections 2023-08-25T04:43:51.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:51.870+0000 7f50e6385700 1 -- 172.21.15.16:0/1121741001 wait complete. 2023-08-25T04:43:51.875 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-08-25T04:43:51.883 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-25T04:43:51.307827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219140,"kb_used_data":2916,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755580,"statfs":{"total":773094113280,"available":772869713920,"internally_reserved":0,"allocated":2985984,"data_stored":1817387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.434461"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327803+0000","last_change":"2023-08-25T04:43:42.895145+0000","last_active":"2023-08-25T04:43:44.327803+0000","last_peered":"2023-08-25T04:43:44.327803+0000","last_clean":"2023-08-25T04:43:44.327803+0000","last_became_active":"2023-08-25T04:43:42.894831+0000","last_became_peered":"2023-08-25T04:43:42.894831+0000","last_unstale":"2023-08-25T04:43:44.327803+0000","last_undegraded":"2023-08-25T04:43:44.327803+0000","last_fullsized":"2023-08-25T04:43:44.327803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:14:14.705163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874604+0000","last_change":"2023-08-25T04:43:42.895503+0000","last_active":"2023-08-25T04:43:43.874604+0000","last_peered":"2023-08-25T04:43:43.874604+0000","last_clean":"2023-08-25T04:43:43.874604+0000","last_became_active":"2023-08-25T04:43:42.895245+0000","last_became_peered":"2023-08-25T04:43:42.895245+0000","last_unstale":"2023-08-25T04:43:43.874604+0000","last_undegraded":"2023-08-25T04:43:43.874604+0000","last_fullsized":"2023-08-25T04:43:43.874604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:15.216169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327984+0000","last_change":"2023-08-25T04:43:42.888920+0000","last_active":"2023-08-25T04:43:44.327984+0000","last_peered":"2023-08-25T04:43:44.327984+0000","last_clean":"2023-08-25T04:43:44.327984+0000","last_became_active":"2023-08-25T04:43:42.888568+0000","last_became_peered":"2023-08-25T04:43:42.888568+0000","last_unstale":"2023-08-25T04:43:44.327984+0000","last_undegraded":"2023-08-25T04:43:44.327984+0000","last_fullsized":"2023-08-25T04:43:44.327984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:16.589145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328061+0000","last_change":"2023-08-25T04:43:42.893868+0000","last_active":"2023-08-25T04:43:44.328061+0000","last_peered":"2023-08-25T04:43:44.328061+0000","last_clean":"2023-08-25T04:43:44.328061+0000","last_became_active":"2023-08-25T04:43:42.893534+0000","last_became_peered":"2023-08-25T04:43:42.893534+0000","last_unstale":"2023-08-25T04:43:44.328061+0000","last_undegraded":"2023-08-25T04:43:44.328061+0000","last_fullsized":"2023-08-25T04:43:44.328061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:31.303608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328282+0000","last_change":"2023-08-25T04:43:42.902297+0000","last_active":"2023-08-25T04:43:44.328282+0000","last_peered":"2023-08-25T04:43:44.328282+0000","last_clean":"2023-08-25T04:43:44.328282+0000","last_became_active":"2023-08-25T04:43:42.901963+0000","last_became_peered":"2023-08-25T04:43:42.901963+0000","last_unstale":"2023-08-25T04:43:44.328282+0000","last_undegraded":"2023-08-25T04:43:44.328282+0000","last_fullsized":"2023-08-25T04:43:44.328282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328304+0000","last_change":"2023-08-25T04:43:42.888877+0000","last_active":"2023-08-25T04:43:44.328304+0000","last_peered":"2023-08-25T04:43:44.328304+0000","last_clean":"2023-08-25T04:43:44.328304+0000","last_became_active":"2023-08-25T04:43:42.888567+0000","last_became_peered":"2023-08-25T04:43:42.888567+0000","last_unstale":"2023-08-25T04:43:44.328304+0000","last_undegraded":"2023-08-25T04:43:44.328304+0000","last_fullsized":"2023-08-25T04:43:44.328304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:32:00.413218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032871+0000","last_change":"2023-08-25T04:43:42.902469+0000","last_active":"2023-08-25T04:43:44.032871+0000","last_peered":"2023-08-25T04:43:44.032871+0000","last_clean":"2023-08-25T04:43:44.032871+0000","last_became_active":"2023-08-25T04:43:42.902156+0000","last_became_peered":"2023-08-25T04:43:42.902156+0000","last_unstale":"2023-08-25T04:43:44.032871+0000","last_undegraded":"2023-08-25T04:43:44.032871+0000","last_fullsized":"2023-08-25T04:43:44.032871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874207+0000","last_change":"2023-08-25T04:43:42.895697+0000","last_active":"2023-08-25T04:43:43.874207+0000","last_peered":"2023-08-25T04:43:43.874207+0000","last_clean":"2023-08-25T04:43:43.874207+0000","last_became_active":"2023-08-25T04:43:42.895410+0000","last_became_peered":"2023-08-25T04:43:42.895410+0000","last_unstale":"2023-08-25T04:43:43.874207+0000","last_undegraded":"2023-08-25T04:43:43.874207+0000","last_fullsized":"2023-08-25T04:43:43.874207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:31.303608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327641+0000","last_change":"2023-08-25T04:43:42.897483+0000","last_active":"2023-08-25T04:43:44.327641+0000","last_peered":"2023-08-25T04:43:44.327641+0000","last_clean":"2023-08-25T04:43:44.327641+0000","last_became_active":"2023-08-25T04:43:42.896949+0000","last_became_peered":"2023-08-25T04:43:42.896949+0000","last_unstale":"2023-08-25T04:43:44.327641+0000","last_undegraded":"2023-08-25T04:43:44.327641+0000","last_fullsized":"2023-08-25T04:43:44.327641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:31:35.265544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874624+0000","last_change":"2023-08-25T04:43:42.895115+0000","last_active":"2023-08-25T04:43:43.874624+0000","last_peered":"2023-08-25T04:43:43.874624+0000","last_clean":"2023-08-25T04:43:43.874624+0000","last_became_active":"2023-08-25T04:43:42.894786+0000","last_became_peered":"2023-08-25T04:43:42.894786+0000","last_unstale":"2023-08-25T04:43:43.874624+0000","last_undegraded":"2023-08-25T04:43:43.874624+0000","last_fullsized":"2023-08-25T04:43:43.874624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:25.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328212+0000","last_change":"2023-08-25T04:43:42.892793+0000","last_active":"2023-08-25T04:43:44.328212+0000","last_peered":"2023-08-25T04:43:44.328212+0000","last_clean":"2023-08-25T04:43:44.328212+0000","last_became_active":"2023-08-25T04:43:42.892558+0000","last_became_peered":"2023-08-25T04:43:42.892558+0000","last_unstale":"2023-08-25T04:43:44.328212+0000","last_undegraded":"2023-08-25T04:43:44.328212+0000","last_fullsized":"2023-08-25T04:43:44.328212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:03.096619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327734+0000","last_change":"2023-08-25T04:43:42.892113+0000","last_active":"2023-08-25T04:43:44.327734+0000","last_peered":"2023-08-25T04:43:44.327734+0000","last_clean":"2023-08-25T04:43:44.327734+0000","last_became_active":"2023-08-25T04:43:42.891782+0000","last_became_peered":"2023-08-25T04:43:42.891782+0000","last_unstale":"2023-08-25T04:43:44.327734+0000","last_undegraded":"2023-08-25T04:43:44.327734+0000","last_fullsized":"2023-08-25T04:43:44.327734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:24:49.974531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327765+0000","last_change":"2023-08-25T04:43:42.896635+0000","last_active":"2023-08-25T04:43:44.327765+0000","last_peered":"2023-08-25T04:43:44.327765+0000","last_clean":"2023-08-25T04:43:44.327765+0000","last_became_active":"2023-08-25T04:43:42.896334+0000","last_became_peered":"2023-08-25T04:43:42.896334+0000","last_unstale":"2023-08-25T04:43:44.327765+0000","last_undegraded":"2023-08-25T04:43:44.327765+0000","last_fullsized":"2023-08-25T04:43:44.327765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:56:24.754587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874371+0000","last_change":"2023-08-25T04:43:42.894765+0000","last_active":"2023-08-25T04:43:43.874371+0000","last_peered":"2023-08-25T04:43:43.874371+0000","last_clean":"2023-08-25T04:43:43.874371+0000","last_became_active":"2023-08-25T04:43:42.894472+0000","last_became_peered":"2023-08-25T04:43:42.894472+0000","last_unstale":"2023-08-25T04:43:43.874371+0000","last_undegraded":"2023-08-25T04:43:43.874371+0000","last_fullsized":"2023-08-25T04:43:43.874371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:10.669970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033055+0000","last_change":"2023-08-25T04:43:42.902458+0000","last_active":"2023-08-25T04:43:44.033055+0000","last_peered":"2023-08-25T04:43:44.033055+0000","last_clean":"2023-08-25T04:43:44.033055+0000","last_became_active":"2023-08-25T04:43:42.902184+0000","last_became_peered":"2023-08-25T04:43:42.902184+0000","last_unstale":"2023-08-25T04:43:44.033055+0000","last_undegraded":"2023-08-25T04:43:44.033055+0000","last_fullsized":"2023-08-25T04:43:44.033055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:14.283818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327581+0000","last_change":"2023-08-25T04:43:42.889087+0000","last_active":"2023-08-25T04:43:44.327581+0000","last_peered":"2023-08-25T04:43:44.327581+0000","last_clean":"2023-08-25T04:43:44.327581+0000","last_became_active":"2023-08-25T04:43:42.888730+0000","last_became_peered":"2023-08-25T04:43:42.888730+0000","last_unstale":"2023-08-25T04:43:44.327581+0000","last_undegraded":"2023-08-25T04:43:44.327581+0000","last_fullsized":"2023-08-25T04:43:44.327581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327697+0000","last_change":"2023-08-25T04:43:42.898466+0000","last_active":"2023-08-25T04:43:44.327697+0000","last_peered":"2023-08-25T04:43:44.327697+0000","last_clean":"2023-08-25T04:43:44.327697+0000","last_became_active":"2023-08-25T04:43:42.898103+0000","last_became_peered":"2023-08-25T04:43:42.898103+0000","last_unstale":"2023-08-25T04:43:44.327697+0000","last_undegraded":"2023-08-25T04:43:44.327697+0000","last_fullsized":"2023-08-25T04:43:44.327697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.713590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328356+0000","last_change":"2023-08-25T04:43:42.892153+0000","last_active":"2023-08-25T04:43:44.328356+0000","last_peered":"2023-08-25T04:43:44.328356+0000","last_clean":"2023-08-25T04:43:44.328356+0000","last_became_active":"2023-08-25T04:43:42.891874+0000","last_became_peered":"2023-08-25T04:43:42.891874+0000","last_unstale":"2023-08-25T04:43:44.328356+0000","last_undegraded":"2023-08-25T04:43:44.328356+0000","last_fullsized":"2023-08-25T04:43:44.328356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:23:15.219642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327457+0000","last_change":"2023-08-25T04:43:42.895594+0000","last_active":"2023-08-25T04:43:44.327457+0000","last_peered":"2023-08-25T04:43:44.327457+0000","last_clean":"2023-08-25T04:43:44.327457+0000","last_became_active":"2023-08-25T04:43:42.895114+0000","last_became_peered":"2023-08-25T04:43:42.895114+0000","last_unstale":"2023-08-25T04:43:44.327457+0000","last_undegraded":"2023-08-25T04:43:44.327457+0000","last_fullsized":"2023-08-25T04:43:44.327457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:16:14.273348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328271+0000","last_change":"2023-08-25T04:43:42.896149+0000","last_active":"2023-08-25T04:43:44.328271+0000","last_peered":"2023-08-25T04:43:44.328271+0000","last_clean":"2023-08-25T04:43:44.328271+0000","last_became_active":"2023-08-25T04:43:42.895893+0000","last_became_peered":"2023-08-25T04:43:42.895893+0000","last_unstale":"2023-08-25T04:43:44.328271+0000","last_undegraded":"2023-08-25T04:43:44.328271+0000","last_fullsized":"2023-08-25T04:43:44.328271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:40.101990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033178+0000","last_change":"2023-08-25T04:43:42.905467+0000","last_active":"2023-08-25T04:43:44.033178+0000","last_peered":"2023-08-25T04:43:44.033178+0000","last_clean":"2023-08-25T04:43:44.033178+0000","last_became_active":"2023-08-25T04:43:42.905157+0000","last_became_peered":"2023-08-25T04:43:42.905157+0000","last_unstale":"2023-08-25T04:43:44.033178+0000","last_undegraded":"2023-08-25T04:43:44.033178+0000","last_fullsized":"2023-08-25T04:43:44.033178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:27.309119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327693+0000","last_change":"2023-08-25T04:43:42.881107+0000","last_active":"2023-08-25T04:43:44.327693+0000","last_peered":"2023-08-25T04:43:44.327693+0000","last_clean":"2023-08-25T04:43:44.327693+0000","last_became_active":"2023-08-25T04:43:42.879881+0000","last_became_peered":"2023-08-25T04:43:42.879881+0000","last_unstale":"2023-08-25T04:43:44.327693+0000","last_undegraded":"2023-08-25T04:43:44.327693+0000","last_fullsized":"2023-08-25T04:43:44.327693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:31.030985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874763+0000","last_change":"2023-08-25T04:43:42.899035+0000","last_active":"2023-08-25T04:43:43.874763+0000","last_peered":"2023-08-25T04:43:43.874763+0000","last_clean":"2023-08-25T04:43:43.874763+0000","last_became_active":"2023-08-25T04:43:42.898723+0000","last_became_peered":"2023-08-25T04:43:42.898723+0000","last_unstale":"2023-08-25T04:43:43.874763+0000","last_undegraded":"2023-08-25T04:43:43.874763+0000","last_fullsized":"2023-08-25T04:43:43.874763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:15.216169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032883+0000","last_change":"2023-08-25T04:43:42.897136+0000","last_active":"2023-08-25T04:43:44.032883+0000","last_peered":"2023-08-25T04:43:44.032883+0000","last_clean":"2023-08-25T04:43:44.032883+0000","last_became_active":"2023-08-25T04:43:42.896869+0000","last_became_peered":"2023-08-25T04:43:42.896869+0000","last_unstale":"2023-08-25T04:43:44.032883+0000","last_undegraded":"2023-08-25T04:43:44.032883+0000","last_fullsized":"2023-08-25T04:43:44.032883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873831+0000","last_change":"2023-08-25T04:43:42.893954+0000","last_active":"2023-08-25T04:43:43.873831+0000","last_peered":"2023-08-25T04:43:43.873831+0000","last_clean":"2023-08-25T04:43:43.873831+0000","last_became_active":"2023-08-25T04:43:42.893673+0000","last_became_peered":"2023-08-25T04:43:42.893673+0000","last_unstale":"2023-08-25T04:43:43.873831+0000","last_undegraded":"2023-08-25T04:43:43.873831+0000","last_fullsized":"2023-08-25T04:43:43.873831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:10.669970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873872+0000","last_change":"2023-08-25T04:43:42.888116+0000","last_active":"2023-08-25T04:43:43.873872+0000","last_peered":"2023-08-25T04:43:43.873872+0000","last_clean":"2023-08-25T04:43:43.873872+0000","last_became_active":"2023-08-25T04:43:42.887831+0000","last_became_peered":"2023-08-25T04:43:42.887831+0000","last_unstale":"2023-08-25T04:43:43.873872+0000","last_undegraded":"2023-08-25T04:43:43.873872+0000","last_fullsized":"2023-08-25T04:43:43.873872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:38.406155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874487+0000","last_change":"2023-08-25T04:43:42.894954+0000","last_active":"2023-08-25T04:43:43.874487+0000","last_peered":"2023-08-25T04:43:43.874487+0000","last_clean":"2023-08-25T04:43:43.874487+0000","last_became_active":"2023-08-25T04:43:42.894302+0000","last_became_peered":"2023-08-25T04:43:42.894302+0000","last_unstale":"2023-08-25T04:43:43.874487+0000","last_undegraded":"2023-08-25T04:43:43.874487+0000","last_fullsized":"2023-08-25T04:43:43.874487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:49.188528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328143+0000","last_change":"2023-08-25T04:43:41.888584+0000","last_active":"2023-08-25T04:43:44.328143+0000","last_peered":"2023-08-25T04:43:44.328143+0000","last_clean":"2023-08-25T04:43:44.328143+0000","last_became_active":"2023-08-25T04:43:41.888339+0000","last_became_peered":"2023-08-25T04:43:41.888339+0000","last_unstale":"2023-08-25T04:43:44.328143+0000","last_undegraded":"2023-08-25T04:43:44.328143+0000","last_fullsized":"2023-08-25T04:43:44.328143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:17.587860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874994+0000","last_change":"2023-08-25T04:43:42.897739+0000","last_active":"2023-08-25T04:43:43.874994+0000","last_peered":"2023-08-25T04:43:43.874994+0000","last_clean":"2023-08-25T04:43:43.874994+0000","last_became_active":"2023-08-25T04:43:42.897425+0000","last_became_peered":"2023-08-25T04:43:42.897425+0000","last_unstale":"2023-08-25T04:43:43.874994+0000","last_undegraded":"2023-08-25T04:43:43.874994+0000","last_fullsized":"2023-08-25T04:43:43.874994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873410+0000","last_change":"2023-08-25T04:43:41.886122+0000","last_active":"2023-08-25T04:43:43.873410+0000","last_peered":"2023-08-25T04:43:43.873410+0000","last_clean":"2023-08-25T04:43:43.873410+0000","last_became_active":"2023-08-25T04:43:41.885184+0000","last_became_peered":"2023-08-25T04:43:41.885184+0000","last_unstale":"2023-08-25T04:43:43.873410+0000","last_undegraded":"2023-08-25T04:43:43.873410+0000","last_fullsized":"2023-08-25T04:43:43.873410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:30.025865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328069+0000","last_change":"2023-08-25T04:43:42.890854+0000","last_active":"2023-08-25T04:43:44.328069+0000","last_peered":"2023-08-25T04:43:44.328069+0000","last_clean":"2023-08-25T04:43:44.328069+0000","last_became_active":"2023-08-25T04:43:42.890575+0000","last_became_peered":"2023-08-25T04:43:42.890575+0000","last_unstale":"2023-08-25T04:43:44.328069+0000","last_undegraded":"2023-08-25T04:43:44.328069+0000","last_fullsized":"2023-08-25T04:43:44.328069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:49.188528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874877+0000","last_change":"2023-08-25T04:43:41.885567+0000","last_active":"2023-08-25T04:43:43.874877+0000","last_peered":"2023-08-25T04:43:43.874877+0000","last_clean":"2023-08-25T04:43:43.874877+0000","last_became_active":"2023-08-25T04:43:41.885299+0000","last_became_peered":"2023-08-25T04:43:41.885299+0000","last_unstale":"2023-08-25T04:43:43.874877+0000","last_undegraded":"2023-08-25T04:43:43.874877+0000","last_fullsized":"2023-08-25T04:43:43.874877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:19.036840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328008+0000","last_change":"2023-08-25T04:43:42.899190+0000","last_active":"2023-08-25T04:43:44.328008+0000","last_peered":"2023-08-25T04:43:44.328008+0000","last_clean":"2023-08-25T04:43:44.328008+0000","last_became_active":"2023-08-25T04:43:42.898874+0000","last_became_peered":"2023-08-25T04:43:42.898874+0000","last_unstale":"2023-08-25T04:43:44.328008+0000","last_undegraded":"2023-08-25T04:43:44.328008+0000","last_fullsized":"2023-08-25T04:43:44.328008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.713590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327795+0000","last_change":"2023-08-25T04:43:41.883055+0000","last_active":"2023-08-25T04:43:44.327795+0000","last_peered":"2023-08-25T04:43:44.327795+0000","last_clean":"2023-08-25T04:43:44.327795+0000","last_became_active":"2023-08-25T04:43:41.882381+0000","last_became_peered":"2023-08-25T04:43:41.882381+0000","last_unstale":"2023-08-25T04:43:44.327795+0000","last_undegraded":"2023-08-25T04:43:44.327795+0000","last_fullsized":"2023-08-25T04:43:44.327795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:30.298488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874811+0000","last_change":"2023-08-25T04:43:42.897118+0000","last_active":"2023-08-25T04:43:43.874811+0000","last_peered":"2023-08-25T04:43:43.874811+0000","last_clean":"2023-08-25T04:43:43.874811+0000","last_became_active":"2023-08-25T04:43:42.896817+0000","last_became_peered":"2023-08-25T04:43:42.896817+0000","last_unstale":"2023-08-25T04:43:43.874811+0000","last_undegraded":"2023-08-25T04:43:43.874811+0000","last_fullsized":"2023-08-25T04:43:43.874811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874464+0000","last_change":"2023-08-25T04:43:41.882339+0000","last_active":"2023-08-25T04:43:43.874464+0000","last_peered":"2023-08-25T04:43:43.874464+0000","last_clean":"2023-08-25T04:43:43.874464+0000","last_became_active":"2023-08-25T04:43:41.882055+0000","last_became_peered":"2023-08-25T04:43:41.882055+0000","last_unstale":"2023-08-25T04:43:43.874464+0000","last_undegraded":"2023-08-25T04:43:43.874464+0000","last_fullsized":"2023-08-25T04:43:43.874464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:58:07.396227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875270+0000","last_change":"2023-08-25T04:43:42.891741+0000","last_active":"2023-08-25T04:43:43.875270+0000","last_peered":"2023-08-25T04:43:43.875270+0000","last_clean":"2023-08-25T04:43:43.875270+0000","last_became_active":"2023-08-25T04:43:42.890100+0000","last_became_peered":"2023-08-25T04:43:42.890100+0000","last_unstale":"2023-08-25T04:43:43.875270+0000","last_undegraded":"2023-08-25T04:43:43.875270+0000","last_fullsized":"2023-08-25T04:43:43.875270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:03.096619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033307+0000","last_change":"2023-08-25T04:43:41.887924+0000","last_active":"2023-08-25T04:43:44.033307+0000","last_peered":"2023-08-25T04:43:44.033307+0000","last_clean":"2023-08-25T04:43:44.033307+0000","last_became_active":"2023-08-25T04:43:41.887622+0000","last_became_peered":"2023-08-25T04:43:41.887622+0000","last_unstale":"2023-08-25T04:43:44.033307+0000","last_undegraded":"2023-08-25T04:43:44.033307+0000","last_fullsized":"2023-08-25T04:43:44.033307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:26.261202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873335+0000","last_change":"2023-08-25T04:43:42.891006+0000","last_active":"2023-08-25T04:43:43.873335+0000","last_peered":"2023-08-25T04:43:43.873335+0000","last_clean":"2023-08-25T04:43:43.873335+0000","last_became_active":"2023-08-25T04:43:42.890648+0000","last_became_peered":"2023-08-25T04:43:42.890648+0000","last_unstale":"2023-08-25T04:43:43.873335+0000","last_undegraded":"2023-08-25T04:43:43.873335+0000","last_fullsized":"2023-08-25T04:43:43.873335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:03.819785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328264+0000","last_change":"2023-08-25T04:43:41.887033+0000","last_active":"2023-08-25T04:43:44.328264+0000","last_peered":"2023-08-25T04:43:44.328264+0000","last_clean":"2023-08-25T04:43:44.328264+0000","last_became_active":"2023-08-25T04:43:41.886491+0000","last_became_peered":"2023-08-25T04:43:41.886491+0000","last_unstale":"2023-08-25T04:43:44.328264+0000","last_undegraded":"2023-08-25T04:43:44.328264+0000","last_fullsized":"2023-08-25T04:43:44.328264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:58:33.572888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328258+0000","last_change":"2023-08-25T04:43:42.893709+0000","last_active":"2023-08-25T04:43:44.328258+0000","last_peered":"2023-08-25T04:43:44.328258+0000","last_clean":"2023-08-25T04:43:44.328258+0000","last_became_active":"2023-08-25T04:43:42.893525+0000","last_became_peered":"2023-08-25T04:43:42.893525+0000","last_unstale":"2023-08-25T04:43:44.328258+0000","last_undegraded":"2023-08-25T04:43:44.328258+0000","last_fullsized":"2023-08-25T04:43:44.328258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:58:52.209554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033093+0000","last_change":"2023-08-25T04:43:41.890946+0000","last_active":"2023-08-25T04:43:44.033093+0000","last_peered":"2023-08-25T04:43:44.033093+0000","last_clean":"2023-08-25T04:43:44.033093+0000","last_became_active":"2023-08-25T04:43:41.890673+0000","last_became_peered":"2023-08-25T04:43:41.890673+0000","last_unstale":"2023-08-25T04:43:44.033093+0000","last_undegraded":"2023-08-25T04:43:44.033093+0000","last_fullsized":"2023-08-25T04:43:44.033093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:38.571968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875163+0000","last_change":"2023-08-25T04:43:42.897809+0000","last_active":"2023-08-25T04:43:43.875163+0000","last_peered":"2023-08-25T04:43:43.875163+0000","last_clean":"2023-08-25T04:43:43.875163+0000","last_became_active":"2023-08-25T04:43:42.897204+0000","last_became_peered":"2023-08-25T04:43:42.897204+0000","last_unstale":"2023-08-25T04:43:43.875163+0000","last_undegraded":"2023-08-25T04:43:43.875163+0000","last_fullsized":"2023-08-25T04:43:43.875163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:27.309119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327671+0000","last_change":"2023-08-25T04:43:41.881387+0000","last_active":"2023-08-25T04:43:44.327671+0000","last_peered":"2023-08-25T04:43:44.327671+0000","last_clean":"2023-08-25T04:43:44.327671+0000","last_became_active":"2023-08-25T04:43:41.881067+0000","last_became_peered":"2023-08-25T04:43:41.881067+0000","last_unstale":"2023-08-25T04:43:44.327671+0000","last_undegraded":"2023-08-25T04:43:44.327671+0000","last_fullsized":"2023-08-25T04:43:44.327671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:34:36.120848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874683+0000","last_change":"2023-08-25T04:43:42.895088+0000","last_active":"2023-08-25T04:43:43.874683+0000","last_peered":"2023-08-25T04:43:43.874683+0000","last_clean":"2023-08-25T04:43:43.874683+0000","last_became_active":"2023-08-25T04:43:42.894807+0000","last_became_peered":"2023-08-25T04:43:42.894807+0000","last_unstale":"2023-08-25T04:43:43.874683+0000","last_undegraded":"2023-08-25T04:43:43.874683+0000","last_fullsized":"2023-08-25T04:43:43.874683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032938+0000","last_change":"2023-08-25T04:43:41.890995+0000","last_active":"2023-08-25T04:43:44.032938+0000","last_peered":"2023-08-25T04:43:44.032938+0000","last_clean":"2023-08-25T04:43:44.032938+0000","last_became_active":"2023-08-25T04:43:41.890706+0000","last_became_peered":"2023-08-25T04:43:41.890706+0000","last_unstale":"2023-08-25T04:43:44.032938+0000","last_undegraded":"2023-08-25T04:43:44.032938+0000","last_fullsized":"2023-08-25T04:43:44.032938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327738+0000","last_change":"2023-08-25T04:43:42.897775+0000","last_active":"2023-08-25T04:43:44.327738+0000","last_peered":"2023-08-25T04:43:44.327738+0000","last_clean":"2023-08-25T04:43:44.327738+0000","last_became_active":"2023-08-25T04:43:42.897476+0000","last_became_peered":"2023-08-25T04:43:42.897476+0000","last_unstale":"2023-08-25T04:43:44.327738+0000","last_undegraded":"2023-08-25T04:43:44.327738+0000","last_fullsized":"2023-08-25T04:43:44.327738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:03.819785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327483+0000","last_change":"2023-08-25T04:43:41.892829+0000","last_active":"2023-08-25T04:43:44.327483+0000","last_peered":"2023-08-25T04:43:44.327483+0000","last_clean":"2023-08-25T04:43:44.327483+0000","last_became_active":"2023-08-25T04:43:41.892517+0000","last_became_peered":"2023-08-25T04:43:41.892517+0000","last_unstale":"2023-08-25T04:43:44.327483+0000","last_undegraded":"2023-08-25T04:43:44.327483+0000","last_fullsized":"2023-08-25T04:43:44.327483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:40:01.170031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875239+0000","last_change":"2023-08-25T04:43:42.905276+0000","last_active":"2023-08-25T04:43:43.875239+0000","last_peered":"2023-08-25T04:43:43.875239+0000","last_clean":"2023-08-25T04:43:43.875239+0000","last_became_active":"2023-08-25T04:43:42.904736+0000","last_became_peered":"2023-08-25T04:43:42.904736+0000","last_unstale":"2023-08-25T04:43:43.875239+0000","last_undegraded":"2023-08-25T04:43:43.875239+0000","last_fullsized":"2023-08-25T04:43:43.875239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:18.592980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033419+0000","last_change":"2023-08-25T04:43:41.891246+0000","last_active":"2023-08-25T04:43:44.033419+0000","last_peered":"2023-08-25T04:43:44.033419+0000","last_clean":"2023-08-25T04:43:44.033419+0000","last_became_active":"2023-08-25T04:43:41.890942+0000","last_became_peered":"2023-08-25T04:43:41.890942+0000","last_unstale":"2023-08-25T04:43:44.033419+0000","last_undegraded":"2023-08-25T04:43:44.033419+0000","last_fullsized":"2023-08-25T04:43:44.033419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:39.096870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874433+0000","last_change":"2023-08-25T04:43:42.895071+0000","last_active":"2023-08-25T04:43:43.874433+0000","last_peered":"2023-08-25T04:43:43.874433+0000","last_clean":"2023-08-25T04:43:43.874433+0000","last_became_active":"2023-08-25T04:43:42.894285+0000","last_became_peered":"2023-08-25T04:43:42.894285+0000","last_unstale":"2023-08-25T04:43:43.874433+0000","last_undegraded":"2023-08-25T04:43:43.874433+0000","last_fullsized":"2023-08-25T04:43:43.874433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:49.534369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033324+0000","last_change":"2023-08-25T04:43:41.891175+0000","last_active":"2023-08-25T04:43:44.033324+0000","last_peered":"2023-08-25T04:43:44.033324+0000","last_clean":"2023-08-25T04:43:44.033324+0000","last_became_active":"2023-08-25T04:43:41.890883+0000","last_became_peered":"2023-08-25T04:43:41.890883+0000","last_unstale":"2023-08-25T04:43:44.033324+0000","last_undegraded":"2023-08-25T04:43:44.033324+0000","last_fullsized":"2023-08-25T04:43:44.033324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:02.091499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327753+0000","last_change":"2023-08-25T04:43:42.891686+0000","last_active":"2023-08-25T04:43:44.327753+0000","last_peered":"2023-08-25T04:43:44.327753+0000","last_clean":"2023-08-25T04:43:44.327753+0000","last_became_active":"2023-08-25T04:43:42.891443+0000","last_became_peered":"2023-08-25T04:43:42.891443+0000","last_unstale":"2023-08-25T04:43:44.327753+0000","last_undegraded":"2023-08-25T04:43:44.327753+0000","last_fullsized":"2023-08-25T04:43:44.327753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033233+0000","last_change":"2023-08-25T04:43:41.888723+0000","last_active":"2023-08-25T04:43:44.033233+0000","last_peered":"2023-08-25T04:43:44.033233+0000","last_clean":"2023-08-25T04:43:44.033233+0000","last_became_active":"2023-08-25T04:43:41.888447+0000","last_became_peered":"2023-08-25T04:43:41.888447+0000","last_unstale":"2023-08-25T04:43:44.033233+0000","last_undegraded":"2023-08-25T04:43:44.033233+0000","last_fullsized":"2023-08-25T04:43:44.033233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:17.587860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328252+0000","last_change":"2023-08-25T04:43:42.892447+0000","last_active":"2023-08-25T04:43:44.328252+0000","last_peered":"2023-08-25T04:43:44.328252+0000","last_clean":"2023-08-25T04:43:44.328252+0000","last_became_active":"2023-08-25T04:43:42.892191+0000","last_became_peered":"2023-08-25T04:43:42.892191+0000","last_unstale":"2023-08-25T04:43:44.328252+0000","last_undegraded":"2023-08-25T04:43:44.328252+0000","last_fullsized":"2023-08-25T04:43:44.328252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:26.162949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874646+0000","last_change":"2023-08-25T04:43:41.884395+0000","last_active":"2023-08-25T04:43:43.874646+0000","last_peered":"2023-08-25T04:43:43.874646+0000","last_clean":"2023-08-25T04:43:43.874646+0000","last_became_active":"2023-08-25T04:43:41.884098+0000","last_became_peered":"2023-08-25T04:43:41.884098+0000","last_unstale":"2023-08-25T04:43:43.874646+0000","last_undegraded":"2023-08-25T04:43:43.874646+0000","last_fullsized":"2023-08-25T04:43:43.874646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:26.896561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328035+0000","last_change":"2023-08-25T04:43:42.881050+0000","last_active":"2023-08-25T04:43:44.328035+0000","last_peered":"2023-08-25T04:43:44.328035+0000","last_clean":"2023-08-25T04:43:44.328035+0000","last_became_active":"2023-08-25T04:43:42.880104+0000","last_became_peered":"2023-08-25T04:43:42.880104+0000","last_unstale":"2023-08-25T04:43:44.328035+0000","last_undegraded":"2023-08-25T04:43:44.328035+0000","last_fullsized":"2023-08-25T04:43:44.328035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:38.406155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875014+0000","last_change":"2023-08-25T04:43:41.885729+0000","last_active":"2023-08-25T04:43:43.875014+0000","last_peered":"2023-08-25T04:43:43.875014+0000","last_clean":"2023-08-25T04:43:43.875014+0000","last_became_active":"2023-08-25T04:43:41.885433+0000","last_became_peered":"2023-08-25T04:43:41.885433+0000","last_unstale":"2023-08-25T04:43:43.875014+0000","last_undegraded":"2023-08-25T04:43:43.875014+0000","last_fullsized":"2023-08-25T04:43:43.875014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:40.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328082+0000","last_change":"2023-08-25T04:43:42.896701+0000","last_active":"2023-08-25T04:43:44.328082+0000","last_peered":"2023-08-25T04:43:44.328082+0000","last_clean":"2023-08-25T04:43:44.328082+0000","last_became_active":"2023-08-25T04:43:42.896440+0000","last_became_peered":"2023-08-25T04:43:42.896440+0000","last_unstale":"2023-08-25T04:43:44.328082+0000","last_undegraded":"2023-08-25T04:43:44.328082+0000","last_fullsized":"2023-08-25T04:43:44.328082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:27.309119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328105+0000","last_change":"2023-08-25T04:43:41.891087+0000","last_active":"2023-08-25T04:43:44.328105+0000","last_peered":"2023-08-25T04:43:44.328105+0000","last_clean":"2023-08-25T04:43:44.328105+0000","last_became_active":"2023-08-25T04:43:41.890827+0000","last_became_peered":"2023-08-25T04:43:41.890827+0000","last_unstale":"2023-08-25T04:43:44.328105+0000","last_undegraded":"2023-08-25T04:43:44.328105+0000","last_fullsized":"2023-08-25T04:43:44.328105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:02.814665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328450+0000","last_change":"2023-08-25T04:43:42.897377+0000","last_active":"2023-08-25T04:43:44.328450+0000","last_peered":"2023-08-25T04:43:44.328450+0000","last_clean":"2023-08-25T04:43:44.328450+0000","last_became_active":"2023-08-25T04:43:42.897108+0000","last_became_peered":"2023-08-25T04:43:42.897108+0000","last_unstale":"2023-08-25T04:43:44.328450+0000","last_undegraded":"2023-08-25T04:43:44.328450+0000","last_fullsized":"2023-08-25T04:43:44.328450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:46:27.979648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327909+0000","last_change":"2023-08-25T04:43:41.888568+0000","last_active":"2023-08-25T04:43:44.327909+0000","last_peered":"2023-08-25T04:43:44.327909+0000","last_clean":"2023-08-25T04:43:44.327909+0000","last_became_active":"2023-08-25T04:43:41.888323+0000","last_became_peered":"2023-08-25T04:43:41.888323+0000","last_unstale":"2023-08-25T04:43:44.327909+0000","last_undegraded":"2023-08-25T04:43:44.327909+0000","last_fullsized":"2023-08-25T04:43:44.327909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:40.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328447+0000","last_change":"2023-08-25T04:43:42.897222+0000","last_active":"2023-08-25T04:43:44.328447+0000","last_peered":"2023-08-25T04:43:44.328447+0000","last_clean":"2023-08-25T04:43:44.328447+0000","last_became_active":"2023-08-25T04:43:42.896943+0000","last_became_peered":"2023-08-25T04:43:42.896943+0000","last_unstale":"2023-08-25T04:43:44.328447+0000","last_undegraded":"2023-08-25T04:43:44.328447+0000","last_fullsized":"2023-08-25T04:43:44.328447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:55.675283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874734+0000","last_change":"2023-08-25T04:43:41.887489+0000","last_active":"2023-08-25T04:43:43.874734+0000","last_peered":"2023-08-25T04:43:43.874734+0000","last_clean":"2023-08-25T04:43:43.874734+0000","last_became_active":"2023-08-25T04:43:41.886846+0000","last_became_peered":"2023-08-25T04:43:41.886846+0000","last_unstale":"2023-08-25T04:43:43.874734+0000","last_undegraded":"2023-08-25T04:43:43.874734+0000","last_fullsized":"2023-08-25T04:43:43.874734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:48.183408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874023+0000","last_change":"2023-08-25T04:43:42.903030+0000","last_active":"2023-08-25T04:43:43.874023+0000","last_peered":"2023-08-25T04:43:43.874023+0000","last_clean":"2023-08-25T04:43:43.874023+0000","last_became_active":"2023-08-25T04:43:42.902123+0000","last_became_peered":"2023-08-25T04:43:42.902123+0000","last_unstale":"2023-08-25T04:43:43.874023+0000","last_undegraded":"2023-08-25T04:43:43.874023+0000","last_fullsized":"2023-08-25T04:43:43.874023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:15.216169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875024+0000","last_change":"2023-08-25T04:43:41.883173+0000","last_active":"2023-08-25T04:43:43.875024+0000","last_peered":"2023-08-25T04:43:43.875024+0000","last_clean":"2023-08-25T04:43:43.875024+0000","last_became_active":"2023-08-25T04:43:41.882776+0000","last_became_peered":"2023-08-25T04:43:41.882776+0000","last_unstale":"2023-08-25T04:43:43.875024+0000","last_undegraded":"2023-08-25T04:43:43.875024+0000","last_fullsized":"2023-08-25T04:43:43.875024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328156+0000","last_change":"2023-08-25T04:43:36.786045+0000","last_active":"2023-08-25T04:43:44.328156+0000","last_peered":"2023-08-25T04:43:44.328156+0000","last_clean":"2023-08-25T04:43:44.328156+0000","last_became_active":"2023-08-25T04:43:36.785725+0000","last_became_peered":"2023-08-25T04:43:36.785725+0000","last_unstale":"2023-08-25T04:43:44.328156+0000","last_undegraded":"2023-08-25T04:43:44.328156+0000","last_fullsized":"2023-08-25T04:43:44.328156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:21.173873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874659+0000","last_change":"2023-08-25T04:43:42.890044+0000","last_active":"2023-08-25T04:43:43.874659+0000","last_peered":"2023-08-25T04:43:43.874659+0000","last_clean":"2023-08-25T04:43:43.874659+0000","last_became_active":"2023-08-25T04:43:42.889721+0000","last_became_peered":"2023-08-25T04:43:42.889721+0000","last_unstale":"2023-08-25T04:43:43.874659+0000","last_undegraded":"2023-08-25T04:43:43.874659+0000","last_fullsized":"2023-08-25T04:43:43.874659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:38.406155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875215+0000","last_change":"2023-08-25T04:43:36.782928+0000","last_active":"2023-08-25T04:43:43.875215+0000","last_peered":"2023-08-25T04:43:43.875215+0000","last_clean":"2023-08-25T04:43:43.875215+0000","last_became_active":"2023-08-25T04:43:36.782680+0000","last_became_peered":"2023-08-25T04:43:36.782680+0000","last_unstale":"2023-08-25T04:43:43.875215+0000","last_undegraded":"2023-08-25T04:43:43.875215+0000","last_fullsized":"2023-08-25T04:43:43.875215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:34.009540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.359125+0000","last_change":"2023-08-25T04:43:41.888878+0000","last_active":"2023-08-25T04:43:44.359125+0000","last_peered":"2023-08-25T04:43:44.359125+0000","last_clean":"2023-08-25T04:43:44.359125+0000","last_became_active":"2023-08-25T04:43:41.885363+0000","last_became_peered":"2023-08-25T04:43:41.885363+0000","last_unstale":"2023-08-25T04:43:44.359125+0000","last_undegraded":"2023-08-25T04:43:44.359125+0000","last_fullsized":"2023-08-25T04:43:44.359125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:14.211049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328061+0000","last_change":"2023-08-25T04:43:42.899201+0000","last_active":"2023-08-25T04:43:44.328061+0000","last_peered":"2023-08-25T04:43:44.328061+0000","last_clean":"2023-08-25T04:43:44.328061+0000","last_became_active":"2023-08-25T04:43:42.898942+0000","last_became_peered":"2023-08-25T04:43:42.898942+0000","last_unstale":"2023-08-25T04:43:44.328061+0000","last_undegraded":"2023-08-25T04:43:44.328061+0000","last_fullsized":"2023-08-25T04:43:44.328061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:39.577088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873470+0000","last_change":"2023-08-25T04:43:36.785266+0000","last_active":"2023-08-25T04:43:43.873470+0000","last_peered":"2023-08-25T04:43:43.873470+0000","last_clean":"2023-08-25T04:43:43.873470+0000","last_became_active":"2023-08-25T04:43:36.784937+0000","last_became_peered":"2023-08-25T04:43:36.784937+0000","last_unstale":"2023-08-25T04:43:43.873470+0000","last_undegraded":"2023-08-25T04:43:43.873470+0000","last_fullsized":"2023-08-25T04:43:43.873470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:45.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032991+0000","last_change":"2023-08-25T04:43:36.785867+0000","last_active":"2023-08-25T04:43:44.032991+0000","last_peered":"2023-08-25T04:43:44.032991+0000","last_clean":"2023-08-25T04:43:44.032991+0000","last_became_active":"2023-08-25T04:43:36.785451+0000","last_became_peered":"2023-08-25T04:43:36.785451+0000","last_unstale":"2023-08-25T04:43:44.032991+0000","last_undegraded":"2023-08-25T04:43:44.032991+0000","last_fullsized":"2023-08-25T04:43:44.032991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:10.496695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327813+0000","last_change":"2023-08-25T04:43:41.886451+0000","last_active":"2023-08-25T04:43:44.327813+0000","last_peered":"2023-08-25T04:43:44.327813+0000","last_clean":"2023-08-25T04:43:44.327813+0000","last_became_active":"2023-08-25T04:43:41.885029+0000","last_became_peered":"2023-08-25T04:43:41.885029+0000","last_unstale":"2023-08-25T04:43:44.327813+0000","last_undegraded":"2023-08-25T04:43:44.327813+0000","last_fullsized":"2023-08-25T04:43:44.327813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:09.664850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327887+0000","last_change":"2023-08-25T04:43:42.881048+0000","last_active":"2023-08-25T04:43:44.327887+0000","last_peered":"2023-08-25T04:43:44.327887+0000","last_clean":"2023-08-25T04:43:44.327887+0000","last_became_active":"2023-08-25T04:43:42.880591+0000","last_became_peered":"2023-08-25T04:43:42.880591+0000","last_unstale":"2023-08-25T04:43:44.327887+0000","last_undegraded":"2023-08-25T04:43:44.327887+0000","last_fullsized":"2023-08-25T04:43:44.327887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:49.534369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032863+0000","last_change":"2023-08-25T04:43:37.192872+0000","last_active":"2023-08-25T04:43:44.032863+0000","last_peered":"2023-08-25T04:43:44.032863+0000","last_clean":"2023-08-25T04:43:44.032863+0000","last_became_active":"2023-08-25T04:43:37.192594+0000","last_became_peered":"2023-08-25T04:43:37.192594+0000","last_unstale":"2023-08-25T04:43:44.032863+0000","last_undegraded":"2023-08-25T04:43:44.032863+0000","last_fullsized":"2023-08-25T04:43:44.032863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:35.350128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873254+0000","last_change":"2023-08-25T04:43:41.888507+0000","last_active":"2023-08-25T04:43:43.873254+0000","last_peered":"2023-08-25T04:43:43.873254+0000","last_clean":"2023-08-25T04:43:43.873254+0000","last_became_active":"2023-08-25T04:43:41.888158+0000","last_became_peered":"2023-08-25T04:43:41.888158+0000","last_unstale":"2023-08-25T04:43:43.873254+0000","last_undegraded":"2023-08-25T04:43:43.873254+0000","last_fullsized":"2023-08-25T04:43:43.873254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:34:36.120848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874020+0000","last_change":"2023-08-25T04:43:42.902440+0000","last_active":"2023-08-25T04:43:43.874020+0000","last_peered":"2023-08-25T04:43:43.874020+0000","last_clean":"2023-08-25T04:43:43.874020+0000","last_became_active":"2023-08-25T04:43:42.901657+0000","last_became_peered":"2023-08-25T04:43:42.901657+0000","last_unstale":"2023-08-25T04:43:43.874020+0000","last_undegraded":"2023-08-25T04:43:43.874020+0000","last_fullsized":"2023-08-25T04:43:43.874020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:49.188528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032805+0000","last_change":"2023-08-25T04:43:37.192977+0000","last_active":"2023-08-25T04:43:44.032805+0000","last_peered":"2023-08-25T04:43:44.032805+0000","last_clean":"2023-08-25T04:43:44.032805+0000","last_became_active":"2023-08-25T04:43:37.192427+0000","last_became_peered":"2023-08-25T04:43:37.192427+0000","last_unstale":"2023-08-25T04:43:44.032805+0000","last_undegraded":"2023-08-25T04:43:44.032805+0000","last_fullsized":"2023-08-25T04:43:44.032805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:13.949510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875137+0000","last_change":"2023-08-25T04:43:41.883960+0000","last_active":"2023-08-25T04:43:43.875137+0000","last_peered":"2023-08-25T04:43:43.875137+0000","last_clean":"2023-08-25T04:43:43.875137+0000","last_became_active":"2023-08-25T04:43:41.883621+0000","last_became_peered":"2023-08-25T04:43:41.883621+0000","last_unstale":"2023-08-25T04:43:43.875137+0000","last_undegraded":"2023-08-25T04:43:43.875137+0000","last_fullsized":"2023-08-25T04:43:43.875137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:38.571968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327644+0000","last_change":"2023-08-25T04:43:42.893639+0000","last_active":"2023-08-25T04:43:44.327644+0000","last_peered":"2023-08-25T04:43:44.327644+0000","last_clean":"2023-08-25T04:43:44.327644+0000","last_became_active":"2023-08-25T04:43:42.893333+0000","last_became_peered":"2023-08-25T04:43:42.893333+0000","last_unstale":"2023-08-25T04:43:44.327644+0000","last_undegraded":"2023-08-25T04:43:44.327644+0000","last_fullsized":"2023-08-25T04:43:44.327644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:08:04.874031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874239+0000","last_change":"2023-08-25T04:43:37.192780+0000","last_active":"2023-08-25T04:43:43.874239+0000","last_peered":"2023-08-25T04:43:43.874239+0000","last_clean":"2023-08-25T04:43:43.874239+0000","last_became_active":"2023-08-25T04:43:37.192432+0000","last_became_peered":"2023-08-25T04:43:37.192432+0000","last_unstale":"2023-08-25T04:43:43.874239+0000","last_undegraded":"2023-08-25T04:43:43.874239+0000","last_fullsized":"2023-08-25T04:43:43.874239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:20.070499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328104+0000","last_change":"2023-08-25T04:43:41.889966+0000","last_active":"2023-08-25T04:43:44.328104+0000","last_peered":"2023-08-25T04:43:44.328104+0000","last_clean":"2023-08-25T04:43:44.328104+0000","last_became_active":"2023-08-25T04:43:41.889717+0000","last_became_peered":"2023-08-25T04:43:41.889717+0000","last_unstale":"2023-08-25T04:43:44.328104+0000","last_undegraded":"2023-08-25T04:43:44.328104+0000","last_fullsized":"2023-08-25T04:43:44.328104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:13.278697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873901+0000","last_change":"2023-08-25T04:43:42.885970+0000","last_active":"2023-08-25T04:43:43.873901+0000","last_peered":"2023-08-25T04:43:43.873901+0000","last_clean":"2023-08-25T04:43:43.873901+0000","last_became_active":"2023-08-25T04:43:42.885671+0000","last_became_peered":"2023-08-25T04:43:42.885671+0000","last_unstale":"2023-08-25T04:43:43.873901+0000","last_undegraded":"2023-08-25T04:43:43.873901+0000","last_fullsized":"2023-08-25T04:43:43.873901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:58:08.401348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327943+0000","last_change":"2023-08-25T04:43:37.192768+0000","last_active":"2023-08-25T04:43:44.327943+0000","last_peered":"2023-08-25T04:43:44.327943+0000","last_clean":"2023-08-25T04:43:44.327943+0000","last_became_active":"2023-08-25T04:43:37.192429+0000","last_became_peered":"2023-08-25T04:43:37.192429+0000","last_unstale":"2023-08-25T04:43:44.327943+0000","last_undegraded":"2023-08-25T04:43:44.327943+0000","last_fullsized":"2023-08-25T04:43:44.327943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:24.938536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873773+0000","last_change":"2023-08-25T04:43:41.888493+0000","last_active":"2023-08-25T04:43:43.873773+0000","last_peered":"2023-08-25T04:43:43.873773+0000","last_clean":"2023-08-25T04:43:43.873773+0000","last_became_active":"2023-08-25T04:43:41.888207+0000","last_became_peered":"2023-08-25T04:43:41.888207+0000","last_unstale":"2023-08-25T04:43:43.873773+0000","last_undegraded":"2023-08-25T04:43:43.873773+0000","last_fullsized":"2023-08-25T04:43:43.873773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:48.529248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327907+0000","last_change":"2023-08-25T04:43:42.900866+0000","last_active":"2023-08-25T04:43:44.327907+0000","last_peered":"2023-08-25T04:43:44.327907+0000","last_clean":"2023-08-25T04:43:44.327907+0000","last_became_active":"2023-08-25T04:43:42.900470+0000","last_became_peered":"2023-08-25T04:43:42.900470+0000","last_unstale":"2023-08-25T04:43:44.327907+0000","last_undegraded":"2023-08-25T04:43:44.327907+0000","last_fullsized":"2023-08-25T04:43:44.327907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:58:08.401348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327840+0000","last_change":"2023-08-25T04:43:36.785280+0000","last_active":"2023-08-25T04:43:44.327840+0000","last_peered":"2023-08-25T04:43:44.327840+0000","last_clean":"2023-08-25T04:43:44.327840+0000","last_became_active":"2023-08-25T04:43:36.784943+0000","last_became_peered":"2023-08-25T04:43:36.784943+0000","last_unstale":"2023-08-25T04:43:44.327840+0000","last_undegraded":"2023-08-25T04:43:44.327840+0000","last_fullsized":"2023-08-25T04:43:44.327840+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:34:31.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874669+0000","last_change":"2023-08-25T04:43:41.884839+0000","last_active":"2023-08-25T04:43:43.874669+0000","last_peered":"2023-08-25T04:43:43.874669+0000","last_clean":"2023-08-25T04:43:43.874669+0000","last_became_active":"2023-08-25T04:43:41.884535+0000","last_became_peered":"2023-08-25T04:43:41.884535+0000","last_unstale":"2023-08-25T04:43:43.874669+0000","last_undegraded":"2023-08-25T04:43:43.874669+0000","last_fullsized":"2023-08-25T04:43:43.874669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:19.036840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873817+0000","last_change":"2023-08-25T04:43:42.903007+0000","last_active":"2023-08-25T04:43:43.873817+0000","last_peered":"2023-08-25T04:43:43.873817+0000","last_clean":"2023-08-25T04:43:43.873817+0000","last_became_active":"2023-08-25T04:43:42.902721+0000","last_became_peered":"2023-08-25T04:43:42.902721+0000","last_unstale":"2023-08-25T04:43:43.873817+0000","last_undegraded":"2023-08-25T04:43:43.873817+0000","last_fullsized":"2023-08-25T04:43:43.873817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:31.303608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328239+0000","last_change":"2023-08-25T04:43:41.889969+0000","last_active":"2023-08-25T04:43:44.328239+0000","last_peered":"2023-08-25T04:43:44.328239+0000","last_clean":"2023-08-25T04:43:44.328239+0000","last_became_active":"2023-08-25T04:43:41.889659+0000","last_became_peered":"2023-08-25T04:43:41.889659+0000","last_unstale":"2023-08-25T04:43:44.328239+0000","last_undegraded":"2023-08-25T04:43:44.328239+0000","last_fullsized":"2023-08-25T04:43:44.328239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:24.582793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327415+0000","last_change":"2023-08-25T04:43:42.894953+0000","last_active":"2023-08-25T04:43:44.327415+0000","last_peered":"2023-08-25T04:43:44.327415+0000","last_clean":"2023-08-25T04:43:44.327415+0000","last_became_active":"2023-08-25T04:43:42.894618+0000","last_became_peered":"2023-08-25T04:43:42.894618+0000","last_unstale":"2023-08-25T04:43:44.327415+0000","last_undegraded":"2023-08-25T04:43:44.327415+0000","last_fullsized":"2023-08-25T04:43:44.327415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:55.404819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874488+0000","last_change":"2023-08-25T04:43:41.886470+0000","last_active":"2023-08-25T04:43:43.874488+0000","last_peered":"2023-08-25T04:43:43.874488+0000","last_clean":"2023-08-25T04:43:43.874488+0000","last_became_active":"2023-08-25T04:43:41.886063+0000","last_became_peered":"2023-08-25T04:43:41.886063+0000","last_unstale":"2023-08-25T04:43:43.874488+0000","last_undegraded":"2023-08-25T04:43:43.874488+0000","last_fullsized":"2023-08-25T04:43:43.874488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:37.401035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327631+0000","last_change":"2023-08-25T04:43:42.900475+0000","last_active":"2023-08-25T04:43:44.327631+0000","last_peered":"2023-08-25T04:43:44.327631+0000","last_clean":"2023-08-25T04:43:44.327631+0000","last_became_active":"2023-08-25T04:43:42.900135+0000","last_became_peered":"2023-08-25T04:43:42.900135+0000","last_unstale":"2023-08-25T04:43:44.327631+0000","last_undegraded":"2023-08-25T04:43:44.327631+0000","last_fullsized":"2023-08-25T04:43:44.327631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:20.041960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874794+0000","last_change":"2023-08-25T04:43:41.891609+0000","last_active":"2023-08-25T04:43:43.874794+0000","last_peered":"2023-08-25T04:43:43.874794+0000","last_clean":"2023-08-25T04:43:43.874794+0000","last_became_active":"2023-08-25T04:43:41.891306+0000","last_became_peered":"2023-08-25T04:43:41.891306+0000","last_unstale":"2023-08-25T04:43:43.874794+0000","last_undegraded":"2023-08-25T04:43:43.874794+0000","last_fullsized":"2023-08-25T04:43:43.874794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:40.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328451+0000","last_change":"2023-08-25T04:43:42.894647+0000","last_active":"2023-08-25T04:43:44.328451+0000","last_peered":"2023-08-25T04:43:44.328451+0000","last_clean":"2023-08-25T04:43:44.328451+0000","last_became_active":"2023-08-25T04:43:42.894386+0000","last_became_peered":"2023-08-25T04:43:42.894386+0000","last_unstale":"2023-08-25T04:43:44.328451+0000","last_undegraded":"2023-08-25T04:43:44.328451+0000","last_fullsized":"2023-08-25T04:43:44.328451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:37.175484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875135+0000","last_change":"2023-08-25T04:43:41.893331+0000","last_active":"2023-08-25T04:43:43.875135+0000","last_peered":"2023-08-25T04:43:43.875135+0000","last_clean":"2023-08-25T04:43:43.875135+0000","last_became_active":"2023-08-25T04:43:41.892929+0000","last_became_peered":"2023-08-25T04:43:41.892929+0000","last_unstale":"2023-08-25T04:43:43.875135+0000","last_undegraded":"2023-08-25T04:43:43.875135+0000","last_fullsized":"2023-08-25T04:43:43.875135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:13.278697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875244+0000","last_change":"2023-08-25T04:43:42.894553+0000","last_active":"2023-08-25T04:43:43.875244+0000","last_peered":"2023-08-25T04:43:43.875244+0000","last_clean":"2023-08-25T04:43:43.875244+0000","last_became_active":"2023-08-25T04:43:42.894239+0000","last_became_peered":"2023-08-25T04:43:42.894239+0000","last_unstale":"2023-08-25T04:43:43.875244+0000","last_undegraded":"2023-08-25T04:43:43.875244+0000","last_fullsized":"2023-08-25T04:43:43.875244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:27.266322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327794+0000","last_change":"2023-08-25T04:43:41.883254+0000","last_active":"2023-08-25T04:43:44.327794+0000","last_peered":"2023-08-25T04:43:44.327794+0000","last_clean":"2023-08-25T04:43:44.327794+0000","last_became_active":"2023-08-25T04:43:41.882756+0000","last_became_peered":"2023-08-25T04:43:41.882756+0000","last_unstale":"2023-08-25T04:43:44.327794+0000","last_undegraded":"2023-08-25T04:43:44.327794+0000","last_fullsized":"2023-08-25T04:43:44.327794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:25.157829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327503+0000","last_change":"2023-08-25T04:43:42.895154+0000","last_active":"2023-08-25T04:43:44.327503+0000","last_peered":"2023-08-25T04:43:44.327503+0000","last_clean":"2023-08-25T04:43:44.327503+0000","last_became_active":"2023-08-25T04:43:42.894912+0000","last_became_peered":"2023-08-25T04:43:42.894912+0000","last_unstale":"2023-08-25T04:43:44.327503+0000","last_undegraded":"2023-08-25T04:43:44.327503+0000","last_fullsized":"2023-08-25T04:43:44.327503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:25.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327814+0000","last_change":"2023-08-25T04:43:42.893541+0000","last_active":"2023-08-25T04:43:44.327814+0000","last_peered":"2023-08-25T04:43:44.327814+0000","last_clean":"2023-08-25T04:43:44.327814+0000","last_became_active":"2023-08-25T04:43:42.893255+0000","last_became_peered":"2023-08-25T04:43:42.893255+0000","last_unstale":"2023-08-25T04:43:44.327814+0000","last_undegraded":"2023-08-25T04:43:44.327814+0000","last_fullsized":"2023-08-25T04:43:44.327814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:31:35.265544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874788+0000","last_change":"2023-08-25T04:43:42.897868+0000","last_active":"2023-08-25T04:43:43.874788+0000","last_peered":"2023-08-25T04:43:43.874788+0000","last_clean":"2023-08-25T04:43:43.874788+0000","last_became_active":"2023-08-25T04:43:42.897394+0000","last_became_peered":"2023-08-25T04:43:42.897394+0000","last_unstale":"2023-08-25T04:43:43.874788+0000","last_undegraded":"2023-08-25T04:43:43.874788+0000","last_fullsized":"2023-08-25T04:43:43.874788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:25.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327937+0000","last_change":"2023-08-25T04:43:42.894698+0000","last_active":"2023-08-25T04:43:44.327937+0000","last_peered":"2023-08-25T04:43:44.327937+0000","last_clean":"2023-08-25T04:43:44.327937+0000","last_became_active":"2023-08-25T04:43:42.894176+0000","last_became_peered":"2023-08-25T04:43:42.894176+0000","last_unstale":"2023-08-25T04:43:44.327937+0000","last_undegraded":"2023-08-25T04:43:44.327937+0000","last_fullsized":"2023-08-25T04:43:44.327937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:52.451365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875112+0000","last_change":"2023-08-25T04:43:42.899435+0000","last_active":"2023-08-25T04:43:43.875112+0000","last_peered":"2023-08-25T04:43:43.875112+0000","last_clean":"2023-08-25T04:43:43.875112+0000","last_became_active":"2023-08-25T04:43:42.898842+0000","last_became_peered":"2023-08-25T04:43:42.898842+0000","last_unstale":"2023-08-25T04:43:43.875112+0000","last_undegraded":"2023-08-25T04:43:43.875112+0000","last_fullsized":"2023-08-25T04:43:43.875112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:16.589145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873681+0000","last_change":"2023-08-25T04:43:42.890136+0000","last_active":"2023-08-25T04:43:43.873681+0000","last_peered":"2023-08-25T04:43:43.873681+0000","last_clean":"2023-08-25T04:43:43.873681+0000","last_became_active":"2023-08-25T04:43:42.889849+0000","last_became_peered":"2023-08-25T04:43:42.889849+0000","last_unstale":"2023-08-25T04:43:43.873681+0000","last_undegraded":"2023-08-25T04:43:43.873681+0000","last_fullsized":"2023-08-25T04:43:43.873681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:26.162949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":671295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":669467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":78720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.571}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6539999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4580000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:43:51.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:43:52.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.047+0000 7fd27f97d700 1 Processor -- start 2023-08-25T04:43:52.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.047+0000 7fd27f97d700 1 -- start start 2023-08-25T04:43:52.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.048+0000 7fd27f97d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd2780caf10 0x7fd2780cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.048+0000 7fd27f97d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd278070eb0 0x7fd2780ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.048+0000 7fd27f97d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2780cbfe0 con 0x7fd2780cc830 2023-08-25T04:43:52.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.048+0000 7fd27f97d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2780cb3d0 con 0x7fd278070eb0 2023-08-25T04:43:52.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.048+0000 7fd27f97d700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2780cb6b0 con 0x7fd2780caf10 2023-08-25T04:43:52.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.048+0000 7fd27df1a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd278070eb0 0x7fd2780ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.048+0000 7fd27d719700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd2780cc830 0x7fd2780ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39922/0 (socket says 172.21.15.16:39922) 2023-08-25T04:43:52.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.048+0000 7fd27d719700 1 -- 172.21.15.16:0/2889509240 learned_addr learned my addr 172.21.15.16:0/2889509240 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:52.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.049+0000 7fd27cf18700 1 --2- 172.21.15.16:0/2889509240 >> v2:172.21.15.117:3300/0 conn(0x7fd2780caf10 0x7fd2780cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.049+0000 7fd27df1a700 1 -- 172.21.15.16:0/2889509240 >> v2:172.21.15.117:3300/0 conn(0x7fd2780caf10 msgr2=0x7fd2780cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:52.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.049+0000 7fd27df1a700 1 --2- 172.21.15.16:0/2889509240 >> v2:172.21.15.117:3300/0 conn(0x7fd2780caf10 0x7fd2780cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.049+0000 7fd27df1a700 1 -- 172.21.15.16:0/2889509240 >> v1:172.21.15.16:6789/0 conn(0x7fd2780cc830 legacy=0x7fd2780ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:52.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.049+0000 7fd26ffff700 1 -- 172.21.15.16:0/2889509240 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669618741 0 0) 0x7fd2780cbfe0 con 0x7fd2780cc830 2023-08-25T04:43:52.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.049+0000 7fd27df1a700 1 -- 172.21.15.16:0/2889509240 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780cb990 con 0x7fd278070eb0 2023-08-25T04:43:52.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.049+0000 7fd27df1a700 1 --2- 172.21.15.16:0/2889509240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd278070eb0 0x7fd2780ce2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd2780cac80 tx=0x7fd27000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d511e72bc15ffd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:52.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.049+0000 7fd26ffff700 1 -- 172.21.15.16:0/2889509240 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27000e070 con 0x7fd278070eb0 2023-08-25T04:43:52.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.049+0000 7fd26ffff700 1 -- 172.21.15.16:0/2889509240 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27000bb20 con 0x7fd278070eb0 2023-08-25T04:43:52.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.049+0000 7fd26ffff700 1 -- 172.21.15.16:0/2889509240 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270012430 con 0x7fd278070eb0 2023-08-25T04:43:52.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.050+0000 7fd27f97d700 1 -- 172.21.15.16:0/2889509240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd278070eb0 msgr2=0x7fd2780ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:52.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.050+0000 7fd27f97d700 1 --2- 172.21.15.16:0/2889509240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd278070eb0 0x7fd2780ce2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd2780cac80 tx=0x7fd27000b330 comp rx=0 tx=0).stop 2023-08-25T04:43:52.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.050+0000 7fd27f97d700 1 -- 172.21.15.16:0/2889509240 shutdown_connections 2023-08-25T04:43:52.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.050+0000 7fd27f97d700 1 --2- 172.21.15.16:0/2889509240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd278070eb0 0x7fd2780ce2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.050+0000 7fd27f97d700 1 --2- 172.21.15.16:0/2889509240 >> v2:172.21.15.117:3300/0 conn(0x7fd2780caf10 0x7fd2780cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.050+0000 7fd27f97d700 1 -- 172.21.15.16:0/2889509240 >> 172.21.15.16:0/2889509240 conn(0x7fd2780b1a10 msgr2=0x7fd2780b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.050+0000 7fd27f97d700 1 -- 172.21.15.16:0/2889509240 shutdown_connections 2023-08-25T04:43:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.050+0000 7fd27f97d700 1 -- 172.21.15.16:0/2889509240 wait complete. 2023-08-25T04:43:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.051+0000 7fd27f97d700 1 Processor -- start 2023-08-25T04:43:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.051+0000 7fd27f97d700 1 -- start start 2023-08-25T04:43:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27f97d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd278070eb0 0x7fd27814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27f97d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2780caf10 0x7fd2780b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27f97d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2780cc830 0x7fd2781f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27f97d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27814d8f0 con 0x7fd2780cc830 2023-08-25T04:43:52.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27f97d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780b2a50 con 0x7fd278070eb0 2023-08-25T04:43:52.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27f97d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27815a9e0 con 0x7fd2780caf10 2023-08-25T04:43:52.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27df1a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2780cc830 0x7fd2781f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27df1a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2780cc830 0x7fd2781f2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49518/0 (socket says 172.21.15.16:49518) 2023-08-25T04:43:52.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27df1a700 1 -- 172.21.15.16:0/1545484647 learned_addr learned my addr 172.21.15.16:0/1545484647 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:52.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27cf18700 1 --2- 172.21.15.16:0/1545484647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2780caf10 0x7fd2780b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27d719700 1 --2- 172.21.15.16:0/1545484647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd278070eb0 0x7fd27814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27df1a700 1 -- 172.21.15.16:0/1545484647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2780caf10 msgr2=0x7fd2780b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:52.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27df1a700 1 --2- 172.21.15.16:0/1545484647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2780caf10 0x7fd2780b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27df1a700 1 -- 172.21.15.16:0/1545484647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd278070eb0 msgr2=0x7fd27814d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:52.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27df1a700 1 --2- 172.21.15.16:0/1545484647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd278070eb0 0x7fd27814d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27df1a700 1 -- 172.21.15.16:0/1545484647 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd270009a70 con 0x7fd2780cc830 2023-08-25T04:43:52.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27df1a700 1 --2- 172.21.15.16:0/1545484647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2780cc830 0x7fd2781f2c80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd27806cc80 tx=0x7fd270004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:52.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd26dffb700 1 -- 172.21.15.16:0/1545484647 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270020070 con 0x7fd2780cc830 2023-08-25T04:43:52.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd26dffb700 1 -- 172.21.15.16:0/1545484647 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2700098f0 con 0x7fd2780cc830 2023-08-25T04:43:52.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd27f97d700 1 -- 172.21.15.16:0/1545484647 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2780b2820 con 0x7fd2780cc830 2023-08-25T04:43:52.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.052+0000 7fd26dffb700 1 -- 172.21.15.16:0/1545484647 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270012430 con 0x7fd2780cc830 2023-08-25T04:43:52.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.053+0000 7fd27f97d700 1 -- 172.21.15.16:0/1545484647 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27815aed0 con 0x7fd2780cc830 2023-08-25T04:43:52.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.054+0000 7fd27f97d700 1 -- 172.21.15.16:0/1545484647 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27804ee70 con 0x7fd2780cc830 2023-08-25T04:43:52.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.054+0000 7fd26dffb700 1 -- 172.21.15.16:0/1545484647 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd270024070 con 0x7fd2780cc830 2023-08-25T04:43:52.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.054+0000 7fd26dffb700 1 --2- 172.21.15.16:0/1545484647 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd25c06a0e0 0x7fd25c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.054+0000 7fd26dffb700 1 -- 172.21.15.16:0/1545484647 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd27008b2f0 con 0x7fd2780cc830 2023-08-25T04:43:52.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.055+0000 7fd27d719700 1 --2- 172.21.15.16:0/1545484647 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd25c06a0e0 0x7fd25c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.055+0000 7fd27d719700 1 --2- 172.21.15.16:0/1545484647 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd25c06a0e0 0x7fd25c06c5a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd268000f60 tx=0x7fd268007e70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:52.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.059+0000 7fd26dffb700 1 -- 172.21.15.16:0/1545484647 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd2700569d0 con 0x7fd2780cc830 2023-08-25T04:43:52.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.257+0000 7fd27f97d700 1 -- 172.21.15.16:0/1545484647 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2780cbc70 con 0x7fd25c06a0e0 2023-08-25T04:43:52.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.265+0000 7fd26dffb700 1 -- 172.21.15.16:0/1545484647 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286908 (secure 0 0 0) 0x7fd268001290 con 0x7fd25c06a0e0 2023-08-25T04:43:52.269 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:52.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.268+0000 7fd27f97d700 1 -- 172.21.15.16:0/1545484647 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd25c06a0e0 msgr2=0x7fd25c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:52.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.268+0000 7fd27f97d700 1 --2- 172.21.15.16:0/1545484647 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd25c06a0e0 0x7fd25c06c5a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd268000f60 tx=0x7fd268007e70 comp rx=0 tx=0).stop 2023-08-25T04:43:52.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.268+0000 7fd27f97d700 1 -- 172.21.15.16:0/1545484647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2780cc830 msgr2=0x7fd2781f2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:52.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.268+0000 7fd27f97d700 1 --2- 172.21.15.16:0/1545484647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2780cc830 0x7fd2781f2c80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd27806cc80 tx=0x7fd270004ad0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.268+0000 7fd27f97d700 1 -- 172.21.15.16:0/1545484647 shutdown_connections 2023-08-25T04:43:52.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.268+0000 7fd27f97d700 1 --2- 172.21.15.16:0/1545484647 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd25c06a0e0 0x7fd25c06c5a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.268+0000 7fd27f97d700 1 --2- 172.21.15.16:0/1545484647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2780cc830 0x7fd2781f2c80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.268+0000 7fd27f97d700 1 --2- 172.21.15.16:0/1545484647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd278070eb0 0x7fd27814d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.268+0000 7fd27f97d700 1 --2- 172.21.15.16:0/1545484647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2780caf10 0x7fd2780b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.268+0000 7fd27f97d700 1 -- 172.21.15.16:0/1545484647 >> 172.21.15.16:0/1545484647 conn(0x7fd2780b1a10 msgr2=0x7fd278157770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:52.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.268+0000 7fd27f97d700 1 -- 172.21.15.16:0/1545484647 shutdown_connections 2023-08-25T04:43:52.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.268+0000 7fd27f97d700 1 -- 172.21.15.16:0/1545484647 wait complete. 2023-08-25T04:43:52.272 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-08-25T04:43:52.281 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-25T04:43:51.307827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219140,"kb_used_data":2916,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755580,"statfs":{"total":773094113280,"available":772869713920,"internally_reserved":0,"allocated":2985984,"data_stored":1817387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.434461"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327803+0000","last_change":"2023-08-25T04:43:42.895145+0000","last_active":"2023-08-25T04:43:44.327803+0000","last_peered":"2023-08-25T04:43:44.327803+0000","last_clean":"2023-08-25T04:43:44.327803+0000","last_became_active":"2023-08-25T04:43:42.894831+0000","last_became_peered":"2023-08-25T04:43:42.894831+0000","last_unstale":"2023-08-25T04:43:44.327803+0000","last_undegraded":"2023-08-25T04:43:44.327803+0000","last_fullsized":"2023-08-25T04:43:44.327803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:14:14.705163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874604+0000","last_change":"2023-08-25T04:43:42.895503+0000","last_active":"2023-08-25T04:43:43.874604+0000","last_peered":"2023-08-25T04:43:43.874604+0000","last_clean":"2023-08-25T04:43:43.874604+0000","last_became_active":"2023-08-25T04:43:42.895245+0000","last_became_peered":"2023-08-25T04:43:42.895245+0000","last_unstale":"2023-08-25T04:43:43.874604+0000","last_undegraded":"2023-08-25T04:43:43.874604+0000","last_fullsized":"2023-08-25T04:43:43.874604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:15.216169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327984+0000","last_change":"2023-08-25T04:43:42.888920+0000","last_active":"2023-08-25T04:43:44.327984+0000","last_peered":"2023-08-25T04:43:44.327984+0000","last_clean":"2023-08-25T04:43:44.327984+0000","last_became_active":"2023-08-25T04:43:42.888568+0000","last_became_peered":"2023-08-25T04:43:42.888568+0000","last_unstale":"2023-08-25T04:43:44.327984+0000","last_undegraded":"2023-08-25T04:43:44.327984+0000","last_fullsized":"2023-08-25T04:43:44.327984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:16.589145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328061+0000","last_change":"2023-08-25T04:43:42.893868+0000","last_active":"2023-08-25T04:43:44.328061+0000","last_peered":"2023-08-25T04:43:44.328061+0000","last_clean":"2023-08-25T04:43:44.328061+0000","last_became_active":"2023-08-25T04:43:42.893534+0000","last_became_peered":"2023-08-25T04:43:42.893534+0000","last_unstale":"2023-08-25T04:43:44.328061+0000","last_undegraded":"2023-08-25T04:43:44.328061+0000","last_fullsized":"2023-08-25T04:43:44.328061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:31.303608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328282+0000","last_change":"2023-08-25T04:43:42.902297+0000","last_active":"2023-08-25T04:43:44.328282+0000","last_peered":"2023-08-25T04:43:44.328282+0000","last_clean":"2023-08-25T04:43:44.328282+0000","last_became_active":"2023-08-25T04:43:42.901963+0000","last_became_peered":"2023-08-25T04:43:42.901963+0000","last_unstale":"2023-08-25T04:43:44.328282+0000","last_undegraded":"2023-08-25T04:43:44.328282+0000","last_fullsized":"2023-08-25T04:43:44.328282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328304+0000","last_change":"2023-08-25T04:43:42.888877+0000","last_active":"2023-08-25T04:43:44.328304+0000","last_peered":"2023-08-25T04:43:44.328304+0000","last_clean":"2023-08-25T04:43:44.328304+0000","last_became_active":"2023-08-25T04:43:42.888567+0000","last_became_peered":"2023-08-25T04:43:42.888567+0000","last_unstale":"2023-08-25T04:43:44.328304+0000","last_undegraded":"2023-08-25T04:43:44.328304+0000","last_fullsized":"2023-08-25T04:43:44.328304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:32:00.413218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032871+0000","last_change":"2023-08-25T04:43:42.902469+0000","last_active":"2023-08-25T04:43:44.032871+0000","last_peered":"2023-08-25T04:43:44.032871+0000","last_clean":"2023-08-25T04:43:44.032871+0000","last_became_active":"2023-08-25T04:43:42.902156+0000","last_became_peered":"2023-08-25T04:43:42.902156+0000","last_unstale":"2023-08-25T04:43:44.032871+0000","last_undegraded":"2023-08-25T04:43:44.032871+0000","last_fullsized":"2023-08-25T04:43:44.032871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874207+0000","last_change":"2023-08-25T04:43:42.895697+0000","last_active":"2023-08-25T04:43:43.874207+0000","last_peered":"2023-08-25T04:43:43.874207+0000","last_clean":"2023-08-25T04:43:43.874207+0000","last_became_active":"2023-08-25T04:43:42.895410+0000","last_became_peered":"2023-08-25T04:43:42.895410+0000","last_unstale":"2023-08-25T04:43:43.874207+0000","last_undegraded":"2023-08-25T04:43:43.874207+0000","last_fullsized":"2023-08-25T04:43:43.874207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:31.303608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327641+0000","last_change":"2023-08-25T04:43:42.897483+0000","last_active":"2023-08-25T04:43:44.327641+0000","last_peered":"2023-08-25T04:43:44.327641+0000","last_clean":"2023-08-25T04:43:44.327641+0000","last_became_active":"2023-08-25T04:43:42.896949+0000","last_became_peered":"2023-08-25T04:43:42.896949+0000","last_unstale":"2023-08-25T04:43:44.327641+0000","last_undegraded":"2023-08-25T04:43:44.327641+0000","last_fullsized":"2023-08-25T04:43:44.327641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:31:35.265544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874624+0000","last_change":"2023-08-25T04:43:42.895115+0000","last_active":"2023-08-25T04:43:43.874624+0000","last_peered":"2023-08-25T04:43:43.874624+0000","last_clean":"2023-08-25T04:43:43.874624+0000","last_became_active":"2023-08-25T04:43:42.894786+0000","last_became_peered":"2023-08-25T04:43:42.894786+0000","last_unstale":"2023-08-25T04:43:43.874624+0000","last_undegraded":"2023-08-25T04:43:43.874624+0000","last_fullsized":"2023-08-25T04:43:43.874624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:25.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328212+0000","last_change":"2023-08-25T04:43:42.892793+0000","last_active":"2023-08-25T04:43:44.328212+0000","last_peered":"2023-08-25T04:43:44.328212+0000","last_clean":"2023-08-25T04:43:44.328212+0000","last_became_active":"2023-08-25T04:43:42.892558+0000","last_became_peered":"2023-08-25T04:43:42.892558+0000","last_unstale":"2023-08-25T04:43:44.328212+0000","last_undegraded":"2023-08-25T04:43:44.328212+0000","last_fullsized":"2023-08-25T04:43:44.328212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:03.096619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327734+0000","last_change":"2023-08-25T04:43:42.892113+0000","last_active":"2023-08-25T04:43:44.327734+0000","last_peered":"2023-08-25T04:43:44.327734+0000","last_clean":"2023-08-25T04:43:44.327734+0000","last_became_active":"2023-08-25T04:43:42.891782+0000","last_became_peered":"2023-08-25T04:43:42.891782+0000","last_unstale":"2023-08-25T04:43:44.327734+0000","last_undegraded":"2023-08-25T04:43:44.327734+0000","last_fullsized":"2023-08-25T04:43:44.327734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:24:49.974531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327765+0000","last_change":"2023-08-25T04:43:42.896635+0000","last_active":"2023-08-25T04:43:44.327765+0000","last_peered":"2023-08-25T04:43:44.327765+0000","last_clean":"2023-08-25T04:43:44.327765+0000","last_became_active":"2023-08-25T04:43:42.896334+0000","last_became_peered":"2023-08-25T04:43:42.896334+0000","last_unstale":"2023-08-25T04:43:44.327765+0000","last_undegraded":"2023-08-25T04:43:44.327765+0000","last_fullsized":"2023-08-25T04:43:44.327765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:56:24.754587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874371+0000","last_change":"2023-08-25T04:43:42.894765+0000","last_active":"2023-08-25T04:43:43.874371+0000","last_peered":"2023-08-25T04:43:43.874371+0000","last_clean":"2023-08-25T04:43:43.874371+0000","last_became_active":"2023-08-25T04:43:42.894472+0000","last_became_peered":"2023-08-25T04:43:42.894472+0000","last_unstale":"2023-08-25T04:43:43.874371+0000","last_undegraded":"2023-08-25T04:43:43.874371+0000","last_fullsized":"2023-08-25T04:43:43.874371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:10.669970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033055+0000","last_change":"2023-08-25T04:43:42.902458+0000","last_active":"2023-08-25T04:43:44.033055+0000","last_peered":"2023-08-25T04:43:44.033055+0000","last_clean":"2023-08-25T04:43:44.033055+0000","last_became_active":"2023-08-25T04:43:42.902184+0000","last_became_peered":"2023-08-25T04:43:42.902184+0000","last_unstale":"2023-08-25T04:43:44.033055+0000","last_undegraded":"2023-08-25T04:43:44.033055+0000","last_fullsized":"2023-08-25T04:43:44.033055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:14.283818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327581+0000","last_change":"2023-08-25T04:43:42.889087+0000","last_active":"2023-08-25T04:43:44.327581+0000","last_peered":"2023-08-25T04:43:44.327581+0000","last_clean":"2023-08-25T04:43:44.327581+0000","last_became_active":"2023-08-25T04:43:42.888730+0000","last_became_peered":"2023-08-25T04:43:42.888730+0000","last_unstale":"2023-08-25T04:43:44.327581+0000","last_undegraded":"2023-08-25T04:43:44.327581+0000","last_fullsized":"2023-08-25T04:43:44.327581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327697+0000","last_change":"2023-08-25T04:43:42.898466+0000","last_active":"2023-08-25T04:43:44.327697+0000","last_peered":"2023-08-25T04:43:44.327697+0000","last_clean":"2023-08-25T04:43:44.327697+0000","last_became_active":"2023-08-25T04:43:42.898103+0000","last_became_peered":"2023-08-25T04:43:42.898103+0000","last_unstale":"2023-08-25T04:43:44.327697+0000","last_undegraded":"2023-08-25T04:43:44.327697+0000","last_fullsized":"2023-08-25T04:43:44.327697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.713590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328356+0000","last_change":"2023-08-25T04:43:42.892153+0000","last_active":"2023-08-25T04:43:44.328356+0000","last_peered":"2023-08-25T04:43:44.328356+0000","last_clean":"2023-08-25T04:43:44.328356+0000","last_became_active":"2023-08-25T04:43:42.891874+0000","last_became_peered":"2023-08-25T04:43:42.891874+0000","last_unstale":"2023-08-25T04:43:44.328356+0000","last_undegraded":"2023-08-25T04:43:44.328356+0000","last_fullsized":"2023-08-25T04:43:44.328356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:23:15.219642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327457+0000","last_change":"2023-08-25T04:43:42.895594+0000","last_active":"2023-08-25T04:43:44.327457+0000","last_peered":"2023-08-25T04:43:44.327457+0000","last_clean":"2023-08-25T04:43:44.327457+0000","last_became_active":"2023-08-25T04:43:42.895114+0000","last_became_peered":"2023-08-25T04:43:42.895114+0000","last_unstale":"2023-08-25T04:43:44.327457+0000","last_undegraded":"2023-08-25T04:43:44.327457+0000","last_fullsized":"2023-08-25T04:43:44.327457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:16:14.273348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328271+0000","last_change":"2023-08-25T04:43:42.896149+0000","last_active":"2023-08-25T04:43:44.328271+0000","last_peered":"2023-08-25T04:43:44.328271+0000","last_clean":"2023-08-25T04:43:44.328271+0000","last_became_active":"2023-08-25T04:43:42.895893+0000","last_became_peered":"2023-08-25T04:43:42.895893+0000","last_unstale":"2023-08-25T04:43:44.328271+0000","last_undegraded":"2023-08-25T04:43:44.328271+0000","last_fullsized":"2023-08-25T04:43:44.328271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:40.101990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033178+0000","last_change":"2023-08-25T04:43:42.905467+0000","last_active":"2023-08-25T04:43:44.033178+0000","last_peered":"2023-08-25T04:43:44.033178+0000","last_clean":"2023-08-25T04:43:44.033178+0000","last_became_active":"2023-08-25T04:43:42.905157+0000","last_became_peered":"2023-08-25T04:43:42.905157+0000","last_unstale":"2023-08-25T04:43:44.033178+0000","last_undegraded":"2023-08-25T04:43:44.033178+0000","last_fullsized":"2023-08-25T04:43:44.033178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:27.309119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327693+0000","last_change":"2023-08-25T04:43:42.881107+0000","last_active":"2023-08-25T04:43:44.327693+0000","last_peered":"2023-08-25T04:43:44.327693+0000","last_clean":"2023-08-25T04:43:44.327693+0000","last_became_active":"2023-08-25T04:43:42.879881+0000","last_became_peered":"2023-08-25T04:43:42.879881+0000","last_unstale":"2023-08-25T04:43:44.327693+0000","last_undegraded":"2023-08-25T04:43:44.327693+0000","last_fullsized":"2023-08-25T04:43:44.327693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:31.030985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874763+0000","last_change":"2023-08-25T04:43:42.899035+0000","last_active":"2023-08-25T04:43:43.874763+0000","last_peered":"2023-08-25T04:43:43.874763+0000","last_clean":"2023-08-25T04:43:43.874763+0000","last_became_active":"2023-08-25T04:43:42.898723+0000","last_became_peered":"2023-08-25T04:43:42.898723+0000","last_unstale":"2023-08-25T04:43:43.874763+0000","last_undegraded":"2023-08-25T04:43:43.874763+0000","last_fullsized":"2023-08-25T04:43:43.874763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:15.216169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032883+0000","last_change":"2023-08-25T04:43:42.897136+0000","last_active":"2023-08-25T04:43:44.032883+0000","last_peered":"2023-08-25T04:43:44.032883+0000","last_clean":"2023-08-25T04:43:44.032883+0000","last_became_active":"2023-08-25T04:43:42.896869+0000","last_became_peered":"2023-08-25T04:43:42.896869+0000","last_unstale":"2023-08-25T04:43:44.032883+0000","last_undegraded":"2023-08-25T04:43:44.032883+0000","last_fullsized":"2023-08-25T04:43:44.032883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873831+0000","last_change":"2023-08-25T04:43:42.893954+0000","last_active":"2023-08-25T04:43:43.873831+0000","last_peered":"2023-08-25T04:43:43.873831+0000","last_clean":"2023-08-25T04:43:43.873831+0000","last_became_active":"2023-08-25T04:43:42.893673+0000","last_became_peered":"2023-08-25T04:43:42.893673+0000","last_unstale":"2023-08-25T04:43:43.873831+0000","last_undegraded":"2023-08-25T04:43:43.873831+0000","last_fullsized":"2023-08-25T04:43:43.873831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:10.669970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873872+0000","last_change":"2023-08-25T04:43:42.888116+0000","last_active":"2023-08-25T04:43:43.873872+0000","last_peered":"2023-08-25T04:43:43.873872+0000","last_clean":"2023-08-25T04:43:43.873872+0000","last_became_active":"2023-08-25T04:43:42.887831+0000","last_became_peered":"2023-08-25T04:43:42.887831+0000","last_unstale":"2023-08-25T04:43:43.873872+0000","last_undegraded":"2023-08-25T04:43:43.873872+0000","last_fullsized":"2023-08-25T04:43:43.873872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:38.406155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874487+0000","last_change":"2023-08-25T04:43:42.894954+0000","last_active":"2023-08-25T04:43:43.874487+0000","last_peered":"2023-08-25T04:43:43.874487+0000","last_clean":"2023-08-25T04:43:43.874487+0000","last_became_active":"2023-08-25T04:43:42.894302+0000","last_became_peered":"2023-08-25T04:43:42.894302+0000","last_unstale":"2023-08-25T04:43:43.874487+0000","last_undegraded":"2023-08-25T04:43:43.874487+0000","last_fullsized":"2023-08-25T04:43:43.874487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:49.188528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328143+0000","last_change":"2023-08-25T04:43:41.888584+0000","last_active":"2023-08-25T04:43:44.328143+0000","last_peered":"2023-08-25T04:43:44.328143+0000","last_clean":"2023-08-25T04:43:44.328143+0000","last_became_active":"2023-08-25T04:43:41.888339+0000","last_became_peered":"2023-08-25T04:43:41.888339+0000","last_unstale":"2023-08-25T04:43:44.328143+0000","last_undegraded":"2023-08-25T04:43:44.328143+0000","last_fullsized":"2023-08-25T04:43:44.328143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:17.587860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874994+0000","last_change":"2023-08-25T04:43:42.897739+0000","last_active":"2023-08-25T04:43:43.874994+0000","last_peered":"2023-08-25T04:43:43.874994+0000","last_clean":"2023-08-25T04:43:43.874994+0000","last_became_active":"2023-08-25T04:43:42.897425+0000","last_became_peered":"2023-08-25T04:43:42.897425+0000","last_unstale":"2023-08-25T04:43:43.874994+0000","last_undegraded":"2023-08-25T04:43:43.874994+0000","last_fullsized":"2023-08-25T04:43:43.874994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873410+0000","last_change":"2023-08-25T04:43:41.886122+0000","last_active":"2023-08-25T04:43:43.873410+0000","last_peered":"2023-08-25T04:43:43.873410+0000","last_clean":"2023-08-25T04:43:43.873410+0000","last_became_active":"2023-08-25T04:43:41.885184+0000","last_became_peered":"2023-08-25T04:43:41.885184+0000","last_unstale":"2023-08-25T04:43:43.873410+0000","last_undegraded":"2023-08-25T04:43:43.873410+0000","last_fullsized":"2023-08-25T04:43:43.873410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:30.025865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328069+0000","last_change":"2023-08-25T04:43:42.890854+0000","last_active":"2023-08-25T04:43:44.328069+0000","last_peered":"2023-08-25T04:43:44.328069+0000","last_clean":"2023-08-25T04:43:44.328069+0000","last_became_active":"2023-08-25T04:43:42.890575+0000","last_became_peered":"2023-08-25T04:43:42.890575+0000","last_unstale":"2023-08-25T04:43:44.328069+0000","last_undegraded":"2023-08-25T04:43:44.328069+0000","last_fullsized":"2023-08-25T04:43:44.328069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:49.188528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874877+0000","last_change":"2023-08-25T04:43:41.885567+0000","last_active":"2023-08-25T04:43:43.874877+0000","last_peered":"2023-08-25T04:43:43.874877+0000","last_clean":"2023-08-25T04:43:43.874877+0000","last_became_active":"2023-08-25T04:43:41.885299+0000","last_became_peered":"2023-08-25T04:43:41.885299+0000","last_unstale":"2023-08-25T04:43:43.874877+0000","last_undegraded":"2023-08-25T04:43:43.874877+0000","last_fullsized":"2023-08-25T04:43:43.874877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:19.036840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328008+0000","last_change":"2023-08-25T04:43:42.899190+0000","last_active":"2023-08-25T04:43:44.328008+0000","last_peered":"2023-08-25T04:43:44.328008+0000","last_clean":"2023-08-25T04:43:44.328008+0000","last_became_active":"2023-08-25T04:43:42.898874+0000","last_became_peered":"2023-08-25T04:43:42.898874+0000","last_unstale":"2023-08-25T04:43:44.328008+0000","last_undegraded":"2023-08-25T04:43:44.328008+0000","last_fullsized":"2023-08-25T04:43:44.328008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.713590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327795+0000","last_change":"2023-08-25T04:43:41.883055+0000","last_active":"2023-08-25T04:43:44.327795+0000","last_peered":"2023-08-25T04:43:44.327795+0000","last_clean":"2023-08-25T04:43:44.327795+0000","last_became_active":"2023-08-25T04:43:41.882381+0000","last_became_peered":"2023-08-25T04:43:41.882381+0000","last_unstale":"2023-08-25T04:43:44.327795+0000","last_undegraded":"2023-08-25T04:43:44.327795+0000","last_fullsized":"2023-08-25T04:43:44.327795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:30.298488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874811+0000","last_change":"2023-08-25T04:43:42.897118+0000","last_active":"2023-08-25T04:43:43.874811+0000","last_peered":"2023-08-25T04:43:43.874811+0000","last_clean":"2023-08-25T04:43:43.874811+0000","last_became_active":"2023-08-25T04:43:42.896817+0000","last_became_peered":"2023-08-25T04:43:42.896817+0000","last_unstale":"2023-08-25T04:43:43.874811+0000","last_undegraded":"2023-08-25T04:43:43.874811+0000","last_fullsized":"2023-08-25T04:43:43.874811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:27.901682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874464+0000","last_change":"2023-08-25T04:43:41.882339+0000","last_active":"2023-08-25T04:43:43.874464+0000","last_peered":"2023-08-25T04:43:43.874464+0000","last_clean":"2023-08-25T04:43:43.874464+0000","last_became_active":"2023-08-25T04:43:41.882055+0000","last_became_peered":"2023-08-25T04:43:41.882055+0000","last_unstale":"2023-08-25T04:43:43.874464+0000","last_undegraded":"2023-08-25T04:43:43.874464+0000","last_fullsized":"2023-08-25T04:43:43.874464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:58:07.396227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875270+0000","last_change":"2023-08-25T04:43:42.891741+0000","last_active":"2023-08-25T04:43:43.875270+0000","last_peered":"2023-08-25T04:43:43.875270+0000","last_clean":"2023-08-25T04:43:43.875270+0000","last_became_active":"2023-08-25T04:43:42.890100+0000","last_became_peered":"2023-08-25T04:43:42.890100+0000","last_unstale":"2023-08-25T04:43:43.875270+0000","last_undegraded":"2023-08-25T04:43:43.875270+0000","last_fullsized":"2023-08-25T04:43:43.875270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:03.096619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033307+0000","last_change":"2023-08-25T04:43:41.887924+0000","last_active":"2023-08-25T04:43:44.033307+0000","last_peered":"2023-08-25T04:43:44.033307+0000","last_clean":"2023-08-25T04:43:44.033307+0000","last_became_active":"2023-08-25T04:43:41.887622+0000","last_became_peered":"2023-08-25T04:43:41.887622+0000","last_unstale":"2023-08-25T04:43:44.033307+0000","last_undegraded":"2023-08-25T04:43:44.033307+0000","last_fullsized":"2023-08-25T04:43:44.033307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:26.261202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873335+0000","last_change":"2023-08-25T04:43:42.891006+0000","last_active":"2023-08-25T04:43:43.873335+0000","last_peered":"2023-08-25T04:43:43.873335+0000","last_clean":"2023-08-25T04:43:43.873335+0000","last_became_active":"2023-08-25T04:43:42.890648+0000","last_became_peered":"2023-08-25T04:43:42.890648+0000","last_unstale":"2023-08-25T04:43:43.873335+0000","last_undegraded":"2023-08-25T04:43:43.873335+0000","last_fullsized":"2023-08-25T04:43:43.873335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:03.819785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328264+0000","last_change":"2023-08-25T04:43:41.887033+0000","last_active":"2023-08-25T04:43:44.328264+0000","last_peered":"2023-08-25T04:43:44.328264+0000","last_clean":"2023-08-25T04:43:44.328264+0000","last_became_active":"2023-08-25T04:43:41.886491+0000","last_became_peered":"2023-08-25T04:43:41.886491+0000","last_unstale":"2023-08-25T04:43:44.328264+0000","last_undegraded":"2023-08-25T04:43:44.328264+0000","last_fullsized":"2023-08-25T04:43:44.328264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:58:33.572888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328258+0000","last_change":"2023-08-25T04:43:42.893709+0000","last_active":"2023-08-25T04:43:44.328258+0000","last_peered":"2023-08-25T04:43:44.328258+0000","last_clean":"2023-08-25T04:43:44.328258+0000","last_became_active":"2023-08-25T04:43:42.893525+0000","last_became_peered":"2023-08-25T04:43:42.893525+0000","last_unstale":"2023-08-25T04:43:44.328258+0000","last_undegraded":"2023-08-25T04:43:44.328258+0000","last_fullsized":"2023-08-25T04:43:44.328258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:58:52.209554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033093+0000","last_change":"2023-08-25T04:43:41.890946+0000","last_active":"2023-08-25T04:43:44.033093+0000","last_peered":"2023-08-25T04:43:44.033093+0000","last_clean":"2023-08-25T04:43:44.033093+0000","last_became_active":"2023-08-25T04:43:41.890673+0000","last_became_peered":"2023-08-25T04:43:41.890673+0000","last_unstale":"2023-08-25T04:43:44.033093+0000","last_undegraded":"2023-08-25T04:43:44.033093+0000","last_fullsized":"2023-08-25T04:43:44.033093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:38.571968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875163+0000","last_change":"2023-08-25T04:43:42.897809+0000","last_active":"2023-08-25T04:43:43.875163+0000","last_peered":"2023-08-25T04:43:43.875163+0000","last_clean":"2023-08-25T04:43:43.875163+0000","last_became_active":"2023-08-25T04:43:42.897204+0000","last_became_peered":"2023-08-25T04:43:42.897204+0000","last_unstale":"2023-08-25T04:43:43.875163+0000","last_undegraded":"2023-08-25T04:43:43.875163+0000","last_fullsized":"2023-08-25T04:43:43.875163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:27.309119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327671+0000","last_change":"2023-08-25T04:43:41.881387+0000","last_active":"2023-08-25T04:43:44.327671+0000","last_peered":"2023-08-25T04:43:44.327671+0000","last_clean":"2023-08-25T04:43:44.327671+0000","last_became_active":"2023-08-25T04:43:41.881067+0000","last_became_peered":"2023-08-25T04:43:41.881067+0000","last_unstale":"2023-08-25T04:43:44.327671+0000","last_undegraded":"2023-08-25T04:43:44.327671+0000","last_fullsized":"2023-08-25T04:43:44.327671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:34:36.120848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874683+0000","last_change":"2023-08-25T04:43:42.895088+0000","last_active":"2023-08-25T04:43:43.874683+0000","last_peered":"2023-08-25T04:43:43.874683+0000","last_clean":"2023-08-25T04:43:43.874683+0000","last_became_active":"2023-08-25T04:43:42.894807+0000","last_became_peered":"2023-08-25T04:43:42.894807+0000","last_unstale":"2023-08-25T04:43:43.874683+0000","last_undegraded":"2023-08-25T04:43:43.874683+0000","last_fullsized":"2023-08-25T04:43:43.874683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032938+0000","last_change":"2023-08-25T04:43:41.890995+0000","last_active":"2023-08-25T04:43:44.032938+0000","last_peered":"2023-08-25T04:43:44.032938+0000","last_clean":"2023-08-25T04:43:44.032938+0000","last_became_active":"2023-08-25T04:43:41.890706+0000","last_became_peered":"2023-08-25T04:43:41.890706+0000","last_unstale":"2023-08-25T04:43:44.032938+0000","last_undegraded":"2023-08-25T04:43:44.032938+0000","last_fullsized":"2023-08-25T04:43:44.032938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327738+0000","last_change":"2023-08-25T04:43:42.897775+0000","last_active":"2023-08-25T04:43:44.327738+0000","last_peered":"2023-08-25T04:43:44.327738+0000","last_clean":"2023-08-25T04:43:44.327738+0000","last_became_active":"2023-08-25T04:43:42.897476+0000","last_became_peered":"2023-08-25T04:43:42.897476+0000","last_unstale":"2023-08-25T04:43:44.327738+0000","last_undegraded":"2023-08-25T04:43:44.327738+0000","last_fullsized":"2023-08-25T04:43:44.327738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:03.819785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327483+0000","last_change":"2023-08-25T04:43:41.892829+0000","last_active":"2023-08-25T04:43:44.327483+0000","last_peered":"2023-08-25T04:43:44.327483+0000","last_clean":"2023-08-25T04:43:44.327483+0000","last_became_active":"2023-08-25T04:43:41.892517+0000","last_became_peered":"2023-08-25T04:43:41.892517+0000","last_unstale":"2023-08-25T04:43:44.327483+0000","last_undegraded":"2023-08-25T04:43:44.327483+0000","last_fullsized":"2023-08-25T04:43:44.327483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:40:01.170031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875239+0000","last_change":"2023-08-25T04:43:42.905276+0000","last_active":"2023-08-25T04:43:43.875239+0000","last_peered":"2023-08-25T04:43:43.875239+0000","last_clean":"2023-08-25T04:43:43.875239+0000","last_became_active":"2023-08-25T04:43:42.904736+0000","last_became_peered":"2023-08-25T04:43:42.904736+0000","last_unstale":"2023-08-25T04:43:43.875239+0000","last_undegraded":"2023-08-25T04:43:43.875239+0000","last_fullsized":"2023-08-25T04:43:43.875239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:18.592980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033419+0000","last_change":"2023-08-25T04:43:41.891246+0000","last_active":"2023-08-25T04:43:44.033419+0000","last_peered":"2023-08-25T04:43:44.033419+0000","last_clean":"2023-08-25T04:43:44.033419+0000","last_became_active":"2023-08-25T04:43:41.890942+0000","last_became_peered":"2023-08-25T04:43:41.890942+0000","last_unstale":"2023-08-25T04:43:44.033419+0000","last_undegraded":"2023-08-25T04:43:44.033419+0000","last_fullsized":"2023-08-25T04:43:44.033419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:39.096870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874433+0000","last_change":"2023-08-25T04:43:42.895071+0000","last_active":"2023-08-25T04:43:43.874433+0000","last_peered":"2023-08-25T04:43:43.874433+0000","last_clean":"2023-08-25T04:43:43.874433+0000","last_became_active":"2023-08-25T04:43:42.894285+0000","last_became_peered":"2023-08-25T04:43:42.894285+0000","last_unstale":"2023-08-25T04:43:43.874433+0000","last_undegraded":"2023-08-25T04:43:43.874433+0000","last_fullsized":"2023-08-25T04:43:43.874433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:49.534369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033324+0000","last_change":"2023-08-25T04:43:41.891175+0000","last_active":"2023-08-25T04:43:44.033324+0000","last_peered":"2023-08-25T04:43:44.033324+0000","last_clean":"2023-08-25T04:43:44.033324+0000","last_became_active":"2023-08-25T04:43:41.890883+0000","last_became_peered":"2023-08-25T04:43:41.890883+0000","last_unstale":"2023-08-25T04:43:44.033324+0000","last_undegraded":"2023-08-25T04:43:44.033324+0000","last_fullsized":"2023-08-25T04:43:44.033324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:02.091499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327753+0000","last_change":"2023-08-25T04:43:42.891686+0000","last_active":"2023-08-25T04:43:44.327753+0000","last_peered":"2023-08-25T04:43:44.327753+0000","last_clean":"2023-08-25T04:43:44.327753+0000","last_became_active":"2023-08-25T04:43:42.891443+0000","last_became_peered":"2023-08-25T04:43:42.891443+0000","last_unstale":"2023-08-25T04:43:44.327753+0000","last_undegraded":"2023-08-25T04:43:44.327753+0000","last_fullsized":"2023-08-25T04:43:44.327753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:08.478557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.033233+0000","last_change":"2023-08-25T04:43:41.888723+0000","last_active":"2023-08-25T04:43:44.033233+0000","last_peered":"2023-08-25T04:43:44.033233+0000","last_clean":"2023-08-25T04:43:44.033233+0000","last_became_active":"2023-08-25T04:43:41.888447+0000","last_became_peered":"2023-08-25T04:43:41.888447+0000","last_unstale":"2023-08-25T04:43:44.033233+0000","last_undegraded":"2023-08-25T04:43:44.033233+0000","last_fullsized":"2023-08-25T04:43:44.033233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:17.587860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328252+0000","last_change":"2023-08-25T04:43:42.892447+0000","last_active":"2023-08-25T04:43:44.328252+0000","last_peered":"2023-08-25T04:43:44.328252+0000","last_clean":"2023-08-25T04:43:44.328252+0000","last_became_active":"2023-08-25T04:43:42.892191+0000","last_became_peered":"2023-08-25T04:43:42.892191+0000","last_unstale":"2023-08-25T04:43:44.328252+0000","last_undegraded":"2023-08-25T04:43:44.328252+0000","last_fullsized":"2023-08-25T04:43:44.328252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:26.162949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874646+0000","last_change":"2023-08-25T04:43:41.884395+0000","last_active":"2023-08-25T04:43:43.874646+0000","last_peered":"2023-08-25T04:43:43.874646+0000","last_clean":"2023-08-25T04:43:43.874646+0000","last_became_active":"2023-08-25T04:43:41.884098+0000","last_became_peered":"2023-08-25T04:43:41.884098+0000","last_unstale":"2023-08-25T04:43:43.874646+0000","last_undegraded":"2023-08-25T04:43:43.874646+0000","last_fullsized":"2023-08-25T04:43:43.874646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:26.896561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328035+0000","last_change":"2023-08-25T04:43:42.881050+0000","last_active":"2023-08-25T04:43:44.328035+0000","last_peered":"2023-08-25T04:43:44.328035+0000","last_clean":"2023-08-25T04:43:44.328035+0000","last_became_active":"2023-08-25T04:43:42.880104+0000","last_became_peered":"2023-08-25T04:43:42.880104+0000","last_unstale":"2023-08-25T04:43:44.328035+0000","last_undegraded":"2023-08-25T04:43:44.328035+0000","last_fullsized":"2023-08-25T04:43:44.328035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:38.406155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875014+0000","last_change":"2023-08-25T04:43:41.885729+0000","last_active":"2023-08-25T04:43:43.875014+0000","last_peered":"2023-08-25T04:43:43.875014+0000","last_clean":"2023-08-25T04:43:43.875014+0000","last_became_active":"2023-08-25T04:43:41.885433+0000","last_became_peered":"2023-08-25T04:43:41.885433+0000","last_unstale":"2023-08-25T04:43:43.875014+0000","last_undegraded":"2023-08-25T04:43:43.875014+0000","last_fullsized":"2023-08-25T04:43:43.875014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:40.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328082+0000","last_change":"2023-08-25T04:43:42.896701+0000","last_active":"2023-08-25T04:43:44.328082+0000","last_peered":"2023-08-25T04:43:44.328082+0000","last_clean":"2023-08-25T04:43:44.328082+0000","last_became_active":"2023-08-25T04:43:42.896440+0000","last_became_peered":"2023-08-25T04:43:42.896440+0000","last_unstale":"2023-08-25T04:43:44.328082+0000","last_undegraded":"2023-08-25T04:43:44.328082+0000","last_fullsized":"2023-08-25T04:43:44.328082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:27.309119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328105+0000","last_change":"2023-08-25T04:43:41.891087+0000","last_active":"2023-08-25T04:43:44.328105+0000","last_peered":"2023-08-25T04:43:44.328105+0000","last_clean":"2023-08-25T04:43:44.328105+0000","last_became_active":"2023-08-25T04:43:41.890827+0000","last_became_peered":"2023-08-25T04:43:41.890827+0000","last_unstale":"2023-08-25T04:43:44.328105+0000","last_undegraded":"2023-08-25T04:43:44.328105+0000","last_fullsized":"2023-08-25T04:43:44.328105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:02.814665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328450+0000","last_change":"2023-08-25T04:43:42.897377+0000","last_active":"2023-08-25T04:43:44.328450+0000","last_peered":"2023-08-25T04:43:44.328450+0000","last_clean":"2023-08-25T04:43:44.328450+0000","last_became_active":"2023-08-25T04:43:42.897108+0000","last_became_peered":"2023-08-25T04:43:42.897108+0000","last_unstale":"2023-08-25T04:43:44.328450+0000","last_undegraded":"2023-08-25T04:43:44.328450+0000","last_fullsized":"2023-08-25T04:43:44.328450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:46:27.979648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327909+0000","last_change":"2023-08-25T04:43:41.888568+0000","last_active":"2023-08-25T04:43:44.327909+0000","last_peered":"2023-08-25T04:43:44.327909+0000","last_clean":"2023-08-25T04:43:44.327909+0000","last_became_active":"2023-08-25T04:43:41.888323+0000","last_became_peered":"2023-08-25T04:43:41.888323+0000","last_unstale":"2023-08-25T04:43:44.327909+0000","last_undegraded":"2023-08-25T04:43:44.327909+0000","last_fullsized":"2023-08-25T04:43:44.327909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:40.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328447+0000","last_change":"2023-08-25T04:43:42.897222+0000","last_active":"2023-08-25T04:43:44.328447+0000","last_peered":"2023-08-25T04:43:44.328447+0000","last_clean":"2023-08-25T04:43:44.328447+0000","last_became_active":"2023-08-25T04:43:42.896943+0000","last_became_peered":"2023-08-25T04:43:42.896943+0000","last_unstale":"2023-08-25T04:43:44.328447+0000","last_undegraded":"2023-08-25T04:43:44.328447+0000","last_fullsized":"2023-08-25T04:43:44.328447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:55.675283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874734+0000","last_change":"2023-08-25T04:43:41.887489+0000","last_active":"2023-08-25T04:43:43.874734+0000","last_peered":"2023-08-25T04:43:43.874734+0000","last_clean":"2023-08-25T04:43:43.874734+0000","last_became_active":"2023-08-25T04:43:41.886846+0000","last_became_peered":"2023-08-25T04:43:41.886846+0000","last_unstale":"2023-08-25T04:43:43.874734+0000","last_undegraded":"2023-08-25T04:43:43.874734+0000","last_fullsized":"2023-08-25T04:43:43.874734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:48.183408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874023+0000","last_change":"2023-08-25T04:43:42.903030+0000","last_active":"2023-08-25T04:43:43.874023+0000","last_peered":"2023-08-25T04:43:43.874023+0000","last_clean":"2023-08-25T04:43:43.874023+0000","last_became_active":"2023-08-25T04:43:42.902123+0000","last_became_peered":"2023-08-25T04:43:42.902123+0000","last_unstale":"2023-08-25T04:43:43.874023+0000","last_undegraded":"2023-08-25T04:43:43.874023+0000","last_fullsized":"2023-08-25T04:43:43.874023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:15.216169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875024+0000","last_change":"2023-08-25T04:43:41.883173+0000","last_active":"2023-08-25T04:43:43.875024+0000","last_peered":"2023-08-25T04:43:43.875024+0000","last_clean":"2023-08-25T04:43:43.875024+0000","last_became_active":"2023-08-25T04:43:41.882776+0000","last_became_peered":"2023-08-25T04:43:41.882776+0000","last_unstale":"2023-08-25T04:43:43.875024+0000","last_undegraded":"2023-08-25T04:43:43.875024+0000","last_fullsized":"2023-08-25T04:43:43.875024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:51.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328156+0000","last_change":"2023-08-25T04:43:36.786045+0000","last_active":"2023-08-25T04:43:44.328156+0000","last_peered":"2023-08-25T04:43:44.328156+0000","last_clean":"2023-08-25T04:43:44.328156+0000","last_became_active":"2023-08-25T04:43:36.785725+0000","last_became_peered":"2023-08-25T04:43:36.785725+0000","last_unstale":"2023-08-25T04:43:44.328156+0000","last_undegraded":"2023-08-25T04:43:44.328156+0000","last_fullsized":"2023-08-25T04:43:44.328156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:21.173873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874659+0000","last_change":"2023-08-25T04:43:42.890044+0000","last_active":"2023-08-25T04:43:43.874659+0000","last_peered":"2023-08-25T04:43:43.874659+0000","last_clean":"2023-08-25T04:43:43.874659+0000","last_became_active":"2023-08-25T04:43:42.889721+0000","last_became_peered":"2023-08-25T04:43:42.889721+0000","last_unstale":"2023-08-25T04:43:43.874659+0000","last_undegraded":"2023-08-25T04:43:43.874659+0000","last_fullsized":"2023-08-25T04:43:43.874659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:38.406155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875215+0000","last_change":"2023-08-25T04:43:36.782928+0000","last_active":"2023-08-25T04:43:43.875215+0000","last_peered":"2023-08-25T04:43:43.875215+0000","last_clean":"2023-08-25T04:43:43.875215+0000","last_became_active":"2023-08-25T04:43:36.782680+0000","last_became_peered":"2023-08-25T04:43:36.782680+0000","last_unstale":"2023-08-25T04:43:43.875215+0000","last_undegraded":"2023-08-25T04:43:43.875215+0000","last_fullsized":"2023-08-25T04:43:43.875215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:34.009540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.359125+0000","last_change":"2023-08-25T04:43:41.888878+0000","last_active":"2023-08-25T04:43:44.359125+0000","last_peered":"2023-08-25T04:43:44.359125+0000","last_clean":"2023-08-25T04:43:44.359125+0000","last_became_active":"2023-08-25T04:43:41.885363+0000","last_became_peered":"2023-08-25T04:43:41.885363+0000","last_unstale":"2023-08-25T04:43:44.359125+0000","last_undegraded":"2023-08-25T04:43:44.359125+0000","last_fullsized":"2023-08-25T04:43:44.359125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:14.211049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328061+0000","last_change":"2023-08-25T04:43:42.899201+0000","last_active":"2023-08-25T04:43:44.328061+0000","last_peered":"2023-08-25T04:43:44.328061+0000","last_clean":"2023-08-25T04:43:44.328061+0000","last_became_active":"2023-08-25T04:43:42.898942+0000","last_became_peered":"2023-08-25T04:43:42.898942+0000","last_unstale":"2023-08-25T04:43:44.328061+0000","last_undegraded":"2023-08-25T04:43:44.328061+0000","last_fullsized":"2023-08-25T04:43:44.328061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:39.577088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873470+0000","last_change":"2023-08-25T04:43:36.785266+0000","last_active":"2023-08-25T04:43:43.873470+0000","last_peered":"2023-08-25T04:43:43.873470+0000","last_clean":"2023-08-25T04:43:43.873470+0000","last_became_active":"2023-08-25T04:43:36.784937+0000","last_became_peered":"2023-08-25T04:43:36.784937+0000","last_unstale":"2023-08-25T04:43:43.873470+0000","last_undegraded":"2023-08-25T04:43:43.873470+0000","last_fullsized":"2023-08-25T04:43:43.873470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:45.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032991+0000","last_change":"2023-08-25T04:43:36.785867+0000","last_active":"2023-08-25T04:43:44.032991+0000","last_peered":"2023-08-25T04:43:44.032991+0000","last_clean":"2023-08-25T04:43:44.032991+0000","last_became_active":"2023-08-25T04:43:36.785451+0000","last_became_peered":"2023-08-25T04:43:36.785451+0000","last_unstale":"2023-08-25T04:43:44.032991+0000","last_undegraded":"2023-08-25T04:43:44.032991+0000","last_fullsized":"2023-08-25T04:43:44.032991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:10.496695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327813+0000","last_change":"2023-08-25T04:43:41.886451+0000","last_active":"2023-08-25T04:43:44.327813+0000","last_peered":"2023-08-25T04:43:44.327813+0000","last_clean":"2023-08-25T04:43:44.327813+0000","last_became_active":"2023-08-25T04:43:41.885029+0000","last_became_peered":"2023-08-25T04:43:41.885029+0000","last_unstale":"2023-08-25T04:43:44.327813+0000","last_undegraded":"2023-08-25T04:43:44.327813+0000","last_fullsized":"2023-08-25T04:43:44.327813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:09.664850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327887+0000","last_change":"2023-08-25T04:43:42.881048+0000","last_active":"2023-08-25T04:43:44.327887+0000","last_peered":"2023-08-25T04:43:44.327887+0000","last_clean":"2023-08-25T04:43:44.327887+0000","last_became_active":"2023-08-25T04:43:42.880591+0000","last_became_peered":"2023-08-25T04:43:42.880591+0000","last_unstale":"2023-08-25T04:43:44.327887+0000","last_undegraded":"2023-08-25T04:43:44.327887+0000","last_fullsized":"2023-08-25T04:43:44.327887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:49.534369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032863+0000","last_change":"2023-08-25T04:43:37.192872+0000","last_active":"2023-08-25T04:43:44.032863+0000","last_peered":"2023-08-25T04:43:44.032863+0000","last_clean":"2023-08-25T04:43:44.032863+0000","last_became_active":"2023-08-25T04:43:37.192594+0000","last_became_peered":"2023-08-25T04:43:37.192594+0000","last_unstale":"2023-08-25T04:43:44.032863+0000","last_undegraded":"2023-08-25T04:43:44.032863+0000","last_fullsized":"2023-08-25T04:43:44.032863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:35.350128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873254+0000","last_change":"2023-08-25T04:43:41.888507+0000","last_active":"2023-08-25T04:43:43.873254+0000","last_peered":"2023-08-25T04:43:43.873254+0000","last_clean":"2023-08-25T04:43:43.873254+0000","last_became_active":"2023-08-25T04:43:41.888158+0000","last_became_peered":"2023-08-25T04:43:41.888158+0000","last_unstale":"2023-08-25T04:43:43.873254+0000","last_undegraded":"2023-08-25T04:43:43.873254+0000","last_fullsized":"2023-08-25T04:43:43.873254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:34:36.120848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874020+0000","last_change":"2023-08-25T04:43:42.902440+0000","last_active":"2023-08-25T04:43:43.874020+0000","last_peered":"2023-08-25T04:43:43.874020+0000","last_clean":"2023-08-25T04:43:43.874020+0000","last_became_active":"2023-08-25T04:43:42.901657+0000","last_became_peered":"2023-08-25T04:43:42.901657+0000","last_unstale":"2023-08-25T04:43:43.874020+0000","last_undegraded":"2023-08-25T04:43:43.874020+0000","last_fullsized":"2023-08-25T04:43:43.874020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:49.188528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.032805+0000","last_change":"2023-08-25T04:43:37.192977+0000","last_active":"2023-08-25T04:43:44.032805+0000","last_peered":"2023-08-25T04:43:44.032805+0000","last_clean":"2023-08-25T04:43:44.032805+0000","last_became_active":"2023-08-25T04:43:37.192427+0000","last_became_peered":"2023-08-25T04:43:37.192427+0000","last_unstale":"2023-08-25T04:43:44.032805+0000","last_undegraded":"2023-08-25T04:43:44.032805+0000","last_fullsized":"2023-08-25T04:43:44.032805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:13.949510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875137+0000","last_change":"2023-08-25T04:43:41.883960+0000","last_active":"2023-08-25T04:43:43.875137+0000","last_peered":"2023-08-25T04:43:43.875137+0000","last_clean":"2023-08-25T04:43:43.875137+0000","last_became_active":"2023-08-25T04:43:41.883621+0000","last_became_peered":"2023-08-25T04:43:41.883621+0000","last_unstale":"2023-08-25T04:43:43.875137+0000","last_undegraded":"2023-08-25T04:43:43.875137+0000","last_fullsized":"2023-08-25T04:43:43.875137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:38.571968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327644+0000","last_change":"2023-08-25T04:43:42.893639+0000","last_active":"2023-08-25T04:43:44.327644+0000","last_peered":"2023-08-25T04:43:44.327644+0000","last_clean":"2023-08-25T04:43:44.327644+0000","last_became_active":"2023-08-25T04:43:42.893333+0000","last_became_peered":"2023-08-25T04:43:42.893333+0000","last_unstale":"2023-08-25T04:43:44.327644+0000","last_undegraded":"2023-08-25T04:43:44.327644+0000","last_fullsized":"2023-08-25T04:43:44.327644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:08:04.874031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874239+0000","last_change":"2023-08-25T04:43:37.192780+0000","last_active":"2023-08-25T04:43:43.874239+0000","last_peered":"2023-08-25T04:43:43.874239+0000","last_clean":"2023-08-25T04:43:43.874239+0000","last_became_active":"2023-08-25T04:43:37.192432+0000","last_became_peered":"2023-08-25T04:43:37.192432+0000","last_unstale":"2023-08-25T04:43:43.874239+0000","last_undegraded":"2023-08-25T04:43:43.874239+0000","last_fullsized":"2023-08-25T04:43:43.874239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:20.070499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328104+0000","last_change":"2023-08-25T04:43:41.889966+0000","last_active":"2023-08-25T04:43:44.328104+0000","last_peered":"2023-08-25T04:43:44.328104+0000","last_clean":"2023-08-25T04:43:44.328104+0000","last_became_active":"2023-08-25T04:43:41.889717+0000","last_became_peered":"2023-08-25T04:43:41.889717+0000","last_unstale":"2023-08-25T04:43:44.328104+0000","last_undegraded":"2023-08-25T04:43:44.328104+0000","last_fullsized":"2023-08-25T04:43:44.328104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:13.278697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873901+0000","last_change":"2023-08-25T04:43:42.885970+0000","last_active":"2023-08-25T04:43:43.873901+0000","last_peered":"2023-08-25T04:43:43.873901+0000","last_clean":"2023-08-25T04:43:43.873901+0000","last_became_active":"2023-08-25T04:43:42.885671+0000","last_became_peered":"2023-08-25T04:43:42.885671+0000","last_unstale":"2023-08-25T04:43:43.873901+0000","last_undegraded":"2023-08-25T04:43:43.873901+0000","last_fullsized":"2023-08-25T04:43:43.873901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:58:08.401348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327943+0000","last_change":"2023-08-25T04:43:37.192768+0000","last_active":"2023-08-25T04:43:44.327943+0000","last_peered":"2023-08-25T04:43:44.327943+0000","last_clean":"2023-08-25T04:43:44.327943+0000","last_became_active":"2023-08-25T04:43:37.192429+0000","last_became_peered":"2023-08-25T04:43:37.192429+0000","last_unstale":"2023-08-25T04:43:44.327943+0000","last_undegraded":"2023-08-25T04:43:44.327943+0000","last_fullsized":"2023-08-25T04:43:44.327943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:24.938536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873773+0000","last_change":"2023-08-25T04:43:41.888493+0000","last_active":"2023-08-25T04:43:43.873773+0000","last_peered":"2023-08-25T04:43:43.873773+0000","last_clean":"2023-08-25T04:43:43.873773+0000","last_became_active":"2023-08-25T04:43:41.888207+0000","last_became_peered":"2023-08-25T04:43:41.888207+0000","last_unstale":"2023-08-25T04:43:43.873773+0000","last_undegraded":"2023-08-25T04:43:43.873773+0000","last_fullsized":"2023-08-25T04:43:43.873773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:48.529248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327907+0000","last_change":"2023-08-25T04:43:42.900866+0000","last_active":"2023-08-25T04:43:44.327907+0000","last_peered":"2023-08-25T04:43:44.327907+0000","last_clean":"2023-08-25T04:43:44.327907+0000","last_became_active":"2023-08-25T04:43:42.900470+0000","last_became_peered":"2023-08-25T04:43:42.900470+0000","last_unstale":"2023-08-25T04:43:44.327907+0000","last_undegraded":"2023-08-25T04:43:44.327907+0000","last_fullsized":"2023-08-25T04:43:44.327907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:58:08.401348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327840+0000","last_change":"2023-08-25T04:43:36.785280+0000","last_active":"2023-08-25T04:43:44.327840+0000","last_peered":"2023-08-25T04:43:44.327840+0000","last_clean":"2023-08-25T04:43:44.327840+0000","last_became_active":"2023-08-25T04:43:36.784943+0000","last_became_peered":"2023-08-25T04:43:36.784943+0000","last_unstale":"2023-08-25T04:43:44.327840+0000","last_undegraded":"2023-08-25T04:43:44.327840+0000","last_fullsized":"2023-08-25T04:43:44.327840+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:34:31.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874669+0000","last_change":"2023-08-25T04:43:41.884839+0000","last_active":"2023-08-25T04:43:43.874669+0000","last_peered":"2023-08-25T04:43:43.874669+0000","last_clean":"2023-08-25T04:43:43.874669+0000","last_became_active":"2023-08-25T04:43:41.884535+0000","last_became_peered":"2023-08-25T04:43:41.884535+0000","last_unstale":"2023-08-25T04:43:43.874669+0000","last_undegraded":"2023-08-25T04:43:43.874669+0000","last_fullsized":"2023-08-25T04:43:43.874669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:19.036840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873817+0000","last_change":"2023-08-25T04:43:42.903007+0000","last_active":"2023-08-25T04:43:43.873817+0000","last_peered":"2023-08-25T04:43:43.873817+0000","last_clean":"2023-08-25T04:43:43.873817+0000","last_became_active":"2023-08-25T04:43:42.902721+0000","last_became_peered":"2023-08-25T04:43:42.902721+0000","last_unstale":"2023-08-25T04:43:43.873817+0000","last_undegraded":"2023-08-25T04:43:43.873817+0000","last_fullsized":"2023-08-25T04:43:43.873817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:31.303608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328239+0000","last_change":"2023-08-25T04:43:41.889969+0000","last_active":"2023-08-25T04:43:44.328239+0000","last_peered":"2023-08-25T04:43:44.328239+0000","last_clean":"2023-08-25T04:43:44.328239+0000","last_became_active":"2023-08-25T04:43:41.889659+0000","last_became_peered":"2023-08-25T04:43:41.889659+0000","last_unstale":"2023-08-25T04:43:44.328239+0000","last_undegraded":"2023-08-25T04:43:44.328239+0000","last_fullsized":"2023-08-25T04:43:44.328239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:24.582793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327415+0000","last_change":"2023-08-25T04:43:42.894953+0000","last_active":"2023-08-25T04:43:44.327415+0000","last_peered":"2023-08-25T04:43:44.327415+0000","last_clean":"2023-08-25T04:43:44.327415+0000","last_became_active":"2023-08-25T04:43:42.894618+0000","last_became_peered":"2023-08-25T04:43:42.894618+0000","last_unstale":"2023-08-25T04:43:44.327415+0000","last_undegraded":"2023-08-25T04:43:44.327415+0000","last_fullsized":"2023-08-25T04:43:44.327415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:55.404819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874488+0000","last_change":"2023-08-25T04:43:41.886470+0000","last_active":"2023-08-25T04:43:43.874488+0000","last_peered":"2023-08-25T04:43:43.874488+0000","last_clean":"2023-08-25T04:43:43.874488+0000","last_became_active":"2023-08-25T04:43:41.886063+0000","last_became_peered":"2023-08-25T04:43:41.886063+0000","last_unstale":"2023-08-25T04:43:43.874488+0000","last_undegraded":"2023-08-25T04:43:43.874488+0000","last_fullsized":"2023-08-25T04:43:43.874488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:37.401035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327631+0000","last_change":"2023-08-25T04:43:42.900475+0000","last_active":"2023-08-25T04:43:44.327631+0000","last_peered":"2023-08-25T04:43:44.327631+0000","last_clean":"2023-08-25T04:43:44.327631+0000","last_became_active":"2023-08-25T04:43:42.900135+0000","last_became_peered":"2023-08-25T04:43:42.900135+0000","last_unstale":"2023-08-25T04:43:44.327631+0000","last_undegraded":"2023-08-25T04:43:44.327631+0000","last_fullsized":"2023-08-25T04:43:44.327631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:20.041960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874794+0000","last_change":"2023-08-25T04:43:41.891609+0000","last_active":"2023-08-25T04:43:43.874794+0000","last_peered":"2023-08-25T04:43:43.874794+0000","last_clean":"2023-08-25T04:43:43.874794+0000","last_became_active":"2023-08-25T04:43:41.891306+0000","last_became_peered":"2023-08-25T04:43:41.891306+0000","last_unstale":"2023-08-25T04:43:43.874794+0000","last_undegraded":"2023-08-25T04:43:43.874794+0000","last_fullsized":"2023-08-25T04:43:43.874794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:01:40.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.328451+0000","last_change":"2023-08-25T04:43:42.894647+0000","last_active":"2023-08-25T04:43:44.328451+0000","last_peered":"2023-08-25T04:43:44.328451+0000","last_clean":"2023-08-25T04:43:44.328451+0000","last_became_active":"2023-08-25T04:43:42.894386+0000","last_became_peered":"2023-08-25T04:43:42.894386+0000","last_unstale":"2023-08-25T04:43:44.328451+0000","last_undegraded":"2023-08-25T04:43:44.328451+0000","last_fullsized":"2023-08-25T04:43:44.328451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:37.175484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875135+0000","last_change":"2023-08-25T04:43:41.893331+0000","last_active":"2023-08-25T04:43:43.875135+0000","last_peered":"2023-08-25T04:43:43.875135+0000","last_clean":"2023-08-25T04:43:43.875135+0000","last_became_active":"2023-08-25T04:43:41.892929+0000","last_became_peered":"2023-08-25T04:43:41.892929+0000","last_unstale":"2023-08-25T04:43:43.875135+0000","last_undegraded":"2023-08-25T04:43:43.875135+0000","last_fullsized":"2023-08-25T04:43:43.875135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:13.278697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875244+0000","last_change":"2023-08-25T04:43:42.894553+0000","last_active":"2023-08-25T04:43:43.875244+0000","last_peered":"2023-08-25T04:43:43.875244+0000","last_clean":"2023-08-25T04:43:43.875244+0000","last_became_active":"2023-08-25T04:43:42.894239+0000","last_became_peered":"2023-08-25T04:43:42.894239+0000","last_unstale":"2023-08-25T04:43:43.875244+0000","last_undegraded":"2023-08-25T04:43:43.875244+0000","last_fullsized":"2023-08-25T04:43:43.875244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:27.266322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327794+0000","last_change":"2023-08-25T04:43:41.883254+0000","last_active":"2023-08-25T04:43:44.327794+0000","last_peered":"2023-08-25T04:43:44.327794+0000","last_clean":"2023-08-25T04:43:44.327794+0000","last_became_active":"2023-08-25T04:43:41.882756+0000","last_became_peered":"2023-08-25T04:43:41.882756+0000","last_unstale":"2023-08-25T04:43:44.327794+0000","last_undegraded":"2023-08-25T04:43:44.327794+0000","last_fullsized":"2023-08-25T04:43:44.327794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:25.157829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327503+0000","last_change":"2023-08-25T04:43:42.895154+0000","last_active":"2023-08-25T04:43:44.327503+0000","last_peered":"2023-08-25T04:43:44.327503+0000","last_clean":"2023-08-25T04:43:44.327503+0000","last_became_active":"2023-08-25T04:43:42.894912+0000","last_became_peered":"2023-08-25T04:43:42.894912+0000","last_unstale":"2023-08-25T04:43:44.327503+0000","last_undegraded":"2023-08-25T04:43:44.327503+0000","last_fullsized":"2023-08-25T04:43:44.327503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:25.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327814+0000","last_change":"2023-08-25T04:43:42.893541+0000","last_active":"2023-08-25T04:43:44.327814+0000","last_peered":"2023-08-25T04:43:44.327814+0000","last_clean":"2023-08-25T04:43:44.327814+0000","last_became_active":"2023-08-25T04:43:42.893255+0000","last_became_peered":"2023-08-25T04:43:42.893255+0000","last_unstale":"2023-08-25T04:43:44.327814+0000","last_undegraded":"2023-08-25T04:43:44.327814+0000","last_fullsized":"2023-08-25T04:43:44.327814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:31:35.265544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.874788+0000","last_change":"2023-08-25T04:43:42.897868+0000","last_active":"2023-08-25T04:43:43.874788+0000","last_peered":"2023-08-25T04:43:43.874788+0000","last_clean":"2023-08-25T04:43:43.874788+0000","last_became_active":"2023-08-25T04:43:42.897394+0000","last_became_peered":"2023-08-25T04:43:42.897394+0000","last_unstale":"2023-08-25T04:43:43.874788+0000","last_undegraded":"2023-08-25T04:43:43.874788+0000","last_fullsized":"2023-08-25T04:43:43.874788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:25.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:44.327937+0000","last_change":"2023-08-25T04:43:42.894698+0000","last_active":"2023-08-25T04:43:44.327937+0000","last_peered":"2023-08-25T04:43:44.327937+0000","last_clean":"2023-08-25T04:43:44.327937+0000","last_became_active":"2023-08-25T04:43:42.894176+0000","last_became_peered":"2023-08-25T04:43:42.894176+0000","last_unstale":"2023-08-25T04:43:44.327937+0000","last_undegraded":"2023-08-25T04:43:44.327937+0000","last_fullsized":"2023-08-25T04:43:44.327937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:52.451365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.875112+0000","last_change":"2023-08-25T04:43:42.899435+0000","last_active":"2023-08-25T04:43:43.875112+0000","last_peered":"2023-08-25T04:43:43.875112+0000","last_clean":"2023-08-25T04:43:43.875112+0000","last_became_active":"2023-08-25T04:43:42.898842+0000","last_became_peered":"2023-08-25T04:43:42.898842+0000","last_unstale":"2023-08-25T04:43:43.875112+0000","last_undegraded":"2023-08-25T04:43:43.875112+0000","last_fullsized":"2023-08-25T04:43:43.875112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:16.589145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-25T04:43:43.873681+0000","last_change":"2023-08-25T04:43:42.890136+0000","last_active":"2023-08-25T04:43:43.873681+0000","last_peered":"2023-08-25T04:43:43.873681+0000","last_clean":"2023-08-25T04:43:43.873681+0000","last_became_active":"2023-08-25T04:43:42.889849+0000","last_became_peered":"2023-08-25T04:43:42.889849+0000","last_unstale":"2023-08-25T04:43:43.873681+0000","last_undegraded":"2023-08-25T04:43:43.873681+0000","last_fullsized":"2023-08-25T04:43:43.873681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:26.162949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":671295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":669467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":78720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.571}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6539999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4580000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:43:52.287 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-25T04:43:52.287 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-25T04:43:52.288 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-25T04:43:52.288 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-25T04:43:52.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.445+0000 7f841ea26700 1 Processor -- start 2023-08-25T04:43:52.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.445+0000 7f841ea26700 1 -- start start 2023-08-25T04:43:52.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.446+0000 7f841ea26700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f841806a340 0x7f84180ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.446+0000 7f841ea26700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f841806a720 0x7f84180cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.446+0000 7f841ea26700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84180ce1c0 con 0x7f841806d270 2023-08-25T04:43:52.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.446+0000 7f841ea26700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841806edb0 con 0x7f841806a720 2023-08-25T04:43:52.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.446+0000 7f841ea26700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841806ead0 con 0x7f841806a340 2023-08-25T04:43:52.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.446+0000 7f84177fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f841806a720 0x7f84180cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.446+0000 7f84177fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f841806a720 0x7f84180cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49524/0 (socket says 172.21.15.16:49524) 2023-08-25T04:43:52.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.446+0000 7f84177fe700 1 -- 172.21.15.16:0/3889752031 learned_addr learned my addr 172.21.15.16:0/3889752031 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:52.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.446+0000 7f8417fff700 1 --2- 172.21.15.16:0/3889752031 >> v2:172.21.15.117:3300/0 conn(0x7f841806a340 0x7f84180ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.446+0000 7f84177fe700 1 -- 172.21.15.16:0/3889752031 >> v2:172.21.15.117:3300/0 conn(0x7f841806a340 msgr2=0x7f84180ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:52.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.446+0000 7f84177fe700 1 --2- 172.21.15.16:0/3889752031 >> v2:172.21.15.117:3300/0 conn(0x7f841806a340 0x7f84180ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.446+0000 7f84177fe700 1 -- 172.21.15.16:0/3889752031 >> v1:172.21.15.117:6789/0 conn(0x7f841806d270 legacy=0x7f841806d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:52.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.446+0000 7f84177fe700 1 -- 172.21.15.16:0/3889752031 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84180cdb70 con 0x7f841806a720 2023-08-25T04:43:52.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.446+0000 7f84177fe700 1 --2- 172.21.15.16:0/3889752031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f841806a720 0x7f84180cf5d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f841806c3c0 tx=0x7f8400009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5e903db52736d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:52.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.447+0000 7f8416ffd700 1 -- 172.21.15.16:0/3889752031 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8400004230 con 0x7f841806a720 2023-08-25T04:43:52.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.447+0000 7f8416ffd700 1 -- 172.21.15.16:0/3889752031 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8400004390 con 0x7f841806a720 2023-08-25T04:43:52.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.447+0000 7f8416ffd700 1 -- 172.21.15.16:0/3889752031 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84000036a0 con 0x7f841806a720 2023-08-25T04:43:52.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.447+0000 7f841ea26700 1 -- 172.21.15.16:0/3889752031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f841806a720 msgr2=0x7f84180cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:52.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.447+0000 7f841ea26700 1 --2- 172.21.15.16:0/3889752031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f841806a720 0x7f84180cf5d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f841806c3c0 tx=0x7f8400009bd0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.447+0000 7f841ea26700 1 -- 172.21.15.16:0/3889752031 shutdown_connections 2023-08-25T04:43:52.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.447+0000 7f841ea26700 1 --2- 172.21.15.16:0/3889752031 >> v2:172.21.15.117:3300/0 conn(0x7f841806a340 0x7f84180ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.447+0000 7f841ea26700 1 --2- 172.21.15.16:0/3889752031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f841806a720 0x7f84180cf5d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.447+0000 7f841ea26700 1 -- 172.21.15.16:0/3889752031 >> 172.21.15.16:0/3889752031 conn(0x7f84180cfe00 msgr2=0x7f84180d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:52.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.447+0000 7f841ea26700 1 -- 172.21.15.16:0/3889752031 shutdown_connections 2023-08-25T04:43:52.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.447+0000 7f841ea26700 1 -- 172.21.15.16:0/3889752031 wait complete. 2023-08-25T04:43:52.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.448+0000 7f841ea26700 1 Processor -- start 2023-08-25T04:43:52.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.449+0000 7f841ea26700 1 -- start start 2023-08-25T04:43:52.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.449+0000 7f841ea26700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f841806a340 0x7f84181e49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.449+0000 7f841ea26700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f841806a720 0x7f841813cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.449+0000 7f841ea26700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f841806d270 0x7f841813d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.449+0000 7f841ea26700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84180c4d20 con 0x7f841806d270 2023-08-25T04:43:52.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.449+0000 7f841ea26700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8418143ec0 con 0x7f841806a720 2023-08-25T04:43:52.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.449+0000 7f841ea26700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84181441a0 con 0x7f841806a340 2023-08-25T04:43:52.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.449+0000 7f841cfc3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f841806d270 0x7f841813d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f841cfc3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f841806d270 0x7f841813d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49532/0 (socket says 172.21.15.16:49532) 2023-08-25T04:43:52.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f841cfc3700 1 -- 172.21.15.16:0/3334730117 learned_addr learned my addr 172.21.15.16:0/3334730117 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:52.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f84177fe700 1 --2- 172.21.15.16:0/3334730117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f841806a720 0x7f841813cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f8417fff700 1 --2- 172.21.15.16:0/3334730117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f841806a340 0x7f84181e49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f841cfc3700 1 -- 172.21.15.16:0/3334730117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f841806a340 msgr2=0x7f84181e49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:52.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f841cfc3700 1 --2- 172.21.15.16:0/3334730117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f841806a340 0x7f84181e49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f841cfc3700 1 -- 172.21.15.16:0/3334730117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f841806a720 msgr2=0x7f841813cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:52.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f841cfc3700 1 --2- 172.21.15.16:0/3334730117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f841806a720 0x7f841813cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f841cfc3700 1 -- 172.21.15.16:0/3334730117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8400009550 con 0x7f841806d270 2023-08-25T04:43:52.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f841cfc3700 1 --2- 172.21.15.16:0/3334730117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f841806d270 0x7f841813d450 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f841000cc10 tx=0x7f841000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:52.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f8414ff9700 1 -- 172.21.15.16:0/3334730117 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841000aa60 con 0x7f841806d270 2023-08-25T04:43:52.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f8414ff9700 1 -- 172.21.15.16:0/3334730117 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841000abc0 con 0x7f841806d270 2023-08-25T04:43:52.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f8414ff9700 1 -- 172.21.15.16:0/3334730117 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410012420 con 0x7f841806d270 2023-08-25T04:43:52.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f841ea26700 1 -- 172.21.15.16:0/3334730117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84180c4fc0 con 0x7f841806d270 2023-08-25T04:43:52.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.450+0000 7f841ea26700 1 -- 172.21.15.16:0/3334730117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84181e4f30 con 0x7f841806d270 2023-08-25T04:43:52.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.451+0000 7f841ea26700 1 -- 172.21.15.16:0/3334730117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84181e5180 con 0x7f841806d270 2023-08-25T04:43:52.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.452+0000 7f8414ff9700 1 -- 172.21.15.16:0/3334730117 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8410012580 con 0x7f841806d270 2023-08-25T04:43:52.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.452+0000 7f8414ff9700 1 --2- 172.21.15.16:0/3334730117 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f83f806a0e0 0x7f83f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.452+0000 7f8414ff9700 1 -- 172.21.15.16:0/3334730117 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84100888b0 con 0x7f841806d270 2023-08-25T04:43:52.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.452+0000 7f8417fff700 1 --2- 172.21.15.16:0/3334730117 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f83f806a0e0 0x7f83f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.453+0000 7f8417fff700 1 --2- 172.21.15.16:0/3334730117 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f83f806a0e0 0x7f83f806c5a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8408006b20 tx=0x7f8408008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:52.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.457+0000 7f8414ff9700 1 -- 172.21.15.16:0/3334730117 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8410053f10 con 0x7f841806d270 2023-08-25T04:43:52.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.700+0000 7f841ea26700 1 -- 172.21.15.16:0/3334730117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f84180ce6e0 con 0x7f841806d270 2023-08-25T04:43:52.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.701+0000 7f8414ff9700 1 -- 172.21.15.16:0/3334730117 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8410057530 con 0x7f841806d270 2023-08-25T04:43:52.702 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:52.702 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-25T04:43:52.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.703+0000 7f841ea26700 1 -- 172.21.15.16:0/3334730117 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f83f806a0e0 msgr2=0x7f83f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:52.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.703+0000 7f841ea26700 1 --2- 172.21.15.16:0/3334730117 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f83f806a0e0 0x7f83f806c5a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8408006b20 tx=0x7f8408008040 comp rx=0 tx=0).stop 2023-08-25T04:43:52.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.703+0000 7f841ea26700 1 -- 172.21.15.16:0/3334730117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f841806d270 msgr2=0x7f841813d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:52.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.703+0000 7f841ea26700 1 --2- 172.21.15.16:0/3334730117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f841806d270 0x7f841813d450 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f841000cc10 tx=0x7f841000cf20 comp rx=0 tx=0).stop 2023-08-25T04:43:52.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.703+0000 7f841ea26700 1 -- 172.21.15.16:0/3334730117 shutdown_connections 2023-08-25T04:43:52.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.703+0000 7f841ea26700 1 --2- 172.21.15.16:0/3334730117 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f83f806a0e0 0x7f83f806c5a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.703+0000 7f841ea26700 1 --2- 172.21.15.16:0/3334730117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f841806d270 0x7f841813d450 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.703+0000 7f841ea26700 1 --2- 172.21.15.16:0/3334730117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f841806a340 0x7f84181e49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.703+0000 7f841ea26700 1 --2- 172.21.15.16:0/3334730117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f841806a720 0x7f841813cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.703+0000 7f841ea26700 1 -- 172.21.15.16:0/3334730117 >> 172.21.15.16:0/3334730117 conn(0x7f84180cfe00 msgr2=0x7f84180d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:52.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.703+0000 7f841ea26700 1 -- 172.21.15.16:0/3334730117 shutdown_connections 2023-08-25T04:43:52.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.703+0000 7f841ea26700 1 -- 172.21.15.16:0/3334730117 wait complete. 2023-08-25T04:43:52.716 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-25T04:43:52.717 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:43:52.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.840+0000 7f952b01c700 1 Processor -- start 2023-08-25T04:43:52.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.840+0000 7f952b01c700 1 -- start start 2023-08-25T04:43:52.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.841+0000 7f952b01c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f95240cc830 0x7f95240ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.841+0000 7f952b01c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95240cedc0 0x7f952406d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.841+0000 7f952b01c700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95240cbfe0 con 0x7f95240caf10 2023-08-25T04:43:52.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.841+0000 7f952b01c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95240cd150 con 0x7f95240cc830 2023-08-25T04:43:52.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.841+0000 7f952b01c700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95240cb3d0 con 0x7f95240cedc0 2023-08-25T04:43:52.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.841+0000 7f9528db8700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f95240cc830 0x7f95240ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.841+0000 7f9528db8700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f95240cc830 0x7f95240ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49536/0 (socket says 172.21.15.16:49536) 2023-08-25T04:43:52.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.841+0000 7f9528db8700 1 -- 172.21.15.16:0/3846641653 learned_addr learned my addr 172.21.15.16:0/3846641653 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:52.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.842+0000 7f95295b9700 1 --2- 172.21.15.16:0/3846641653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95240cedc0 0x7f952406d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.842+0000 7f9528db8700 1 -- 172.21.15.16:0/3846641653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95240cedc0 msgr2=0x7f952406d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:52.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.842+0000 7f9528db8700 1 --2- 172.21.15.16:0/3846641653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95240cedc0 0x7f952406d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.842+0000 7f9528db8700 1 -- 172.21.15.16:0/3846641653 >> v1:172.21.15.117:6789/0 conn(0x7f95240caf10 legacy=0x7f952406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:52.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.842+0000 7f9528db8700 1 -- 172.21.15.16:0/3846641653 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95240cb6b0 con 0x7f95240cc830 2023-08-25T04:43:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.842+0000 7f95295b9700 1 --2- 172.21.15.16:0/3846641653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95240cedc0 0x7f952406d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.842+0000 7f9528db8700 1 --2- 172.21.15.16:0/3846641653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95240cc830 0x7f95240ccc10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f95180098f0 tx=0x7f9518009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59701decb9ba4fd9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.842+0000 7f95237fe700 1 -- 172.21.15.16:0/3846641653 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518004230 con 0x7f95240cc830 2023-08-25T04:43:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.842+0000 7f95237fe700 1 -- 172.21.15.16:0/3846641653 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9518004390 con 0x7f95240cc830 2023-08-25T04:43:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.842+0000 7f95237fe700 1 -- 172.21.15.16:0/3846641653 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95180036a0 con 0x7f95240cc830 2023-08-25T04:43:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.842+0000 7f952b01c700 1 -- 172.21.15.16:0/3846641653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95240cc830 msgr2=0x7f95240ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.842+0000 7f952b01c700 1 --2- 172.21.15.16:0/3846641653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95240cc830 0x7f95240ccc10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f95180098f0 tx=0x7f9518009c00 comp rx=0 tx=0).stop 2023-08-25T04:43:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.843+0000 7f952b01c700 1 -- 172.21.15.16:0/3846641653 shutdown_connections 2023-08-25T04:43:52.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.843+0000 7f952b01c700 1 --2- 172.21.15.16:0/3846641653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95240cedc0 0x7f952406d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.843+0000 7f952b01c700 1 --2- 172.21.15.16:0/3846641653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95240cc830 0x7f95240ccc10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.843+0000 7f952b01c700 1 -- 172.21.15.16:0/3846641653 >> 172.21.15.16:0/3846641653 conn(0x7f95240b1a10 msgr2=0x7f95240b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:52.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.843+0000 7f952b01c700 1 -- 172.21.15.16:0/3846641653 shutdown_connections 2023-08-25T04:43:52.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.843+0000 7f952b01c700 1 -- 172.21.15.16:0/3846641653 wait complete. 2023-08-25T04:43:52.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.844+0000 7f952b01c700 1 Processor -- start 2023-08-25T04:43:52.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.844+0000 7f952b01c700 1 -- start start 2023-08-25T04:43:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f952b01c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95240caf10 0x7f95240c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f952b01c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95240cc830 0x7f95240c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f952b01c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95240cedc0 0x7f952414a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f952b01c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95240c4c60 con 0x7f95240caf10 2023-08-25T04:43:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f952b01c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9524147200 con 0x7f95240cedc0 2023-08-25T04:43:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f952b01c700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95240c66b0 con 0x7f95240cc830 2023-08-25T04:43:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f9528db8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95240caf10 0x7f95240c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f9528db8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95240caf10 0x7f95240c6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49542/0 (socket says 172.21.15.16:49542) 2023-08-25T04:43:52.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f9528db8700 1 -- 172.21.15.16:0/536485170 learned_addr learned my addr 172.21.15.16:0/536485170 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:52.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f9523fff700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95240cc830 0x7f95240c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f95295b9700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95240cedc0 0x7f952414a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f9528db8700 1 -- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95240cc830 msgr2=0x7f95240c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f9528db8700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95240cc830 0x7f95240c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f9528db8700 1 -- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95240cedc0 msgr2=0x7f952414a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f9528db8700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95240cedc0 0x7f952414a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f9528db8700 1 -- 172.21.15.16:0/536485170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518009550 con 0x7f95240caf10 2023-08-25T04:43:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f9523fff700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95240cc830 0x7f95240c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f95295b9700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95240cedc0 0x7f952414a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f9528db8700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95240caf10 0x7f95240c6060 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9518009130 tx=0x7f9518004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f95217fa700 1 -- 172.21.15.16:0/536485170 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800b860 con 0x7f95240caf10 2023-08-25T04:43:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f95217fa700 1 -- 172.21.15.16:0/536485170 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951800b9c0 con 0x7f95240caf10 2023-08-25T04:43:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f952b01c700 1 -- 172.21.15.16:0/536485170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9524157660 con 0x7f95240caf10 2023-08-25T04:43:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.845+0000 7f95217fa700 1 -- 172.21.15.16:0/536485170 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800bd70 con 0x7f95240caf10 2023-08-25T04:43:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.846+0000 7f952b01c700 1 -- 172.21.15.16:0/536485170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9524157c20 con 0x7f95240caf10 2023-08-25T04:43:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.846+0000 7f952b01c700 1 -- 172.21.15.16:0/536485170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952404ee70 con 0x7f95240caf10 2023-08-25T04:43:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.847+0000 7f95217fa700 1 -- 172.21.15.16:0/536485170 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f951801b440 con 0x7f95240caf10 2023-08-25T04:43:52.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.847+0000 7f95217fa700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f950806a0e0 0x7f950806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:52.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.847+0000 7f95217fa700 1 -- 172.21.15.16:0/536485170 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9518089f10 con 0x7f95240caf10 2023-08-25T04:43:52.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.847+0000 7f9523fff700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f950806a0e0 0x7f950806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:52.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.848+0000 7f9523fff700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f950806a0e0 0x7f950806c5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9510009930 tx=0x7f9510008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:52.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:52.853+0000 7f95217fa700 1 -- 172.21.15.16:0/536485170 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9518055690 con 0x7f95240caf10 2023-08-25T04:43:53.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.053+0000 7f952b01c700 1 -- 172.21.15.16:0/536485170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9524071cb0 con 0x7f95240caf10 2023-08-25T04:43:53.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.055+0000 7f95217fa700 1 -- 172.21.15.16:0/536485170 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18233 (secure 0 0 0) 0x7f951801f090 con 0x7f95240caf10 2023-08-25T04:43:53.056 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:53.056 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:43:43.870075+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:43:40.197381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:43:41.268759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:43:53.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.057+0000 7f952b01c700 1 -- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f950806a0e0 msgr2=0x7f950806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.057+0000 7f952b01c700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f950806a0e0 0x7f950806c5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9510009930 tx=0x7f9510008040 comp rx=0 tx=0).stop 2023-08-25T04:43:53.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.057+0000 7f952b01c700 1 -- 172.21.15.16:0/536485170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95240caf10 msgr2=0x7f95240c6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.057+0000 7f952b01c700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95240caf10 0x7f95240c6060 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9518009130 tx=0x7f9518004750 comp rx=0 tx=0).stop 2023-08-25T04:43:53.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.057+0000 7f952b01c700 1 -- 172.21.15.16:0/536485170 shutdown_connections 2023-08-25T04:43:53.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.057+0000 7f952b01c700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f950806a0e0 0x7f950806c5a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.057+0000 7f952b01c700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95240cedc0 0x7f952414a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.057+0000 7f952b01c700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95240caf10 0x7f95240c6060 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.057+0000 7f952b01c700 1 --2- 172.21.15.16:0/536485170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95240cc830 0x7f95240c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.057+0000 7f952b01c700 1 -- 172.21.15.16:0/536485170 >> 172.21.15.16:0/536485170 conn(0x7f95240b1a10 msgr2=0x7f95240cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:53.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.057+0000 7f952b01c700 1 -- 172.21.15.16:0/536485170 shutdown_connections 2023-08-25T04:43:53.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.057+0000 7f952b01c700 1 -- 172.21.15.16:0/536485170 wait complete. 2023-08-25T04:43:53.070 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:43:34.951742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:43:35.360236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:43:40.197381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:43:41.268759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:43:53.071 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:43:53.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.198+0000 7f05b9865700 1 Processor -- start 2023-08-25T04:43:53.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.198+0000 7f05b9865700 1 -- start start 2023-08-25T04:43:53.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.199+0000 7f05b9865700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05b4146560 0x7f05b40d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.199+0000 7f05b9865700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f05b4146aa0 0x7f05b406a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.199+0000 7f05b9865700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f05b406a880 0x7f05b4070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.199+0000 7f05b9865700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b4146940 con 0x7f05b406a880 2023-08-25T04:43:53.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.199+0000 7f05b9865700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b406ace0 con 0x7f05b4146aa0 2023-08-25T04:43:53.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.199+0000 7f05b9865700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b4161810 con 0x7f05b4146560 2023-08-25T04:43:53.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.199+0000 7f05b37fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f05b406a880 0x7f05b4070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.199+0000 7f05b37fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f05b406a880 0x7f05b4070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49554/0 (socket says 172.21.15.16:49554) 2023-08-25T04:43:53.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.199+0000 7f05b37fe700 1 -- 172.21.15.16:0/171127239 learned_addr learned my addr 172.21.15.16:0/171127239 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:53.207 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.199+0000 7f05b27fc700 1 --2- 172.21.15.16:0/171127239 >> v2:172.21.15.117:3300/0 conn(0x7f05b4146aa0 0x7f05b406a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.207 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.200+0000 7f05b2ffd700 1 --2- 172.21.15.16:0/171127239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05b4146560 0x7f05b40d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.207 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.200+0000 7f05b37fe700 1 -- 172.21.15.16:0/171127239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05b4146560 msgr2=0x7f05b40d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:53.207 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.200+0000 7f05b37fe700 1 --2- 172.21.15.16:0/171127239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05b4146560 0x7f05b40d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.200+0000 7f05b37fe700 1 -- 172.21.15.16:0/171127239 >> v2:172.21.15.117:3300/0 conn(0x7f05b4146aa0 msgr2=0x7f05b406a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.200+0000 7f05b37fe700 1 --2- 172.21.15.16:0/171127239 >> v2:172.21.15.117:3300/0 conn(0x7f05b4146aa0 0x7f05b406a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.200+0000 7f05b37fe700 1 -- 172.21.15.16:0/171127239 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b40c5400 con 0x7f05b406a880 2023-08-25T04:43:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.200+0000 7f05b37fe700 1 --2- 172.21.15.16:0/171127239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b406a880 0x7f05b4070eb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f05b406c3f0 tx=0x7f05ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f866a6e4551a105 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.200+0000 7f05b1ffb700 1 -- 172.21.15.16:0/171127239 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00e070 con 0x7f05b406a880 2023-08-25T04:43:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.200+0000 7f05b1ffb700 1 -- 172.21.15.16:0/171127239 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac00b8d0 con 0x7f05b406a880 2023-08-25T04:43:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.200+0000 7f05b1ffb700 1 -- 172.21.15.16:0/171127239 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00bc80 con 0x7f05b406a880 2023-08-25T04:43:53.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.201+0000 7f05b9865700 1 -- 172.21.15.16:0/171127239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b406a880 msgr2=0x7f05b4070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.201+0000 7f05b9865700 1 --2- 172.21.15.16:0/171127239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b406a880 0x7f05b4070eb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f05b406c3f0 tx=0x7f05ac00b330 comp rx=0 tx=0).stop 2023-08-25T04:43:53.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.201+0000 7f05b9865700 1 -- 172.21.15.16:0/171127239 shutdown_connections 2023-08-25T04:43:53.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.201+0000 7f05b9865700 1 --2- 172.21.15.16:0/171127239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b406a880 0x7f05b4070eb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.201+0000 7f05b9865700 1 --2- 172.21.15.16:0/171127239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05b4146560 0x7f05b40d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.201+0000 7f05b9865700 1 --2- 172.21.15.16:0/171127239 >> v2:172.21.15.117:3300/0 conn(0x7f05b4146aa0 0x7f05b406a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.201+0000 7f05b9865700 1 -- 172.21.15.16:0/171127239 >> 172.21.15.16:0/171127239 conn(0x7f05b40cfe00 msgr2=0x7f05b40d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:53.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.201+0000 7f05b9865700 1 -- 172.21.15.16:0/171127239 shutdown_connections 2023-08-25T04:43:53.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.201+0000 7f05b9865700 1 -- 172.21.15.16:0/171127239 wait complete. 2023-08-25T04:43:53.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.202+0000 7f05b9865700 1 Processor -- start 2023-08-25T04:43:53.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.202+0000 7f05b9865700 1 -- start start 2023-08-25T04:43:53.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b9865700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b406a880 0x7f05b4140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b9865700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05b4146560 0x7f05b40b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b9865700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05b4146aa0 0x7f05b40ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b9865700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40b4910 con 0x7f05b406a880 2023-08-25T04:43:53.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b9865700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40aee30 con 0x7f05b4146560 2023-08-25T04:43:53.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b9865700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40af0b0 con 0x7f05b4146aa0 2023-08-25T04:43:53.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b406a880 0x7f05b4140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b406a880 0x7f05b4140bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49556/0 (socket says 172.21.15.16:49556) 2023-08-25T04:43:53.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b2ffd700 1 -- 172.21.15.16:0/10497408 learned_addr learned my addr 172.21.15.16:0/10497408 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:53.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b2ffd700 1 -- 172.21.15.16:0/10497408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05b4146aa0 msgr2=0x7f05b40ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b2ffd700 1 --2- 172.21.15.16:0/10497408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05b4146aa0 0x7f05b40ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b2ffd700 1 -- 172.21.15.16:0/10497408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05b4146560 msgr2=0x7f05b40b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b2ffd700 1 --2- 172.21.15.16:0/10497408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05b4146560 0x7f05b40b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b2ffd700 1 -- 172.21.15.16:0/10497408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac009b30 con 0x7f05b406a880 2023-08-25T04:43:53.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b2ffd700 1 --2- 172.21.15.16:0/10497408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b406a880 0x7f05b4140bc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f05a800e870 tx=0x7f05a800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:53.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f059bfff700 1 -- 172.21.15.16:0/10497408 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8009590 con 0x7f05b406a880 2023-08-25T04:43:53.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f059bfff700 1 -- 172.21.15.16:0/10497408 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a800ee70 con 0x7f05b406a880 2023-08-25T04:43:53.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b9865700 1 -- 172.21.15.16:0/10497408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b40af390 con 0x7f05b406a880 2023-08-25T04:43:53.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f059bfff700 1 -- 172.21.15.16:0/10497408 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800ca50 con 0x7f05b406a880 2023-08-25T04:43:53.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.203+0000 7f05b9865700 1 -- 172.21.15.16:0/10497408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b40b4530 con 0x7f05b406a880 2023-08-25T04:43:53.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.204+0000 7f05b9865700 1 -- 172.21.15.16:0/10497408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b406edf0 con 0x7f05b406a880 2023-08-25T04:43:53.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.205+0000 7f059bfff700 1 -- 172.21.15.16:0/10497408 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f05a800cbb0 con 0x7f05b406a880 2023-08-25T04:43:53.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.205+0000 7f059bfff700 1 --2- 172.21.15.16:0/10497408 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f05a006a0e0 0x7f05a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.205+0000 7f059bfff700 1 -- 172.21.15.16:0/10497408 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f05a80884b0 con 0x7f05b406a880 2023-08-25T04:43:53.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.205+0000 7f05b27fc700 1 --2- 172.21.15.16:0/10497408 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f05a006a0e0 0x7f05a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.206+0000 7f05b27fc700 1 --2- 172.21.15.16:0/10497408 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f05a006a0e0 0x7f05a006c5a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009a40 tx=0x7f05a4009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:53.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.209+0000 7f059bfff700 1 -- 172.21.15.16:0/10497408 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f05a80576c0 con 0x7f05b406a880 2023-08-25T04:43:53.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.411+0000 7f05b9865700 1 -- 172.21.15.16:0/10497408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f05b40b4a50 con 0x7f05b406a880 2023-08-25T04:43:53.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.412+0000 7f059bfff700 1 -- 172.21.15.16:0/10497408 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f05a800ce60 con 0x7f05b406a880 2023-08-25T04:43:53.413 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-08-25T04:43:53.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.414+0000 7f05b9865700 1 -- 172.21.15.16:0/10497408 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f05a006a0e0 msgr2=0x7f05a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.414+0000 7f05b9865700 1 --2- 172.21.15.16:0/10497408 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f05a006a0e0 0x7f05a006c5a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009a40 tx=0x7f05a4009500 comp rx=0 tx=0).stop 2023-08-25T04:43:53.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.414+0000 7f05b9865700 1 -- 172.21.15.16:0/10497408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b406a880 msgr2=0x7f05b4140bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.414+0000 7f05b9865700 1 --2- 172.21.15.16:0/10497408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b406a880 0x7f05b4140bc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f05a800e870 tx=0x7f05a800ec30 comp rx=0 tx=0).stop 2023-08-25T04:43:53.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.414+0000 7f05b9865700 1 -- 172.21.15.16:0/10497408 shutdown_connections 2023-08-25T04:43:53.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.414+0000 7f05b9865700 1 --2- 172.21.15.16:0/10497408 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f05a006a0e0 0x7f05a006c5a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.414+0000 7f05b9865700 1 --2- 172.21.15.16:0/10497408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05b4146aa0 0x7f05b40ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.414+0000 7f05b9865700 1 --2- 172.21.15.16:0/10497408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b406a880 0x7f05b4140bc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.414+0000 7f05b9865700 1 --2- 172.21.15.16:0/10497408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05b4146560 0x7f05b40b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.414+0000 7f05b9865700 1 -- 172.21.15.16:0/10497408 >> 172.21.15.16:0/10497408 conn(0x7f05b40cfe00 msgr2=0x7f05b41448a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:53.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.414+0000 7f05b9865700 1 -- 172.21.15.16:0/10497408 shutdown_connections 2023-08-25T04:43:53.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.414+0000 7f05b9865700 1 -- 172.21.15.16:0/10497408 wait complete. 2023-08-25T04:43:53.427 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:43:53.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.554+0000 7f3939f63700 1 Processor -- start 2023-08-25T04:43:53.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.554+0000 7f3939f63700 1 -- start start 2023-08-25T04:43:53.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f3939f63700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f393406a340 0x7f39340ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f3939f63700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f393406d270 0x7f393406d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f3939f63700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39340ce1c0 con 0x7f393406a720 2023-08-25T04:43:53.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f3939f63700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393406edb0 con 0x7f393406d270 2023-08-25T04:43:53.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f3939f63700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393406ead0 con 0x7f393406a340 2023-08-25T04:43:53.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f3932ffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f393406a720 0x7f39340cf5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39978/0 (socket says 172.21.15.16:39978) 2023-08-25T04:43:53.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f3932ffd700 1 -- 172.21.15.16:0/114295606 learned_addr learned my addr 172.21.15.16:0/114295606 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:53.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f39337fe700 1 --2- 172.21.15.16:0/114295606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f393406a340 0x7f39340ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f39327fc700 1 -- 172.21.15.16:0/114295606 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615821592 0 0) 0x7f39340ce1c0 con 0x7f393406a720 2023-08-25T04:43:53.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f3933fff700 1 --2- 172.21.15.16:0/114295606 >> v2:172.21.15.117:3300/0 conn(0x7f393406d270 0x7f393406d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f39327fc700 1 -- 172.21.15.16:0/114295606 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39200035b0 con 0x7f393406a720 2023-08-25T04:43:53.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f39327fc700 1 -- 172.21.15.16:0/114295606 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1617893723 0 0) 0x7f39200035b0 con 0x7f393406a720 2023-08-25T04:43:53.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f39327fc700 1 -- 172.21.15.16:0/114295606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f393406a340 msgr2=0x7f39340ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:53.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f39327fc700 1 --2- 172.21.15.16:0/114295606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f393406a340 0x7f39340ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f39327fc700 1 -- 172.21.15.16:0/114295606 >> v2:172.21.15.117:3300/0 conn(0x7f393406d270 msgr2=0x7f393406d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:53.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.555+0000 7f39327fc700 1 --2- 172.21.15.16:0/114295606 >> v2:172.21.15.117:3300/0 conn(0x7f393406d270 0x7f393406d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39327fc700 1 -- 172.21.15.16:0/114295606 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39340cdb70 con 0x7f393406a720 2023-08-25T04:43:53.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39327fc700 1 -- 172.21.15.16:0/114295606 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f391c001670 con 0x7f393406a720 2023-08-25T04:43:53.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39327fc700 1 -- 172.21.15.16:0/114295606 >> v1:172.21.15.16:6789/0 conn(0x7f393406a720 legacy=0x7f39340cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39327fc700 1 --2- 172.21.15.16:0/114295606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3920003a00 0x7f3920003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39327fc700 1 --2- 172.21.15.16:0/114295606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f393406a340 0x7f3920004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39327fc700 1 --2- 172.21.15.16:0/114295606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3920004d90 0x7f3920005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39327fc700 1 -- 172.21.15.16:0/114295606 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393406ead0 con 0x7f3920003a00 2023-08-25T04:43:53.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39327fc700 1 -- 172.21.15.16:0/114295606 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392000ba10 con 0x7f3920004d90 2023-08-25T04:43:53.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39327fc700 1 -- 172.21.15.16:0/114295606 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392000bb50 con 0x7f393406a340 2023-08-25T04:43:53.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39337fe700 1 --2- 172.21.15.16:0/114295606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3920003a00 0x7f3920003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f3932ffd700 1 --2- 172.21.15.16:0/114295606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f393406a340 0x7f3920004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f3933fff700 1 --2- 172.21.15.16:0/114295606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3920004d90 0x7f3920005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39337fe700 1 -- 172.21.15.16:0/114295606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f393406a340 msgr2=0x7f3920004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:53.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39337fe700 1 --2- 172.21.15.16:0/114295606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f393406a340 0x7f3920004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39337fe700 1 -- 172.21.15.16:0/114295606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3920004d90 msgr2=0x7f3920005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:53.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39337fe700 1 --2- 172.21.15.16:0/114295606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3920004d90 0x7f3920005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39337fe700 1 -- 172.21.15.16:0/114295606 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39200035b0 con 0x7f3920003a00 2023-08-25T04:43:53.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f3932ffd700 1 --2- 172.21.15.16:0/114295606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f393406a340 0x7f3920004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39337fe700 1 --2- 172.21.15.16:0/114295606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3920003a00 0x7f3920003e20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3924009b60 tx=0x7f3920005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d82a869e3f559c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39327fc700 1 -- 172.21.15.16:0/114295606 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392400e6c0 con 0x7f3920003a00 2023-08-25T04:43:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39327fc700 1 -- 172.21.15.16:0/114295606 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392400e820 con 0x7f3920003a00 2023-08-25T04:43:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.556+0000 7f39327fc700 1 -- 172.21.15.16:0/114295606 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392400eb90 con 0x7f3920003a00 2023-08-25T04:43:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.557+0000 7f3939f63700 1 -- 172.21.15.16:0/114295606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3920003a00 msgr2=0x7f3920003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.557+0000 7f3939f63700 1 --2- 172.21.15.16:0/114295606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3920003a00 0x7f3920003e20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3924009b60 tx=0x7f3920005880 comp rx=0 tx=0).stop 2023-08-25T04:43:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.557+0000 7f3933fff700 1 -- 172.21.15.16:0/114295606 reap_dead start 2023-08-25T04:43:53.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.557+0000 7f3939f63700 1 -- 172.21.15.16:0/114295606 shutdown_connections 2023-08-25T04:43:53.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.557+0000 7f3939f63700 1 -- 172.21.15.16:0/114295606 >> 172.21.15.16:0/114295606 conn(0x7f39340cfe00 msgr2=0x7f39340d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:53.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.557+0000 7f3939f63700 1 -- 172.21.15.16:0/114295606 shutdown_connections 2023-08-25T04:43:53.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.557+0000 7f3939f63700 1 -- 172.21.15.16:0/114295606 wait complete. 2023-08-25T04:43:53.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.558+0000 7f3939f63700 1 Processor -- start 2023-08-25T04:43:53.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.559+0000 7f3939f63700 1 -- start start 2023-08-25T04:43:53.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3939f63700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3920003a00 0x7f39340cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3939f63700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39340cc510 0x7f393413cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3939f63700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39340cbb80 0x7f393415a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3939f63700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39340cd050 con 0x7f39340cbb80 2023-08-25T04:43:53.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3939f63700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39340ca440 con 0x7f39340cc510 2023-08-25T04:43:53.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3939f63700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39340cca90 con 0x7f3920003a00 2023-08-25T04:43:53.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3933fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39340cbb80 0x7f393415a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3933fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39340cbb80 0x7f393415a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49578/0 (socket says 172.21.15.16:49578) 2023-08-25T04:43:53.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3933fff700 1 -- 172.21.15.16:0/4143134575 learned_addr learned my addr 172.21.15.16:0/4143134575 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:53.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f39337fe700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3920003a00 0x7f39340cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3932ffd700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39340cc510 0x7f393413cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3933fff700 1 -- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3920003a00 msgr2=0x7f39340cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3933fff700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3920003a00 0x7f39340cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3933fff700 1 -- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39340cc510 msgr2=0x7f393413cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3933fff700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39340cc510 0x7f393413cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3933fff700 1 -- 172.21.15.16:0/4143134575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39340ccd70 con 0x7f39340cbb80 2023-08-25T04:43:53.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3932ffd700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39340cc510 0x7f393413cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:53.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3933fff700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39340cbb80 0x7f393415a480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f393406d650 tx=0x7f392c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:53.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f392bfff700 1 -- 172.21.15.16:0/4143134575 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c00e040 con 0x7f39340cbb80 2023-08-25T04:43:53.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f392bfff700 1 -- 172.21.15.16:0/4143134575 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c00f040 con 0x7f39340cbb80 2023-08-25T04:43:53.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f392bfff700 1 -- 172.21.15.16:0/4143134575 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c00fd00 con 0x7f39340cbb80 2023-08-25T04:43:53.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3939f63700 1 -- 172.21.15.16:0/4143134575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39340ca6e0 con 0x7f39340cbb80 2023-08-25T04:43:53.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.560+0000 7f3939f63700 1 -- 172.21.15.16:0/4143134575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39340cb140 con 0x7f39340cbb80 2023-08-25T04:43:53.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.561+0000 7f3939f63700 1 -- 172.21.15.16:0/4143134575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39340ce6e0 con 0x7f39340cbb80 2023-08-25T04:43:53.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.562+0000 7f392bfff700 1 -- 172.21.15.16:0/4143134575 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f392c015430 con 0x7f39340cbb80 2023-08-25T04:43:53.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.562+0000 7f392bfff700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f391406a0e0 0x7f391406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.562+0000 7f392bfff700 1 -- 172.21.15.16:0/4143134575 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f392c088d80 con 0x7f39340cbb80 2023-08-25T04:43:53.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.562+0000 7f39337fe700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f391406a0e0 0x7f391406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.563+0000 7f39337fe700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f391406a0e0 0x7f391406c5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f39240090b0 tx=0x7f3924008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:53.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.567+0000 7f392bfff700 1 -- 172.21.15.16:0/4143134575 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f392c057ef0 con 0x7f39340cbb80 2023-08-25T04:43:53.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.767+0000 7f3939f63700 1 -- 172.21.15.16:0/4143134575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f393404ee70 con 0x7f39340cbb80 2023-08-25T04:43:53.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.767+0000 7f392bfff700 1 -- 172.21.15.16:0/4143134575 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f392c057a80 con 0x7f39340cbb80 2023-08-25T04:43:53.768 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-08-25T04:43:53.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.769+0000 7f3939f63700 1 -- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f391406a0e0 msgr2=0x7f391406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.769+0000 7f3939f63700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f391406a0e0 0x7f391406c5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f39240090b0 tx=0x7f3924008030 comp rx=0 tx=0).stop 2023-08-25T04:43:53.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.769+0000 7f3939f63700 1 -- 172.21.15.16:0/4143134575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39340cbb80 msgr2=0x7f393415a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.769+0000 7f3939f63700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39340cbb80 0x7f393415a480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f393406d650 tx=0x7f392c011ed0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.769+0000 7f3939f63700 1 -- 172.21.15.16:0/4143134575 shutdown_connections 2023-08-25T04:43:53.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.769+0000 7f3939f63700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f391406a0e0 0x7f391406c5a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.769+0000 7f3939f63700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39340cbb80 0x7f393415a480 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.769+0000 7f3939f63700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3920003a00 0x7f39340cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.769+0000 7f3939f63700 1 --2- 172.21.15.16:0/4143134575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39340cc510 0x7f393413cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.769+0000 7f3939f63700 1 -- 172.21.15.16:0/4143134575 >> 172.21.15.16:0/4143134575 conn(0x7f39340cfe00 msgr2=0x7f39340c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:53.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.770+0000 7f3939f63700 1 -- 172.21.15.16:0/4143134575 shutdown_connections 2023-08-25T04:43:53.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.770+0000 7f3939f63700 1 -- 172.21.15.16:0/4143134575 wait complete. 2023-08-25T04:43:53.782 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:43:53.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.909+0000 7fbbf2e10700 1 Processor -- start 2023-08-25T04:43:53.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.909+0000 7fbbf2e10700 1 -- start start 2023-08-25T04:43:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.910+0000 7fbbf2e10700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbbec070eb0 0x7fbbec071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.910+0000 7fbbf2e10700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbec0ce510 0x7fbbec0ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.910+0000 7fbbf2e10700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec15b0b0 con 0x7fbbec143420 2023-08-25T04:43:53.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.910+0000 7fbbf2e10700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbec15a4c0 con 0x7fbbec070eb0 2023-08-25T04:43:53.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.910+0000 7fbbf2e10700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec15a780 con 0x7fbbec0ce510 2023-08-25T04:43:53.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.911+0000 7fbbebfff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fbbec143420 0x7fbbec071290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.16:48094/0 (socket says 172.21.15.16:48094) 2023-08-25T04:43:53.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.911+0000 7fbbf0bac700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbbec070eb0 0x7fbbec071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.911+0000 7fbbebfff700 1 -- 172.21.15.16:0/3588508973 learned_addr learned my addr 172.21.15.16:0/3588508973 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:53.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.911+0000 7fbbf13ad700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbec0ce510 0x7fbbec0ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.911+0000 7fbbf0bac700 1 -- 172.21.15.16:0/3588508973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbec0ce510 msgr2=0x7fbbec0ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:53.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.911+0000 7fbbf0bac700 1 --2- 172.21.15.16:0/3588508973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbec0ce510 0x7fbbec0ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.911+0000 7fbbf0bac700 1 -- 172.21.15.16:0/3588508973 >> v1:172.21.15.117:6789/0 conn(0x7fbbec143420 legacy=0x7fbbec071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.911+0000 7fbbf0bac700 1 -- 172.21.15.16:0/3588508973 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec15aa60 con 0x7fbbec070eb0 2023-08-25T04:43:53.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.911+0000 7fbbf0bac700 1 --2- 172.21.15.16:0/3588508973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbec070eb0 0x7fbbec071c00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009840 tx=0x7fbbe0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4abb86f51045b513 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:53.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.911+0000 7fbbeb7fe700 1 -- 172.21.15.16:0/3588508973 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0011830 con 0x7fbbec070eb0 2023-08-25T04:43:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.911+0000 7fbbeb7fe700 1 -- 172.21.15.16:0/3588508973 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe0011990 con 0x7fbbec070eb0 2023-08-25T04:43:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.911+0000 7fbbeb7fe700 1 -- 172.21.15.16:0/3588508973 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0011d20 con 0x7fbbec070eb0 2023-08-25T04:43:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.912+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3588508973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbec070eb0 msgr2=0x7fbbec071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.912+0000 7fbbf2e10700 1 --2- 172.21.15.16:0/3588508973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbec070eb0 0x7fbbec071c00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009840 tx=0x7fbbe0009b50 comp rx=0 tx=0).stop 2023-08-25T04:43:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.912+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3588508973 shutdown_connections 2023-08-25T04:43:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.912+0000 7fbbf2e10700 1 --2- 172.21.15.16:0/3588508973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbec0ce510 0x7fbbec0ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.912+0000 7fbbf2e10700 1 --2- 172.21.15.16:0/3588508973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbec070eb0 0x7fbbec071c00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.912+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3588508973 >> 172.21.15.16:0/3588508973 conn(0x7fbbec0cfe00 msgr2=0x7fbbec0d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.912+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3588508973 shutdown_connections 2023-08-25T04:43:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.912+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3588508973 wait complete. 2023-08-25T04:43:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.913+0000 7fbbf2e10700 1 Processor -- start 2023-08-25T04:43:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.913+0000 7fbbf2e10700 1 -- start start 2023-08-25T04:43:53.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf2e10700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbec070eb0 0x7fbbec1f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf2e10700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbec0ce510 0x7fbbec06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf2e10700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbec143420 0x7fbbec1413a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf2e10700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec1f11a0 con 0x7fbbec143420 2023-08-25T04:43:53.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf2e10700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec13c920 con 0x7fbbec070eb0 2023-08-25T04:43:53.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf2e10700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec13cc00 con 0x7fbbec0ce510 2023-08-25T04:43:53.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf13ad700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbec143420 0x7fbbec1413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf13ad700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbec143420 0x7fbbec1413a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49592/0 (socket says 172.21.15.16:49592) 2023-08-25T04:43:53.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf13ad700 1 -- 172.21.15.16:0/3122861149 learned_addr learned my addr 172.21.15.16:0/3122861149 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:53.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf0bac700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbec070eb0 0x7fbbec1f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbebfff700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbec0ce510 0x7fbbec06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf0bac700 1 -- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbec0ce510 msgr2=0x7fbbec06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf0bac700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbec0ce510 0x7fbbec06a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf0bac700 1 -- 172.21.15.16:0/3122861149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbec143420 msgr2=0x7fbbec1413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:53.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf0bac700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbec143420 0x7fbbec1413a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:53.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf0bac700 1 -- 172.21.15.16:0/3122861149 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe00094a0 con 0x7fbbec070eb0 2023-08-25T04:43:53.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.914+0000 7fbbf13ad700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbec143420 0x7fbbec1413a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:53.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.915+0000 7fbbf0bac700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbec070eb0 0x7fbbec1f0c60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0016000 tx=0x7fbbe0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:53.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.915+0000 7fbbe97fa700 1 -- 172.21.15.16:0/3122861149 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00036a0 con 0x7fbbec070eb0 2023-08-25T04:43:53.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.915+0000 7fbbe97fa700 1 -- 172.21.15.16:0/3122861149 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe001f070 con 0x7fbbec070eb0 2023-08-25T04:43:53.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.915+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3122861149 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbec13cee0 con 0x7fbbec070eb0 2023-08-25T04:43:53.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.915+0000 7fbbe97fa700 1 -- 172.21.15.16:0/3122861149 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0003a80 con 0x7fbbec070eb0 2023-08-25T04:43:53.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.915+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3122861149 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec13d4a0 con 0x7fbbec070eb0 2023-08-25T04:43:53.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.916+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3122861149 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbec04ee70 con 0x7fbbec070eb0 2023-08-25T04:43:53.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.916+0000 7fbbe97fa700 1 -- 172.21.15.16:0/3122861149 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbbe0003be0 con 0x7fbbec070eb0 2023-08-25T04:43:53.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.917+0000 7fbbe97fa700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:53.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.917+0000 7fbbe97fa700 1 -- 172.21.15.16:0/3122861149 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbe0021070 con 0x7fbbec070eb0 2023-08-25T04:43:53.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.917+0000 7fbbebfff700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:53.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.917+0000 7fbbebfff700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8005910 tx=0x7fbbd8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:53.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:53.922+0000 7fbbe97fa700 1 -- 172.21.15.16:0/3122861149 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbbe0055420 con 0x7fbbec070eb0 2023-08-25T04:43:54.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.121+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3122861149 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbbec0719e0 con 0x7fbbec070eb0 2023-08-25T04:43:54.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.121+0000 7fbbe97fa700 1 -- 172.21.15.16:0/3122861149 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbbe0058a40 con 0x7fbbec070eb0 2023-08-25T04:43:54.242 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-08-25T04:43:54.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.123+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fbbd006a0e0 msgr2=0x7fbbd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:54.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.123+0000 7fbbf2e10700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8005910 tx=0x7fbbd8009040 comp rx=0 tx=0).stop 2023-08-25T04:43:54.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.123+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbec070eb0 msgr2=0x7fbbec1f0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:54.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.123+0000 7fbbf2e10700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbec070eb0 0x7fbbec1f0c60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0016000 tx=0x7fbbe0004750 comp rx=0 tx=0).stop 2023-08-25T04:43:54.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.123+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3122861149 shutdown_connections 2023-08-25T04:43:54.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.123+0000 7fbbf2e10700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.124+0000 7fbbf2e10700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbec143420 0x7fbbec1413a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.124+0000 7fbbf2e10700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbec070eb0 0x7fbbec1f0c60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.124+0000 7fbbf2e10700 1 --2- 172.21.15.16:0/3122861149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbec0ce510 0x7fbbec06a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.124+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3122861149 >> 172.21.15.16:0/3122861149 conn(0x7fbbec0cfe00 msgr2=0x7fbbec0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:54.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.124+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3122861149 shutdown_connections 2023-08-25T04:43:54.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.124+0000 7fbbf2e10700 1 -- 172.21.15.16:0/3122861149 wait complete. 2023-08-25T04:43:54.246 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:43:54.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.375+0000 7f08ff743700 1 Processor -- start 2023-08-25T04:43:54.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.375+0000 7f08ff743700 1 -- start start 2023-08-25T04:43:54.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08ff743700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f806d740 0x7f08f806adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:54.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08ff743700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f08f80aeb50 0x7f08f806b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:54.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08ff743700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f806dbd0 con 0x7f08f80ae770 2023-08-25T04:43:54.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08ff743700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f80ac140 con 0x7f08f80aeb50 2023-08-25T04:43:54.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08ff743700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f806deb0 con 0x7f08f806d740 2023-08-25T04:43:54.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08fdce0700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f08f80aeb50 0x7f08f806b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:54.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08fd4df700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f08f80ae770 0x7f08f806d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40010/0 (socket says 172.21.15.16:40010) 2023-08-25T04:43:54.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08fd4df700 1 -- 172.21.15.16:0/706374585 learned_addr learned my addr 172.21.15.16:0/706374585 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:54.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08fccde700 1 --2- 172.21.15.16:0/706374585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f806d740 0x7f08f806adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:54.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08fdce0700 1 -- 172.21.15.16:0/706374585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f806d740 msgr2=0x7f08f806adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:54.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08fdce0700 1 --2- 172.21.15.16:0/706374585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f806d740 0x7f08f806adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08fdce0700 1 -- 172.21.15.16:0/706374585 >> v1:172.21.15.16:6789/0 conn(0x7f08f80ae770 legacy=0x7f08f806d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:54.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08fdce0700 1 -- 172.21.15.16:0/706374585 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f80ac350 con 0x7f08f80aeb50 2023-08-25T04:43:54.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08effff700 1 -- 172.21.15.16:0/706374585 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056823650 0 0) 0x7f08f806dbd0 con 0x7f08f80ae770 2023-08-25T04:43:54.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.376+0000 7f08fdce0700 1 --2- 172.21.15.16:0/706374585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80aeb50 0x7f08f806b300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f08f000aea0 tx=0x7f08f000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2da15fc8c52555 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:54.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.377+0000 7f08effff700 1 -- 172.21.15.16:0/706374585 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f000f070 con 0x7f08f80aeb50 2023-08-25T04:43:54.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.377+0000 7f08effff700 1 -- 172.21.15.16:0/706374585 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f000a2e0 con 0x7f08f80aeb50 2023-08-25T04:43:54.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.377+0000 7f08effff700 1 -- 172.21.15.16:0/706374585 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f000cb50 con 0x7f08f80aeb50 2023-08-25T04:43:54.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.377+0000 7f08ff743700 1 -- 172.21.15.16:0/706374585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80aeb50 msgr2=0x7f08f806b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:54.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.377+0000 7f08ff743700 1 --2- 172.21.15.16:0/706374585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80aeb50 0x7f08f806b300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f08f000aea0 tx=0x7f08f000c330 comp rx=0 tx=0).stop 2023-08-25T04:43:54.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.377+0000 7f08ff743700 1 -- 172.21.15.16:0/706374585 shutdown_connections 2023-08-25T04:43:54.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.377+0000 7f08ff743700 1 --2- 172.21.15.16:0/706374585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80aeb50 0x7f08f806b300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.377+0000 7f08ff743700 1 --2- 172.21.15.16:0/706374585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f806d740 0x7f08f806adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.377+0000 7f08ff743700 1 -- 172.21.15.16:0/706374585 >> 172.21.15.16:0/706374585 conn(0x7f08f80b2440 msgr2=0x7f08f80b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:54.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.377+0000 7f08ff743700 1 -- 172.21.15.16:0/706374585 shutdown_connections 2023-08-25T04:43:54.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.377+0000 7f08ff743700 1 -- 172.21.15.16:0/706374585 wait complete. 2023-08-25T04:43:54.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.378+0000 7f08ff743700 1 Processor -- start 2023-08-25T04:43:54.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.378+0000 7f08ff743700 1 -- start start 2023-08-25T04:43:54.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.379+0000 7f08ff743700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08f80ae770 0x7f08f80c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:54.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.379+0000 7f08ff743700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f80aeb50 0x7f08f80c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:54.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.379+0000 7f08ff743700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80c8920 0x7f08f81ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:54.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.379+0000 7f08ff743700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f815a760 con 0x7f08f80c8920 2023-08-25T04:43:54.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.379+0000 7f08ff743700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f80c5650 con 0x7f08f80ae770 2023-08-25T04:43:54.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.379+0000 7f08ff743700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f8159ee0 con 0x7f08f80aeb50 2023-08-25T04:43:54.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.379+0000 7f08fdce0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80c8920 0x7f08f81ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:54.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.379+0000 7f08fdce0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80c8920 0x7f08f81ed8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49606/0 (socket says 172.21.15.16:49606) 2023-08-25T04:43:54.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.379+0000 7f08fdce0700 1 -- 172.21.15.16:0/287124069 learned_addr learned my addr 172.21.15.16:0/287124069 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:54.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.379+0000 7f08fd4df700 1 --2- 172.21.15.16:0/287124069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08f80ae770 0x7f08f80c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:54.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.379+0000 7f08fccde700 1 --2- 172.21.15.16:0/287124069 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f80aeb50 0x7f08f80c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:54.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.380+0000 7f08fdce0700 1 -- 172.21.15.16:0/287124069 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f80aeb50 msgr2=0x7f08f80c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:54.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.380+0000 7f08fdce0700 1 --2- 172.21.15.16:0/287124069 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f80aeb50 0x7f08f80c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.380+0000 7f08fdce0700 1 -- 172.21.15.16:0/287124069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08f80ae770 msgr2=0x7f08f80c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:54.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.380+0000 7f08fdce0700 1 --2- 172.21.15.16:0/287124069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08f80ae770 0x7f08f80c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.380+0000 7f08fdce0700 1 -- 172.21.15.16:0/287124069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f000ab80 con 0x7f08f80c8920 2023-08-25T04:43:54.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.380+0000 7f08fdce0700 1 --2- 172.21.15.16:0/287124069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80c8920 0x7f08f81ed8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08f8070b10 tx=0x7f08f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:54.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.380+0000 7f08edffb700 1 -- 172.21.15.16:0/287124069 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0015a10 con 0x7f08f80c8920 2023-08-25T04:43:54.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.380+0000 7f08edffb700 1 -- 172.21.15.16:0/287124069 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f0015b70 con 0x7f08f80c8920 2023-08-25T04:43:54.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.380+0000 7f08ff743700 1 -- 172.21.15.16:0/287124069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f81f2480 con 0x7f08f80c8920 2023-08-25T04:43:54.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.380+0000 7f08edffb700 1 -- 172.21.15.16:0/287124069 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0004040 con 0x7f08f80c8920 2023-08-25T04:43:54.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.380+0000 7f08ff743700 1 -- 172.21.15.16:0/287124069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f815a480 con 0x7f08f80c8920 2023-08-25T04:43:54.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.381+0000 7f08ff743700 1 -- 172.21.15.16:0/287124069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f80c57c0 con 0x7f08f80c8920 2023-08-25T04:43:54.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.382+0000 7f08edffb700 1 -- 172.21.15.16:0/287124069 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f08f00041a0 con 0x7f08f80c8920 2023-08-25T04:43:54.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.382+0000 7f08edffb700 1 --2- 172.21.15.16:0/287124069 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f08dc06a0e0 0x7f08dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:54.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.382+0000 7f08edffb700 1 -- 172.21.15.16:0/287124069 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08f008c130 con 0x7f08f80c8920 2023-08-25T04:43:54.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.382+0000 7f08fd4df700 1 --2- 172.21.15.16:0/287124069 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f08dc06a0e0 0x7f08dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:54.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.383+0000 7f08fd4df700 1 --2- 172.21.15.16:0/287124069 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f08dc06a0e0 0x7f08dc06c5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f08f40010e0 tx=0x7f08f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:54.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.386+0000 7f08edffb700 1 -- 172.21.15.16:0/287124069 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f08f80c57c0 con 0x7f08f80c8920 2023-08-25T04:43:54.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.585+0000 7f08ff743700 1 -- 172.21.15.16:0/287124069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08f80c57c0 con 0x7f08f80c8920 2023-08-25T04:43:54.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.585+0000 7f08edffb700 1 -- 172.21.15.16:0/287124069 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08f80c57c0 con 0x7f08f80c8920 2023-08-25T04:43:54.586 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-08-25T04:43:54.588 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.587+0000 7f08ff743700 1 -- 172.21.15.16:0/287124069 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f08dc06a0e0 msgr2=0x7f08dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:54.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.587+0000 7f08ff743700 1 --2- 172.21.15.16:0/287124069 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f08dc06a0e0 0x7f08dc06c5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f08f40010e0 tx=0x7f08f4009040 comp rx=0 tx=0).stop 2023-08-25T04:43:54.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.587+0000 7f08ff743700 1 -- 172.21.15.16:0/287124069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80c8920 msgr2=0x7f08f81ed8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:54.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.587+0000 7f08ff743700 1 --2- 172.21.15.16:0/287124069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80c8920 0x7f08f81ed8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08f8070b10 tx=0x7f08f0004ad0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.587+0000 7f08ff743700 1 -- 172.21.15.16:0/287124069 shutdown_connections 2023-08-25T04:43:54.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.587+0000 7f08ff743700 1 --2- 172.21.15.16:0/287124069 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f08dc06a0e0 0x7f08dc06c5a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.587+0000 7f08ff743700 1 --2- 172.21.15.16:0/287124069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80c8920 0x7f08f81ed8f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.587+0000 7f08ff743700 1 --2- 172.21.15.16:0/287124069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08f80ae770 0x7f08f80c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.587+0000 7f08ff743700 1 --2- 172.21.15.16:0/287124069 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f80aeb50 0x7f08f80c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.587+0000 7f08ff743700 1 -- 172.21.15.16:0/287124069 >> 172.21.15.16:0/287124069 conn(0x7f08f80b2440 msgr2=0x7f08f80cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:54.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.587+0000 7f08ff743700 1 -- 172.21.15.16:0/287124069 shutdown_connections 2023-08-25T04:43:54.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.587+0000 7f08ff743700 1 -- 172.21.15.16:0/287124069 wait complete. 2023-08-25T04:43:54.600 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:43:54.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.725+0000 7f384e1c0700 1 Processor -- start 2023-08-25T04:43:54.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.725+0000 7f384e1c0700 1 -- start start 2023-08-25T04:43:54.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f384e1c0700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3848160ec0 0x7f38480cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:54.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f384e1c0700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38480ce360 0x7f38480d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:54.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f384e1c0700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3848161430 con 0x7f384815d2d0 2023-08-25T04:43:54.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f384e1c0700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38480ce810 con 0x7f3848160ec0 2023-08-25T04:43:54.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f384e1c0700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38480d2f10 con 0x7f38480ce360 2023-08-25T04:43:54.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f3846ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3848160ec0 0x7f38480cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:54.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f38477fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f384815d2d0 0x7f38480b8b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40024/0 (socket says 172.21.15.16:40024) 2023-08-25T04:43:54.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f38477fe700 1 -- 172.21.15.16:0/3169715214 learned_addr learned my addr 172.21.15.16:0/3169715214 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f3846ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3848160ec0 0x7f38480cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49612/0 (socket says 172.21.15.16:49612) 2023-08-25T04:43:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f3846ffd700 1 -- 172.21.15.16:0/3169715214 >> v2:172.21.15.117:3300/0 conn(0x7f38480ce360 msgr2=0x7f38480d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f3846ffd700 1 --2- 172.21.15.16:0/3169715214 >> v2:172.21.15.117:3300/0 conn(0x7f38480ce360 0x7f38480d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f3846ffd700 1 -- 172.21.15.16:0/3169715214 >> v1:172.21.15.16:6789/0 conn(0x7f384815d2d0 legacy=0x7f38480b8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f38467fc700 1 -- 172.21.15.16:0/3169715214 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345730719 0 0) 0x7f3848161430 con 0x7f384815d2d0 2023-08-25T04:43:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f3846ffd700 1 -- 172.21.15.16:0/3169715214 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3848161710 con 0x7f3848160ec0 2023-08-25T04:43:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.726+0000 7f3846ffd700 1 --2- 172.21.15.16:0/3169715214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3848160ec0 0x7f38480cde20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3830009840 tx=0x7f3830009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8321423becbbd12 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:54.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.727+0000 7f38467fc700 1 -- 172.21.15.16:0/3169715214 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830011830 con 0x7f3848160ec0 2023-08-25T04:43:54.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.727+0000 7f38467fc700 1 -- 172.21.15.16:0/3169715214 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3830011990 con 0x7f3848160ec0 2023-08-25T04:43:54.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.727+0000 7f38467fc700 1 -- 172.21.15.16:0/3169715214 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830011d20 con 0x7f3848160ec0 2023-08-25T04:43:54.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.727+0000 7f384e1c0700 1 -- 172.21.15.16:0/3169715214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3848160ec0 msgr2=0x7f38480cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:54.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.727+0000 7f384e1c0700 1 --2- 172.21.15.16:0/3169715214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3848160ec0 0x7f38480cde20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3830009840 tx=0x7f3830009b50 comp rx=0 tx=0).stop 2023-08-25T04:43:54.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.727+0000 7f384e1c0700 1 -- 172.21.15.16:0/3169715214 shutdown_connections 2023-08-25T04:43:54.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.727+0000 7f384e1c0700 1 --2- 172.21.15.16:0/3169715214 >> v2:172.21.15.117:3300/0 conn(0x7f38480ce360 0x7f38480d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.727+0000 7f384e1c0700 1 --2- 172.21.15.16:0/3169715214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3848160ec0 0x7f38480cde20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.727+0000 7f384e1c0700 1 -- 172.21.15.16:0/3169715214 >> 172.21.15.16:0/3169715214 conn(0x7f38480d30e0 msgr2=0x7f38480d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:54.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.727+0000 7f384e1c0700 1 -- 172.21.15.16:0/3169715214 shutdown_connections 2023-08-25T04:43:54.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.727+0000 7f384e1c0700 1 -- 172.21.15.16:0/3169715214 wait complete. 2023-08-25T04:43:54.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.728+0000 7f384e1c0700 1 Processor -- start 2023-08-25T04:43:54.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.729+0000 7f384e1c0700 1 -- start start 2023-08-25T04:43:54.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.729+0000 7f384e1c0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38480ce360 0x7f384815e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:54.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.729+0000 7f384e1c0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f384815d2d0 0x7f384815da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:54.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.729+0000 7f384e1c0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3848160ec0 0x7f384815df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:54.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.729+0000 7f384e1c0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3848158720 con 0x7f384815d2d0 2023-08-25T04:43:54.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.729+0000 7f384e1c0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3848159540 con 0x7f3848160ec0 2023-08-25T04:43:54.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.729+0000 7f384e1c0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38481589c0 con 0x7f38480ce360 2023-08-25T04:43:54.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.729+0000 7f3846ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f384815d2d0 0x7f384815da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:54.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.729+0000 7f3846ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f384815d2d0 0x7f384815da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49618/0 (socket says 172.21.15.16:49618) 2023-08-25T04:43:54.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.729+0000 7f3846ffd700 1 -- 172.21.15.16:0/492439813 learned_addr learned my addr 172.21.15.16:0/492439813 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:54.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.729+0000 7f3847fff700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3848160ec0 0x7f384815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:54.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.729+0000 7f38477fe700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38480ce360 0x7f384815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:54.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.730+0000 7f3846ffd700 1 -- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38480ce360 msgr2=0x7f384815e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:54.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.730+0000 7f3846ffd700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38480ce360 0x7f384815e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.730+0000 7f3846ffd700 1 -- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3848160ec0 msgr2=0x7f384815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:54.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.730+0000 7f3846ffd700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3848160ec0 0x7f384815df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.730+0000 7f3846ffd700 1 -- 172.21.15.16:0/492439813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38300094a0 con 0x7f384815d2d0 2023-08-25T04:43:54.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.730+0000 7f3847fff700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3848160ec0 0x7f384815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:54.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.730+0000 7f38477fe700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38480ce360 0x7f384815e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:54.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.730+0000 7f3846ffd700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f384815d2d0 0x7f384815da40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f38480b5cd0 tx=0x7f3830004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:54.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.730+0000 7f383ffff700 1 -- 172.21.15.16:0/492439813 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38300038a0 con 0x7f384815d2d0 2023-08-25T04:43:54.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.730+0000 7f383ffff700 1 -- 172.21.15.16:0/492439813 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3830003a00 con 0x7f384815d2d0 2023-08-25T04:43:54.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.730+0000 7f384e1c0700 1 -- 172.21.15.16:0/492439813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3848158ca0 con 0x7f384815d2d0 2023-08-25T04:43:54.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.730+0000 7f383ffff700 1 -- 172.21.15.16:0/492439813 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830003d70 con 0x7f384815d2d0 2023-08-25T04:43:54.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.730+0000 7f384e1c0700 1 -- 172.21.15.16:0/492439813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3848159260 con 0x7f384815d2d0 2023-08-25T04:43:54.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.731+0000 7f384e1c0700 1 -- 172.21.15.16:0/492439813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3848149360 con 0x7f384815d2d0 2023-08-25T04:43:54.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.731+0000 7f383ffff700 1 -- 172.21.15.16:0/492439813 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f383001a420 con 0x7f384815d2d0 2023-08-25T04:43:54.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.732+0000 7f383ffff700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f382806a0e0 0x7f382806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:54.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.732+0000 7f383ffff700 1 -- 172.21.15.16:0/492439813 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3830089c70 con 0x7f384815d2d0 2023-08-25T04:43:54.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.732+0000 7f38477fe700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f382806a0e0 0x7f382806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:54.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.733+0000 7f38477fe700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f382806a0e0 0x7f382806c5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3838000f60 tx=0x7f3838007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:54.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.736+0000 7f383ffff700 1 -- 172.21.15.16:0/492439813 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3848149360 con 0x7f384815d2d0 2023-08-25T04:43:54.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.977+0000 7f384e1c0700 1 -- 172.21.15.16:0/492439813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3848149360 con 0x7f384815d2d0 2023-08-25T04:43:54.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.978+0000 7f383ffff700 1 -- 172.21.15.16:0/492439813 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4863 (secure 0 0 0) 0x7f3848149360 con 0x7f384815d2d0 2023-08-25T04:43:54.978 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:54.978 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/397913125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":397913125},{"type":"v1","addr":"172.21.15.16:6834","nonce":397913125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1401503507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1401503507},{"type":"v1","addr":"172.21.15.117:6835","nonce":1401503507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/899398848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":899398848},{"type":"v1","addr":"172.21.15.16:6835","nonce":899398848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:43:42.297594+0000","modified":"2023-08-25T04:43:45.899399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/36836471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":36836471},{"type":"v1","addr":"172.21.15.117:6837","nonce":36836471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:43:54.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.980+0000 7f384e1c0700 1 -- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f382806a0e0 msgr2=0x7f382806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:54.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.980+0000 7f384e1c0700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f382806a0e0 0x7f382806c5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3838000f60 tx=0x7f3838007ca0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.980+0000 7f384e1c0700 1 -- 172.21.15.16:0/492439813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f384815d2d0 msgr2=0x7f384815da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:54.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.980+0000 7f384e1c0700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f384815d2d0 0x7f384815da40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f38480b5cd0 tx=0x7f3830004750 comp rx=0 tx=0).stop 2023-08-25T04:43:54.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.980+0000 7f384e1c0700 1 -- 172.21.15.16:0/492439813 shutdown_connections 2023-08-25T04:43:54.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.980+0000 7f384e1c0700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f382806a0e0 0x7f382806c5a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.980+0000 7f384e1c0700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3848160ec0 0x7f384815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.980+0000 7f384e1c0700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38480ce360 0x7f384815e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.980+0000 7f384e1c0700 1 --2- 172.21.15.16:0/492439813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f384815d2d0 0x7f384815da40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:54.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.980+0000 7f384e1c0700 1 -- 172.21.15.16:0/492439813 >> 172.21.15.16:0/492439813 conn(0x7f38480d30e0 msgr2=0x7f3848152290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:54.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.980+0000 7f384e1c0700 1 -- 172.21.15.16:0/492439813 shutdown_connections 2023-08-25T04:43:54.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:54.980+0000 7f384e1c0700 1 -- 172.21.15.16:0/492439813 wait complete. 2023-08-25T04:43:54.982 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2023-08-25T04:43:54.993 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:43:55.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.118+0000 7fe92b022700 1 Processor -- start 2023-08-25T04:43:55.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.118+0000 7fe92b022700 1 -- start start 2023-08-25T04:43:55.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe92b022700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe92415a240 0x7fe92406bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe92b022700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe92406aa50 0x7fe9240cda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe92b022700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe924065fe0 con 0x7fe92406d9e0 2023-08-25T04:43:55.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe92b022700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92406de60 con 0x7fe92415a240 2023-08-25T04:43:55.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe92b022700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240662c0 con 0x7fe92406aa50 2023-08-25T04:43:55.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe928dbe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe92415a240 0x7fe92406bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe923fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe92406d9e0 0x7fe92406a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40040/0 (socket says 172.21.15.16:40040) 2023-08-25T04:43:55.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe923fff700 1 -- 172.21.15.16:0/3428151185 learned_addr learned my addr 172.21.15.16:0/3428151185 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:55.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe928dbe700 1 -- 172.21.15.16:0/3428151185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe92406aa50 msgr2=0x7fe9240cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:55.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe9295bf700 1 --2- 172.21.15.16:0/3428151185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe92406aa50 0x7fe9240cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe928dbe700 1 --2- 172.21.15.16:0/3428151185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe92406aa50 0x7fe9240cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe928dbe700 1 -- 172.21.15.16:0/3428151185 >> v1:172.21.15.16:6789/0 conn(0x7fe92406d9e0 legacy=0x7fe92406a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe928dbe700 1 -- 172.21.15.16:0/3428151185 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92406c5a0 con 0x7fe92415a240 2023-08-25T04:43:55.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe9237fe700 1 -- 172.21.15.16:0/3428151185 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743307463 0 0) 0x7fe924065fe0 con 0x7fe92406d9e0 2023-08-25T04:43:55.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.119+0000 7fe9295bf700 1 --2- 172.21.15.16:0/3428151185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe92406aa50 0x7fe9240cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:55.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.120+0000 7fe928dbe700 1 --2- 172.21.15.16:0/3428151185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92415a240 0x7fe92406bf80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe918009820 tx=0x7fe918009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fa7fc4d7cc7a14 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:55.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.120+0000 7fe9237fe700 1 -- 172.21.15.16:0/3428151185 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918005e30 con 0x7fe92415a240 2023-08-25T04:43:55.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.120+0000 7fe9237fe700 1 -- 172.21.15.16:0/3428151185 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe918006030 con 0x7fe92415a240 2023-08-25T04:43:55.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.120+0000 7fe9237fe700 1 -- 172.21.15.16:0/3428151185 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9180063e0 con 0x7fe92415a240 2023-08-25T04:43:55.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.120+0000 7fe92b022700 1 -- 172.21.15.16:0/3428151185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92415a240 msgr2=0x7fe92406bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.120+0000 7fe92b022700 1 --2- 172.21.15.16:0/3428151185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92415a240 0x7fe92406bf80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe918009820 tx=0x7fe918009b30 comp rx=0 tx=0).stop 2023-08-25T04:43:55.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.120+0000 7fe92b022700 1 -- 172.21.15.16:0/3428151185 shutdown_connections 2023-08-25T04:43:55.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.120+0000 7fe92b022700 1 --2- 172.21.15.16:0/3428151185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92415a240 0x7fe92406bf80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.120+0000 7fe92b022700 1 --2- 172.21.15.16:0/3428151185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe92406aa50 0x7fe9240cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.120+0000 7fe92b022700 1 -- 172.21.15.16:0/3428151185 >> 172.21.15.16:0/3428151185 conn(0x7fe9240b2480 msgr2=0x7fe9240b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:55.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.120+0000 7fe92b022700 1 -- 172.21.15.16:0/3428151185 shutdown_connections 2023-08-25T04:43:55.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.120+0000 7fe92b022700 1 -- 172.21.15.16:0/3428151185 wait complete. 2023-08-25T04:43:55.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.121+0000 7fe92b022700 1 Processor -- start 2023-08-25T04:43:55.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.121+0000 7fe92b022700 1 -- start start 2023-08-25T04:43:55.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.122+0000 7fe92b022700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe92406aa50 0x7fe924159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.122+0000 7fe92b022700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92406d9e0 0x7fe9241587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.122+0000 7fe92b022700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe92415a240 0x7fe924097ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.122+0000 7fe92b022700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240cc7e0 con 0x7fe92406d9e0 2023-08-25T04:43:55.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.122+0000 7fe92b022700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240cbbd0 con 0x7fe92406aa50 2023-08-25T04:43:55.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.122+0000 7fe92b022700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240cbeb0 con 0x7fe92415a240 2023-08-25T04:43:55.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.122+0000 7fe923fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92406d9e0 0x7fe9241587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.122+0000 7fe923fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92406d9e0 0x7fe9241587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49632/0 (socket says 172.21.15.16:49632) 2023-08-25T04:43:55.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.123+0000 7fe923fff700 1 -- 172.21.15.16:0/828870079 learned_addr learned my addr 172.21.15.16:0/828870079 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:55.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.123+0000 7fe928dbe700 1 --2- 172.21.15.16:0/828870079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe92406aa50 0x7fe924159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.123+0000 7fe9295bf700 1 --2- 172.21.15.16:0/828870079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe92415a240 0x7fe924097ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.123+0000 7fe923fff700 1 -- 172.21.15.16:0/828870079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe92415a240 msgr2=0x7fe924097ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.123+0000 7fe923fff700 1 --2- 172.21.15.16:0/828870079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe92415a240 0x7fe924097ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.123+0000 7fe923fff700 1 -- 172.21.15.16:0/828870079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe92406aa50 msgr2=0x7fe924159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.123+0000 7fe923fff700 1 --2- 172.21.15.16:0/828870079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe92406aa50 0x7fe924159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.123+0000 7fe923fff700 1 -- 172.21.15.16:0/828870079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe918009430 con 0x7fe92406d9e0 2023-08-25T04:43:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.123+0000 7fe923fff700 1 --2- 172.21.15.16:0/828870079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92406d9e0 0x7fe9241587f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe9100011e0 tx=0x7fe91000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.123+0000 7fe9217fa700 1 -- 172.21.15.16:0/828870079 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910004c80 con 0x7fe92406d9e0 2023-08-25T04:43:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.123+0000 7fe9217fa700 1 -- 172.21.15.16:0/828870079 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe910004e00 con 0x7fe92406d9e0 2023-08-25T04:43:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.123+0000 7fe92b022700 1 -- 172.21.15.16:0/828870079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9240cc190 con 0x7fe92406d9e0 2023-08-25T04:43:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.123+0000 7fe9217fa700 1 -- 172.21.15.16:0/828870079 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910007310 con 0x7fe92406d9e0 2023-08-25T04:43:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.123+0000 7fe92b022700 1 -- 172.21.15.16:0/828870079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9240cb850 con 0x7fe92406d9e0 2023-08-25T04:43:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.124+0000 7fe92b022700 1 -- 172.21.15.16:0/828870079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9240cc950 con 0x7fe92406d9e0 2023-08-25T04:43:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.124+0000 7fe9217fa700 1 -- 172.21.15.16:0/828870079 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe910007470 con 0x7fe92406d9e0 2023-08-25T04:43:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.125+0000 7fe9217fa700 1 --2- 172.21.15.16:0/828870079 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe90806a110 0x7fe90806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.125+0000 7fe9217fa700 1 -- 172.21.15.16:0/828870079 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe910088140 con 0x7fe92406d9e0 2023-08-25T04:43:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.125+0000 7fe928dbe700 1 --2- 172.21.15.16:0/828870079 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe90806a110 0x7fe90806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.126+0000 7fe928dbe700 1 --2- 172.21.15.16:0/828870079 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe90806a110 0x7fe90806c5d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe918013040 tx=0x7fe918008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.129+0000 7fe9217fa700 1 -- 172.21.15.16:0/828870079 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe910053820 con 0x7fe92406d9e0 2023-08-25T04:43:55.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.329+0000 7fe92b022700 1 -- 172.21.15.16:0/828870079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe92404ee70 con 0x7fe92406d9e0 2023-08-25T04:43:55.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.330+0000 7fe9217fa700 1 -- 172.21.15.16:0/828870079 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18233 (secure 0 0 0) 0x7fe910056e40 con 0x7fe92406d9e0 2023-08-25T04:43:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:55.331 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:43:43.870075+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:43:40.197381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:43:41.268759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:43:55.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.333+0000 7fe92b022700 1 -- 172.21.15.16:0/828870079 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe90806a110 msgr2=0x7fe90806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.333+0000 7fe92b022700 1 --2- 172.21.15.16:0/828870079 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe90806a110 0x7fe90806c5d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe918013040 tx=0x7fe918008070 comp rx=0 tx=0).stop 2023-08-25T04:43:55.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.333+0000 7fe92b022700 1 -- 172.21.15.16:0/828870079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92406d9e0 msgr2=0x7fe9241587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.333+0000 7fe92b022700 1 --2- 172.21.15.16:0/828870079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92406d9e0 0x7fe9241587f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe9100011e0 tx=0x7fe91000ca30 comp rx=0 tx=0).stop 2023-08-25T04:43:55.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.333+0000 7fe92b022700 1 -- 172.21.15.16:0/828870079 shutdown_connections 2023-08-25T04:43:55.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.333+0000 7fe92b022700 1 --2- 172.21.15.16:0/828870079 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe90806a110 0x7fe90806c5d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.333+0000 7fe92b022700 1 --2- 172.21.15.16:0/828870079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe92415a240 0x7fe924097ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.333+0000 7fe92b022700 1 --2- 172.21.15.16:0/828870079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe92406aa50 0x7fe924159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.333+0000 7fe92b022700 1 --2- 172.21.15.16:0/828870079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92406d9e0 0x7fe9241587f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.333+0000 7fe92b022700 1 -- 172.21.15.16:0/828870079 >> 172.21.15.16:0/828870079 conn(0x7fe9240b2480 msgr2=0x7fe92415d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:55.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.333+0000 7fe92b022700 1 -- 172.21.15.16:0/828870079 shutdown_connections 2023-08-25T04:43:55.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.333+0000 7fe92b022700 1 -- 172.21.15.16:0/828870079 wait complete. 2023-08-25T04:43:55.345 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:43:34.951742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:43:35.360236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:43:40.197381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:43:41.268759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:43:55.346 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:43:55.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.474+0000 7f00b5313700 1 Processor -- start 2023-08-25T04:43:55.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.475+0000 7f00b5313700 1 -- start start 2023-08-25T04:43:55.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.475+0000 7f00b5313700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00b00ae770 0x7f00b006d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.475+0000 7f00b5313700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f00b006b4d0 0x7f00b006d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.475+0000 7f00b5313700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b006dbd0 con 0x7f00b00aeb50 2023-08-25T04:43:55.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.475+0000 7f00b5313700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b00ac140 con 0x7f00b006b4d0 2023-08-25T04:43:55.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.475+0000 7f00b5313700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b006deb0 con 0x7f00b00ae770 2023-08-25T04:43:55.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.475+0000 7f00af7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f00b006b4d0 0x7f00b006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.475+0000 7f00af7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f00b006b4d0 0x7f00b006d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49642/0 (socket says 172.21.15.16:49642) 2023-08-25T04:43:55.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.475+0000 7f00af7fe700 1 -- 172.21.15.16:0/1215394378 learned_addr learned my addr 172.21.15.16:0/1215394378 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:55.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.476+0000 7f00aeffd700 1 --2- 172.21.15.16:0/1215394378 >> v2:172.21.15.117:3300/0 conn(0x7f00b00ae770 0x7f00b006d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.476+0000 7f00af7fe700 1 -- 172.21.15.16:0/1215394378 >> v2:172.21.15.117:3300/0 conn(0x7f00b00ae770 msgr2=0x7f00b006d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:55.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.476+0000 7f00af7fe700 1 --2- 172.21.15.16:0/1215394378 >> v2:172.21.15.117:3300/0 conn(0x7f00b00ae770 0x7f00b006d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.476+0000 7f00af7fe700 1 -- 172.21.15.16:0/1215394378 >> v1:172.21.15.117:6789/0 conn(0x7f00b00aeb50 legacy=0x7f00b006adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.476+0000 7f00af7fe700 1 -- 172.21.15.16:0/1215394378 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b00ac350 con 0x7f00b006b4d0 2023-08-25T04:43:55.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.476+0000 7f00af7fe700 1 --2- 172.21.15.16:0/1215394378 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00b006b4d0 0x7f00b006d570 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f00a800d150 tx=0x7f00a800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb57f4c8a9da2a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:55.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.476+0000 7f00adffb700 1 -- 172.21.15.16:0/1215394378 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8010070 con 0x7f00b006b4d0 2023-08-25T04:43:55.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.476+0000 7f00adffb700 1 -- 172.21.15.16:0/1215394378 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a800dd80 con 0x7f00b006b4d0 2023-08-25T04:43:55.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.476+0000 7f00adffb700 1 -- 172.21.15.16:0/1215394378 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800b310 con 0x7f00b006b4d0 2023-08-25T04:43:55.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.477+0000 7f00b5313700 1 -- 172.21.15.16:0/1215394378 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00b006b4d0 msgr2=0x7f00b006d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.477+0000 7f00b5313700 1 --2- 172.21.15.16:0/1215394378 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00b006b4d0 0x7f00b006d570 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f00a800d150 tx=0x7f00a800d460 comp rx=0 tx=0).stop 2023-08-25T04:43:55.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.477+0000 7f00b5313700 1 -- 172.21.15.16:0/1215394378 shutdown_connections 2023-08-25T04:43:55.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.477+0000 7f00b5313700 1 --2- 172.21.15.16:0/1215394378 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00b006b4d0 0x7f00b006d570 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.477+0000 7f00b5313700 1 --2- 172.21.15.16:0/1215394378 >> v2:172.21.15.117:3300/0 conn(0x7f00b00ae770 0x7f00b006d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.477+0000 7f00b5313700 1 -- 172.21.15.16:0/1215394378 >> 172.21.15.16:0/1215394378 conn(0x7f00b00b2440 msgr2=0x7f00b00b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:55.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.477+0000 7f00b5313700 1 -- 172.21.15.16:0/1215394378 shutdown_connections 2023-08-25T04:43:55.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.477+0000 7f00b5313700 1 -- 172.21.15.16:0/1215394378 wait complete. 2023-08-25T04:43:55.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.478+0000 7f00b5313700 1 Processor -- start 2023-08-25T04:43:55.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.478+0000 7f00b5313700 1 -- start start 2023-08-25T04:43:55.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00b5313700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00b006b4d0 0x7f00b00ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00b5313700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b00ae770 0x7f00b00c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00b5313700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b00aeb50 0x7f00b00cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00b5313700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00cadd0 con 0x7f00b006b4d0 2023-08-25T04:43:55.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00b5313700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00c4080 con 0x7f00b00ae770 2023-08-25T04:43:55.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00b5313700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00cb000 con 0x7f00b00aeb50 2023-08-25T04:43:55.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00aeffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00b006b4d0 0x7f00b00ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00aeffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00b006b4d0 0x7f00b00ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49644/0 (socket says 172.21.15.16:49644) 2023-08-25T04:43:55.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00aeffd700 1 -- 172.21.15.16:0/3779255158 learned_addr learned my addr 172.21.15.16:0/3779255158 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:55.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00af7fe700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b00aeb50 0x7f00b00cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00ae7fc700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b00ae770 0x7f00b00c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00aeffd700 1 -- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b00aeb50 msgr2=0x7f00b00cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00aeffd700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b00aeb50 0x7f00b00cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00aeffd700 1 -- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b00ae770 msgr2=0x7f00b00c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00aeffd700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b00ae770 0x7f00b00c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00aeffd700 1 -- 172.21.15.16:0/3779255158 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a800bd40 con 0x7f00b006b4d0 2023-08-25T04:43:55.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00ae7fc700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b00ae770 0x7f00b00c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:55.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.479+0000 7f00aeffd700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00b006b4d0 0x7f00b00ca890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f00a400e730 tx=0x7f00a400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:55.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.480+0000 7f00977fe700 1 -- 172.21.15.16:0/3779255158 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4013610 con 0x7f00b006b4d0 2023-08-25T04:43:55.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.480+0000 7f00977fe700 1 -- 172.21.15.16:0/3779255158 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a4013770 con 0x7f00b006b4d0 2023-08-25T04:43:55.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.480+0000 7f00b5313700 1 -- 172.21.15.16:0/3779255158 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b00cb2e0 con 0x7f00b006b4d0 2023-08-25T04:43:55.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.480+0000 7f00977fe700 1 -- 172.21.15.16:0/3779255158 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4013b20 con 0x7f00b006b4d0 2023-08-25T04:43:55.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.480+0000 7f00b5313700 1 -- 172.21.15.16:0/3779255158 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b00cb8a0 con 0x7f00b006b4d0 2023-08-25T04:43:55.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.480+0000 7f00b5313700 1 -- 172.21.15.16:0/3779255158 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b004ee70 con 0x7f00b006b4d0 2023-08-25T04:43:55.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.481+0000 7f00977fe700 1 -- 172.21.15.16:0/3779255158 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f00a4013c80 con 0x7f00b006b4d0 2023-08-25T04:43:55.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.481+0000 7f00977fe700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f009c06a0e0 0x7f009c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.481+0000 7f00977fe700 1 -- 172.21.15.16:0/3779255158 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00a4087e60 con 0x7f00b006b4d0 2023-08-25T04:43:55.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.482+0000 7f00ae7fc700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f009c06a0e0 0x7f009c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.482+0000 7f00ae7fc700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f009c06a0e0 0x7f009c06c5a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f00b00cffd0 tx=0x7f00a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:55.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.486+0000 7f00977fe700 1 -- 172.21.15.16:0/3779255158 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f00a4057070 con 0x7f00b006b4d0 2023-08-25T04:43:55.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.684+0000 7f00b5313700 1 -- 172.21.15.16:0/3779255158 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f00b00b53b0 con 0x7f00b006b4d0 2023-08-25T04:43:55.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.684+0000 7f00977fe700 1 -- 172.21.15.16:0/3779255158 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f00a40210a0 con 0x7f00b006b4d0 2023-08-25T04:43:55.684 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-08-25T04:43:55.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.686+0000 7f00b5313700 1 -- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f009c06a0e0 msgr2=0x7f009c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.686+0000 7f00b5313700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f009c06a0e0 0x7f009c06c5a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f00b00cffd0 tx=0x7f00a0009040 comp rx=0 tx=0).stop 2023-08-25T04:43:55.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.686+0000 7f00b5313700 1 -- 172.21.15.16:0/3779255158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00b006b4d0 msgr2=0x7f00b00ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.686+0000 7f00b5313700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00b006b4d0 0x7f00b00ca890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f00a400e730 tx=0x7f00a400eaf0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.686+0000 7f00b5313700 1 -- 172.21.15.16:0/3779255158 shutdown_connections 2023-08-25T04:43:55.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.686+0000 7f00b5313700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f009c06a0e0 0x7f009c06c5a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.686+0000 7f00b5313700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b00aeb50 0x7f00b00cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.686+0000 7f00b5313700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00b006b4d0 0x7f00b00ca890 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.686+0000 7f00b5313700 1 --2- 172.21.15.16:0/3779255158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b00ae770 0x7f00b00c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.686+0000 7f00b5313700 1 -- 172.21.15.16:0/3779255158 >> 172.21.15.16:0/3779255158 conn(0x7f00b00b2440 msgr2=0x7f00b00cf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.686+0000 7f00b5313700 1 -- 172.21.15.16:0/3779255158 shutdown_connections 2023-08-25T04:43:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.686+0000 7f00b5313700 1 -- 172.21.15.16:0/3779255158 wait complete. 2023-08-25T04:43:55.699 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:43:55.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.826+0000 7fd9b7c13700 1 Processor -- start 2023-08-25T04:43:55.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.826+0000 7fd9b7c13700 1 -- start start 2023-08-25T04:43:55.827 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.827+0000 7fd9b7c13700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9b006aa50 0x7fd9b00d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.827+0000 7fd9b7c13700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd9b0146aa0 0x7fd9b006d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.827+0000 7fd9b7c13700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b0161810 con 0x7fd9b0146560 2023-08-25T04:43:55.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.827+0000 7fd9b7c13700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b0146940 con 0x7fd9b0146aa0 2023-08-25T04:43:55.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.827+0000 7fd9b7c13700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00c5400 con 0x7fd9b006aa50 2023-08-25T04:43:55.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.827+0000 7fd9b59af700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd9b0146560 0x7fd9b006a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40066/0 (socket says 172.21.15.16:40066) 2023-08-25T04:43:55.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.827+0000 7fd9b59af700 1 -- 172.21.15.16:0/1321068254 learned_addr learned my addr 172.21.15.16:0/1321068254 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:55.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.827+0000 7fd9b51ae700 1 --2- 172.21.15.16:0/1321068254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9b006aa50 0x7fd9b00d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.827+0000 7fd9b61b0700 1 --2- 172.21.15.16:0/1321068254 >> v2:172.21.15.117:3300/0 conn(0x7fd9b0146aa0 0x7fd9b006d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.827+0000 7fd9b49ad700 1 -- 172.21.15.16:0/1321068254 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458159695 0 0) 0x7fd9b0161810 con 0x7fd9b0146560 2023-08-25T04:43:55.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.827+0000 7fd9b49ad700 1 -- 172.21.15.16:0/1321068254 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd99c0035b0 con 0x7fd9b0146560 2023-08-25T04:43:55.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b51ae700 1 -- 172.21.15.16:0/1321068254 >> v2:172.21.15.117:3300/0 conn(0x7fd9b0146aa0 msgr2=0x7fd9b006d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:55.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b49ad700 1 -- 172.21.15.16:0/1321068254 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2179278441 0 0) 0x7fd99c0035b0 con 0x7fd9b0146560 2023-08-25T04:43:55.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b51ae700 1 --2- 172.21.15.16:0/1321068254 >> v2:172.21.15.117:3300/0 conn(0x7fd9b0146aa0 0x7fd9b006d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b51ae700 1 -- 172.21.15.16:0/1321068254 >> v1:172.21.15.16:6789/0 conn(0x7fd9b0146560 legacy=0x7fd9b006a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b51ae700 1 -- 172.21.15.16:0/1321068254 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0161d40 con 0x7fd9b006aa50 2023-08-25T04:43:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b61b0700 1 --2- 172.21.15.16:0/1321068254 >> v2:172.21.15.117:3300/0 conn(0x7fd9b0146aa0 0x7fd9b006d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b51ae700 1 --2- 172.21.15.16:0/1321068254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9b006aa50 0x7fd9b00d0920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009840 tx=0x7fd9ac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c054bf73f67ac7a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b49ad700 1 -- 172.21.15.16:0/1321068254 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac011830 con 0x7fd9b006aa50 2023-08-25T04:43:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b49ad700 1 -- 172.21.15.16:0/1321068254 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac011990 con 0x7fd9b006aa50 2023-08-25T04:43:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b49ad700 1 -- 172.21.15.16:0/1321068254 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac011d00 con 0x7fd9b006aa50 2023-08-25T04:43:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1321068254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9b006aa50 msgr2=0x7fd9b00d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b7c13700 1 --2- 172.21.15.16:0/1321068254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9b006aa50 0x7fd9b00d0920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009840 tx=0x7fd9ac009b50 comp rx=0 tx=0).stop 2023-08-25T04:43:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1321068254 shutdown_connections 2023-08-25T04:43:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b7c13700 1 --2- 172.21.15.16:0/1321068254 >> v2:172.21.15.117:3300/0 conn(0x7fd9b0146aa0 0x7fd9b006d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b7c13700 1 --2- 172.21.15.16:0/1321068254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9b006aa50 0x7fd9b00d0920 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.828+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1321068254 >> 172.21.15.16:0/1321068254 conn(0x7fd9b00cfe00 msgr2=0x7fd9b00d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.829+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1321068254 shutdown_connections 2023-08-25T04:43:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.829+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1321068254 wait complete. 2023-08-25T04:43:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.830+0000 7fd9b7c13700 1 Processor -- start 2023-08-25T04:43:55.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.830+0000 7fd9b7c13700 1 -- start start 2023-08-25T04:43:55.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.830+0000 7fd9b7c13700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9b006aa50 0x7fd9b00b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.830+0000 7fd9b7c13700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9b0146560 0x7fd9b00b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.830+0000 7fd9b7c13700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9b0146aa0 0x7fd9b00b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.830+0000 7fd9b7c13700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00b48e0 con 0x7fd9b0146aa0 2023-08-25T04:43:55.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.830+0000 7fd9b7c13700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b01435b0 con 0x7fd9b0146560 2023-08-25T04:43:55.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.830+0000 7fd9b7c13700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0135c10 con 0x7fd9b006aa50 2023-08-25T04:43:55.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9b61b0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9b0146aa0 0x7fd9b00b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9b61b0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9b0146aa0 0x7fd9b00b2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49662/0 (socket says 172.21.15.16:49662) 2023-08-25T04:43:55.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9b61b0700 1 -- 172.21.15.16:0/1412521430 learned_addr learned my addr 172.21.15.16:0/1412521430 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:55.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9b51ae700 1 --2- 172.21.15.16:0/1412521430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9b0146560 0x7fd9b00b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9b59af700 1 --2- 172.21.15.16:0/1412521430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9b006aa50 0x7fd9b00b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9b61b0700 1 -- 172.21.15.16:0/1412521430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9b006aa50 msgr2=0x7fd9b00b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9b61b0700 1 --2- 172.21.15.16:0/1412521430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9b006aa50 0x7fd9b00b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9b61b0700 1 -- 172.21.15.16:0/1412521430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9b0146560 msgr2=0x7fd9b00b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9b61b0700 1 --2- 172.21.15.16:0/1412521430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9b0146560 0x7fd9b00b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9b61b0700 1 -- 172.21.15.16:0/1412521430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a8009a70 con 0x7fd9b0146aa0 2023-08-25T04:43:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9b61b0700 1 --2- 172.21.15.16:0/1412521430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9b0146aa0 0x7fd9b00b2fb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800ef90 tx=0x7fd9a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9a67fc700 1 -- 172.21.15.16:0/1412521430 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a800cc90 con 0x7fd9b0146aa0 2023-08-25T04:43:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9a67fc700 1 -- 172.21.15.16:0/1412521430 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a800f040 con 0x7fd9b0146aa0 2023-08-25T04:43:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1412521430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ac0094a0 con 0x7fd9b0146aa0 2023-08-25T04:43:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9a67fc700 1 -- 172.21.15.16:0/1412521430 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80146c0 con 0x7fd9b0146aa0 2023-08-25T04:43:55.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.831+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1412521430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b00b4b10 con 0x7fd9b0146aa0 2023-08-25T04:43:55.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.832+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1412521430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b006edf0 con 0x7fd9b0146aa0 2023-08-25T04:43:55.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.833+0000 7fd9a67fc700 1 -- 172.21.15.16:0/1412521430 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd9a8014820 con 0x7fd9b0146aa0 2023-08-25T04:43:55.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.833+0000 7fd9a67fc700 1 --2- 172.21.15.16:0/1412521430 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd99406a0e0 0x7fd99406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:55.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.833+0000 7fd9a67fc700 1 -- 172.21.15.16:0/1412521430 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9a8089180 con 0x7fd9b0146aa0 2023-08-25T04:43:55.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.833+0000 7fd9b59af700 1 --2- 172.21.15.16:0/1412521430 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd99406a0e0 0x7fd99406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:55.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.834+0000 7fd9b59af700 1 --2- 172.21.15.16:0/1412521430 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd99406a0e0 0x7fd99406c5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0007fd0 tx=0x7fd9a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:55.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:55.837+0000 7fd9a67fc700 1 -- 172.21.15.16:0/1412521430 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd9a8058300 con 0x7fd9b0146aa0 2023-08-25T04:43:56.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.036+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1412521430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9b004ee70 con 0x7fd9b0146aa0 2023-08-25T04:43:56.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.036+0000 7fd9a67fc700 1 -- 172.21.15.16:0/1412521430 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9a8009d70 con 0x7fd9b0146aa0 2023-08-25T04:43:56.037 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-08-25T04:43:56.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.038+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1412521430 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd99406a0e0 msgr2=0x7fd99406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.038+0000 7fd9b7c13700 1 --2- 172.21.15.16:0/1412521430 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd99406a0e0 0x7fd99406c5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0007fd0 tx=0x7fd9a0009040 comp rx=0 tx=0).stop 2023-08-25T04:43:56.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.038+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1412521430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9b0146aa0 msgr2=0x7fd9b00b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.038+0000 7fd9b7c13700 1 --2- 172.21.15.16:0/1412521430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9b0146aa0 0x7fd9b00b2fb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800ef90 tx=0x7fd9a800c3a0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.038+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1412521430 shutdown_connections 2023-08-25T04:43:56.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.038+0000 7fd9b7c13700 1 --2- 172.21.15.16:0/1412521430 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd99406a0e0 0x7fd99406c5a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.038+0000 7fd9b7c13700 1 --2- 172.21.15.16:0/1412521430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9b0146aa0 0x7fd9b00b2fb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.038+0000 7fd9b7c13700 1 --2- 172.21.15.16:0/1412521430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9b006aa50 0x7fd9b00b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.038+0000 7fd9b7c13700 1 --2- 172.21.15.16:0/1412521430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9b0146560 0x7fd9b00b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.038+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1412521430 >> 172.21.15.16:0/1412521430 conn(0x7fd9b00cfe00 msgr2=0x7fd9b00afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:56.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.038+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1412521430 shutdown_connections 2023-08-25T04:43:56.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.038+0000 7fd9b7c13700 1 -- 172.21.15.16:0/1412521430 wait complete. 2023-08-25T04:43:56.051 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:43:56.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.178+0000 7fda0b4ec700 1 Processor -- start 2023-08-25T04:43:56.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.178+0000 7fda0b4ec700 1 -- start start 2023-08-25T04:43:56.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.179+0000 7fda0b4ec700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda0415d370 0x7fda040d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.179+0000 7fda0b4ec700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda040d0060 con 0x7fda040b0030 2023-08-25T04:43:56.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.179+0000 7fda0b4ec700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda040d0340 con 0x7fda040cde10 2023-08-25T04:43:56.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.179+0000 7fda0b4ec700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda040d0620 con 0x7fda0415d370 2023-08-25T04:43:56.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.179+0000 7fda08a87700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fda040b0030 0x7fda040cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40080/0 (socket says 172.21.15.16:40080) 2023-08-25T04:43:56.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.179+0000 7fda08a87700 1 -- 172.21.15.16:0/1315686025 learned_addr learned my addr 172.21.15.16:0/1315686025 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:56.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.180+0000 7fda09288700 1 --2- 172.21.15.16:0/1315686025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda0415d370 0x7fda040d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.180+0000 7fd9fbfff700 1 -- 172.21.15.16:0/1315686025 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191364038 0 0) 0x7fda040d0060 con 0x7fda040b0030 2023-08-25T04:43:56.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.180+0000 7fd9fbfff700 1 -- 172.21.15.16:0/1315686025 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9f00035b0 con 0x7fda040b0030 2023-08-25T04:43:56.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.180+0000 7fda09288700 1 -- 172.21.15.16:0/1315686025 >> v1:172.21.15.117:6789/0 conn(0x7fda040cde10 legacy=0x7fda040cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.180+0000 7fda09288700 1 -- 172.21.15.16:0/1315686025 >> v1:172.21.15.16:6789/0 conn(0x7fda040b0030 legacy=0x7fda040cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.180+0000 7fd9fbfff700 1 -- 172.21.15.16:0/1315686025 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479991196 0 0) 0x7fda040d0340 con 0x7fda040cde10 2023-08-25T04:43:56.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.180+0000 7fda09288700 1 -- 172.21.15.16:0/1315686025 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda040cb650 con 0x7fda0415d370 2023-08-25T04:43:56.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.180+0000 7fda09288700 1 --2- 172.21.15.16:0/1315686025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda0415d370 0x7fda040d19a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fda00009850 tx=0x7fda00009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99f13b0af0f41ba1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:56.183 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.180+0000 7fd9fbfff700 1 -- 172.21.15.16:0/1315686025 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4001670 con 0x7fda0415d370 2023-08-25T04:43:56.183 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.180+0000 7fd9fbfff700 1 -- 172.21.15.16:0/1315686025 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda00005c30 con 0x7fda0415d370 2023-08-25T04:43:56.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.180+0000 7fd9fbfff700 1 -- 172.21.15.16:0/1315686025 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00006030 con 0x7fda0415d370 2023-08-25T04:43:56.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.181+0000 7fda0b4ec700 1 -- 172.21.15.16:0/1315686025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda0415d370 msgr2=0x7fda040d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.181+0000 7fda0b4ec700 1 --2- 172.21.15.16:0/1315686025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda0415d370 0x7fda040d19a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fda00009850 tx=0x7fda00009b60 comp rx=0 tx=0).stop 2023-08-25T04:43:56.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.181+0000 7fda0b4ec700 1 -- 172.21.15.16:0/1315686025 shutdown_connections 2023-08-25T04:43:56.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.181+0000 7fda0b4ec700 1 --2- 172.21.15.16:0/1315686025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda0415d370 0x7fda040d19a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.181+0000 7fda0b4ec700 1 -- 172.21.15.16:0/1315686025 >> 172.21.15.16:0/1315686025 conn(0x7fda040d0e80 msgr2=0x7fda040d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:56.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.181+0000 7fda0b4ec700 1 -- 172.21.15.16:0/1315686025 shutdown_connections 2023-08-25T04:43:56.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.181+0000 7fda0b4ec700 1 -- 172.21.15.16:0/1315686025 wait complete. 2023-08-25T04:43:56.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.182+0000 7fda0b4ec700 1 Processor -- start 2023-08-25T04:43:56.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.182+0000 7fda0b4ec700 1 -- start start 2023-08-25T04:43:56.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda0b4ec700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda040b0030 0x7fda040c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda0b4ec700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda040cde10 0x7fda04150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda0b4ec700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda0415d370 0x7fda040b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda0b4ec700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda040c60b0 con 0x7fda0415d370 2023-08-25T04:43:56.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda0b4ec700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda04150690 con 0x7fda040cde10 2023-08-25T04:43:56.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda0b4ec700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda040b4070 con 0x7fda040b0030 2023-08-25T04:43:56.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda09a89700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda0415d370 0x7fda040b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda09a89700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda0415d370 0x7fda040b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49674/0 (socket says 172.21.15.16:49674) 2023-08-25T04:43:56.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda09a89700 1 -- 172.21.15.16:0/3531418290 learned_addr learned my addr 172.21.15.16:0/3531418290 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:56.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda08a87700 1 --2- 172.21.15.16:0/3531418290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda040cde10 0x7fda04150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda09288700 1 --2- 172.21.15.16:0/3531418290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda040b0030 0x7fda040c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda09a89700 1 -- 172.21.15.16:0/3531418290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda040b0030 msgr2=0x7fda040c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda09a89700 1 --2- 172.21.15.16:0/3531418290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda040b0030 0x7fda040c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda09a89700 1 -- 172.21.15.16:0/3531418290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda040cde10 msgr2=0x7fda04150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda09a89700 1 --2- 172.21.15.16:0/3531418290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda040cde10 0x7fda04150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.183+0000 7fda09a89700 1 -- 172.21.15.16:0/3531418290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda00009430 con 0x7fda0415d370 2023-08-25T04:43:56.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.184+0000 7fda09a89700 1 --2- 172.21.15.16:0/3531418290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda0415d370 0x7fda040b4690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00c820 tx=0x7fd9fc00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:56.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.184+0000 7fd9f9ffb700 1 -- 172.21.15.16:0/3531418290 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc003e30 con 0x7fda0415d370 2023-08-25T04:43:56.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.184+0000 7fd9f9ffb700 1 -- 172.21.15.16:0/3531418290 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc0050f0 con 0x7fda0415d370 2023-08-25T04:43:56.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.184+0000 7fda0b4ec700 1 -- 172.21.15.16:0/3531418290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda040c5a60 con 0x7fda0415d370 2023-08-25T04:43:56.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.184+0000 7fd9f9ffb700 1 -- 172.21.15.16:0/3531418290 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc0054a0 con 0x7fda0415d370 2023-08-25T04:43:56.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.184+0000 7fda0b4ec700 1 -- 172.21.15.16:0/3531418290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda040b4350 con 0x7fda0415d370 2023-08-25T04:43:56.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.185+0000 7fda0b4ec700 1 -- 172.21.15.16:0/3531418290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda040c6260 con 0x7fda0415d370 2023-08-25T04:43:56.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.185+0000 7fd9f9ffb700 1 -- 172.21.15.16:0/3531418290 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd9fc005600 con 0x7fda0415d370 2023-08-25T04:43:56.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.186+0000 7fd9f9ffb700 1 --2- 172.21.15.16:0/3531418290 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd9e806a0e0 0x7fd9e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.186+0000 7fd9f9ffb700 1 -- 172.21.15.16:0/3531418290 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9fc087cd0 con 0x7fda0415d370 2023-08-25T04:43:56.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.186+0000 7fda09288700 1 --2- 172.21.15.16:0/3531418290 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd9e806a0e0 0x7fd9e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.186+0000 7fda09288700 1 --2- 172.21.15.16:0/3531418290 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd9e806a0e0 0x7fd9e806c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fda000097a0 tx=0x7fda00007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:56.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.190+0000 7fd9f9ffb700 1 -- 172.21.15.16:0/3531418290 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fda040c6260 con 0x7fda0415d370 2023-08-25T04:43:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.391+0000 7fda0b4ec700 1 -- 172.21.15.16:0/3531418290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda0404ee70 con 0x7fda0415d370 2023-08-25T04:43:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.391+0000 7fd9f9ffb700 1 -- 172.21.15.16:0/3531418290 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd9fc0170a0 con 0x7fda0415d370 2023-08-25T04:43:56.392 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-08-25T04:43:56.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.393+0000 7fda0b4ec700 1 -- 172.21.15.16:0/3531418290 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd9e806a0e0 msgr2=0x7fd9e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.393+0000 7fda0b4ec700 1 --2- 172.21.15.16:0/3531418290 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd9e806a0e0 0x7fd9e806c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fda000097a0 tx=0x7fda00007000 comp rx=0 tx=0).stop 2023-08-25T04:43:56.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.393+0000 7fda0b4ec700 1 -- 172.21.15.16:0/3531418290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda0415d370 msgr2=0x7fda040b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.393+0000 7fda0b4ec700 1 --2- 172.21.15.16:0/3531418290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda0415d370 0x7fda040b4690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00c820 tx=0x7fd9fc00cbe0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.393+0000 7fda0b4ec700 1 -- 172.21.15.16:0/3531418290 shutdown_connections 2023-08-25T04:43:56.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.393+0000 7fda0b4ec700 1 --2- 172.21.15.16:0/3531418290 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd9e806a0e0 0x7fd9e806c5a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.393+0000 7fda0b4ec700 1 --2- 172.21.15.16:0/3531418290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda0415d370 0x7fda040b4690 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.393+0000 7fda0b4ec700 1 --2- 172.21.15.16:0/3531418290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda040b0030 0x7fda040c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.393+0000 7fda0b4ec700 1 --2- 172.21.15.16:0/3531418290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda040cde10 0x7fda04150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.393+0000 7fda0b4ec700 1 -- 172.21.15.16:0/3531418290 >> 172.21.15.16:0/3531418290 conn(0x7fda040d0e80 msgr2=0x7fda040d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:56.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.393+0000 7fda0b4ec700 1 -- 172.21.15.16:0/3531418290 shutdown_connections 2023-08-25T04:43:56.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.393+0000 7fda0b4ec700 1 -- 172.21.15.16:0/3531418290 wait complete. 2023-08-25T04:43:56.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:43:56.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.534+0000 7fe057c8f700 1 Processor -- start 2023-08-25T04:43:56.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.534+0000 7fe057c8f700 1 -- start start 2023-08-25T04:43:56.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe057c8f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe050065fe0 0x7fe05006bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe057c8f700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05006c4c0 con 0x7fe05015a190 2023-08-25T04:43:56.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe057c8f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0500aeb20 con 0x7fe05006aa50 2023-08-25T04:43:56.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe057c8f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe050066510 con 0x7fe050065fe0 2023-08-25T04:43:56.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe055a2b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe05015a190 0x7fe05006a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40094/0 (socket says 172.21.15.16:40094) 2023-08-25T04:43:56.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe055a2b700 1 -- 172.21.15.16:0/3873588398 learned_addr learned my addr 172.21.15.16:0/3873588398 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:56.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe05622c700 1 --2- 172.21.15.16:0/3873588398 >> v2:172.21.15.117:3300/0 conn(0x7fe050065fe0 0x7fe05006bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885575668 0 0) 0x7fe04c001290 con 0x7fe05015a190 2023-08-25T04:43:56.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe03c0035b0 con 0x7fe05015a190 2023-08-25T04:43:56.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279643423 0 0) 0x7fe0500aeb20 con 0x7fe05006aa50 2023-08-25T04:43:56.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe04c001290 con 0x7fe05006aa50 2023-08-25T04:43:56.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1879305883 0 0) 0x7fe03c0035b0 con 0x7fe05015a190 2023-08-25T04:43:56.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 >> v2:172.21.15.117:3300/0 conn(0x7fe050065fe0 msgr2=0x7fe05006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:56.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 --2- 172.21.15.16:0/3873588398 >> v2:172.21.15.117:3300/0 conn(0x7fe050065fe0 0x7fe05006bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 >> v1:172.21.15.117:6789/0 conn(0x7fe05006aa50 legacy=0x7fe0500cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05006b560 con 0x7fe05015a190 2023-08-25T04:43:56.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7fe04c001980 con 0x7fe05015a190 2023-08-25T04:43:56.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe05622c700 1 --2- 172.21.15.16:0/3873588398 >> v2:172.21.15.117:3300/0 conn(0x7fe050065fe0 0x7fe05006bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:43:56.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 >> v1:172.21.15.16:6789/0 conn(0x7fe05015a190 legacy=0x7fe05006a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 --2- 172.21.15.16:0/3873588398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe03c003b90 0x7fe03c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 --2- 172.21.15.16:0/3873588398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe03c004850 0x7fe03c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 --2- 172.21.15.16:0/3873588398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe03c005210 0x7fe03c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe050066510 con 0x7fe03c004850 2023-08-25T04:43:56.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c00c090 con 0x7fe03c003b90 2023-08-25T04:43:56.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c00c250 con 0x7fe03c005210 2023-08-25T04:43:56.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe05522a700 1 --2- 172.21.15.16:0/3873588398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe03c004850 0x7fe03c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.535+0000 7fe055a2b700 1 --2- 172.21.15.16:0/3873588398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe03c003b90 0x7fe03c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.536+0000 7fe05622c700 1 --2- 172.21.15.16:0/3873588398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe03c005210 0x7fe03c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.536+0000 7fe05522a700 1 -- 172.21.15.16:0/3873588398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe03c005210 msgr2=0x7fe03c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:56.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.536+0000 7fe05522a700 1 --2- 172.21.15.16:0/3873588398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe03c005210 0x7fe03c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.536+0000 7fe05522a700 1 -- 172.21.15.16:0/3873588398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe03c003b90 msgr2=0x7fe03c003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:56.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.536+0000 7fe05522a700 1 --2- 172.21.15.16:0/3873588398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe03c003b90 0x7fe03c003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.536+0000 7fe05522a700 1 -- 172.21.15.16:0/3873588398 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c0035b0 con 0x7fe03c004850 2023-08-25T04:43:56.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.536+0000 7fe05622c700 1 --2- 172.21.15.16:0/3873588398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe03c005210 0x7fe03c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:56.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.536+0000 7fe05622c700 1 -- 172.21.15.16:0/3873588398 reap_dead start 2023-08-25T04:43:56.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.536+0000 7fe05522a700 1 --2- 172.21.15.16:0/3873588398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe03c004850 0x7fe03c004cd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe0500aee40 tx=0x7fe03c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa95d4ebfb470c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:56.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.536+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe040001430 con 0x7fe03c004850 2023-08-25T04:43:56.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.536+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0400052d0 con 0x7fe03c004850 2023-08-25T04:43:56.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.536+0000 7fe054a29700 1 -- 172.21.15.16:0/3873588398 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe040001d40 con 0x7fe03c004850 2023-08-25T04:43:56.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.536+0000 7fe057c8f700 1 -- 172.21.15.16:0/3873588398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe03c004850 msgr2=0x7fe03c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.536+0000 7fe057c8f700 1 --2- 172.21.15.16:0/3873588398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe03c004850 0x7fe03c004cd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe0500aee40 tx=0x7fe03c005880 comp rx=0 tx=0).stop 2023-08-25T04:43:56.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.537+0000 7fe057c8f700 1 -- 172.21.15.16:0/3873588398 shutdown_connections 2023-08-25T04:43:56.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.537+0000 7fe057c8f700 1 --2- 172.21.15.16:0/3873588398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe03c004850 0x7fe03c004cd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.537+0000 7fe057c8f700 1 -- 172.21.15.16:0/3873588398 >> 172.21.15.16:0/3873588398 conn(0x7fe0500b2440 msgr2=0x7fe0500b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:56.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.537+0000 7fe057c8f700 1 -- 172.21.15.16:0/3873588398 shutdown_connections 2023-08-25T04:43:56.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.537+0000 7fe057c8f700 1 -- 172.21.15.16:0/3873588398 wait complete. 2023-08-25T04:43:56.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.538+0000 7fe057c8f700 1 Processor -- start 2023-08-25T04:43:56.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.538+0000 7fe057c8f700 1 -- start start 2023-08-25T04:43:56.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.539+0000 7fe057c8f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe03c004850 0x7fe0501e4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.539+0000 7fe057c8f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0500cb9d0 0x7fe0501f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.539+0000 7fe057c8f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0501f21c0 0x7fe0500ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.539+0000 7fe057c8f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0500cbe50 con 0x7fe0501f21c0 2023-08-25T04:43:56.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.539+0000 7fe057c8f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0501e29d0 con 0x7fe03c004850 2023-08-25T04:43:56.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.539+0000 7fe057c8f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0501f38c0 con 0x7fe0500cb9d0 2023-08-25T04:43:56.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.539+0000 7fe05622c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0501f21c0 0x7fe0500ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.539+0000 7fe05622c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0501f21c0 0x7fe0500ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49694/0 (socket says 172.21.15.16:49694) 2023-08-25T04:43:56.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.539+0000 7fe05622c700 1 -- 172.21.15.16:0/2598614254 learned_addr learned my addr 172.21.15.16:0/2598614254 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:56.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.539+0000 7fe055a2b700 1 --2- 172.21.15.16:0/2598614254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe03c004850 0x7fe0501e4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.539+0000 7fe05522a700 1 --2- 172.21.15.16:0/2598614254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0500cb9d0 0x7fe0501f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.540+0000 7fe05622c700 1 -- 172.21.15.16:0/2598614254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0500cb9d0 msgr2=0x7fe0501f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.540+0000 7fe05622c700 1 --2- 172.21.15.16:0/2598614254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0500cb9d0 0x7fe0501f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.540+0000 7fe05622c700 1 -- 172.21.15.16:0/2598614254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe03c004850 msgr2=0x7fe0501e4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.540+0000 7fe05622c700 1 --2- 172.21.15.16:0/2598614254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe03c004850 0x7fe0501e4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.540+0000 7fe05622c700 1 -- 172.21.15.16:0/2598614254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0501f29d0 con 0x7fe0501f21c0 2023-08-25T04:43:56.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.540+0000 7fe05622c700 1 --2- 172.21.15.16:0/2598614254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0501f21c0 0x7fe0500ad2c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe050071440 tx=0x7fe0480114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:56.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.540+0000 7fe0467fc700 1 -- 172.21.15.16:0/2598614254 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04800e070 con 0x7fe0501f21c0 2023-08-25T04:43:56.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.540+0000 7fe0467fc700 1 -- 172.21.15.16:0/2598614254 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe048003c30 con 0x7fe0501f21c0 2023-08-25T04:43:56.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.540+0000 7fe057c8f700 1 -- 172.21.15.16:0/2598614254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0501f2cb0 con 0x7fe0501f21c0 2023-08-25T04:43:56.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.540+0000 7fe0467fc700 1 -- 172.21.15.16:0/2598614254 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048003de0 con 0x7fe0501f21c0 2023-08-25T04:43:56.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.540+0000 7fe057c8f700 1 -- 172.21.15.16:0/2598614254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0501e2c20 con 0x7fe0501f21c0 2023-08-25T04:43:56.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.541+0000 7fe057c8f700 1 -- 172.21.15.16:0/2598614254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0501f31d0 con 0x7fe0501f21c0 2023-08-25T04:43:56.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.541+0000 7fe0467fc700 1 -- 172.21.15.16:0/2598614254 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe0480119c0 con 0x7fe0501f21c0 2023-08-25T04:43:56.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.542+0000 7fe0467fc700 1 --2- 172.21.15.16:0/2598614254 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe03406a0e0 0x7fe03406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.542+0000 7fe0467fc700 1 -- 172.21.15.16:0/2598614254 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe048088900 con 0x7fe0501f21c0 2023-08-25T04:43:56.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.542+0000 7fe055a2b700 1 --2- 172.21.15.16:0/2598614254 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe03406a0e0 0x7fe03406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.543+0000 7fe055a2b700 1 --2- 172.21.15.16:0/2598614254 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe03406a0e0 0x7fe03406c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe04c000ef0 tx=0x7fe04c007a80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:56.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.546+0000 7fe0467fc700 1 -- 172.21.15.16:0/2598614254 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe048054080 con 0x7fe0501f21c0 2023-08-25T04:43:56.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.748+0000 7fe057c8f700 1 -- 172.21.15.16:0/2598614254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe05004ee70 con 0x7fe0501f21c0 2023-08-25T04:43:56.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.748+0000 7fe0467fc700 1 -- 172.21.15.16:0/2598614254 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe0480576a0 con 0x7fe0501f21c0 2023-08-25T04:43:56.749 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-08-25T04:43:56.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.750+0000 7fe057c8f700 1 -- 172.21.15.16:0/2598614254 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe03406a0e0 msgr2=0x7fe03406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.750+0000 7fe057c8f700 1 --2- 172.21.15.16:0/2598614254 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe03406a0e0 0x7fe03406c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe04c000ef0 tx=0x7fe04c007a80 comp rx=0 tx=0).stop 2023-08-25T04:43:56.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.750+0000 7fe057c8f700 1 -- 172.21.15.16:0/2598614254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0501f21c0 msgr2=0x7fe0500ad2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.750+0000 7fe057c8f700 1 --2- 172.21.15.16:0/2598614254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0501f21c0 0x7fe0500ad2c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe050071440 tx=0x7fe0480114b0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.750+0000 7fe057c8f700 1 -- 172.21.15.16:0/2598614254 shutdown_connections 2023-08-25T04:43:56.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.750+0000 7fe057c8f700 1 --2- 172.21.15.16:0/2598614254 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe03406a0e0 0x7fe03406c5a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.750+0000 7fe057c8f700 1 --2- 172.21.15.16:0/2598614254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0501f21c0 0x7fe0500ad2c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.750+0000 7fe057c8f700 1 --2- 172.21.15.16:0/2598614254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe03c004850 0x7fe0501e4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.750+0000 7fe057c8f700 1 --2- 172.21.15.16:0/2598614254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0500cb9d0 0x7fe0501f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.750+0000 7fe057c8f700 1 -- 172.21.15.16:0/2598614254 >> 172.21.15.16:0/2598614254 conn(0x7fe0500b2440 msgr2=0x7fe0501592a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:56.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.750+0000 7fe057c8f700 1 -- 172.21.15.16:0/2598614254 shutdown_connections 2023-08-25T04:43:56.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.750+0000 7fe057c8f700 1 -- 172.21.15.16:0/2598614254 wait complete. 2023-08-25T04:43:56.768 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:43:56.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.893+0000 7f66e43dd700 1 Processor -- start 2023-08-25T04:43:56.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.893+0000 7f66e43dd700 1 -- start start 2023-08-25T04:43:56.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e43dd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f66dc15b380 0x7f66dc0701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e43dd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66dc0d0970 0x7f66dc0b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e43dd700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc0b33a0 con 0x7f66dc0b2fa0 2023-08-25T04:43:56.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e43dd700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc0cd900 con 0x7f66dc15b380 2023-08-25T04:43:56.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e43dd700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc070730 con 0x7f66dc0d0970 2023-08-25T04:43:56.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e2179700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f66dc15b380 0x7f66dc0701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e2179700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f66dc15b380 0x7f66dc0701f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49698/0 (socket says 172.21.15.16:49698) 2023-08-25T04:43:56.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e2179700 1 -- 172.21.15.16:0/1128691572 learned_addr learned my addr 172.21.15.16:0/1128691572 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:56.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e1978700 1 --2- 172.21.15.16:0/1128691572 >> v2:172.21.15.117:3300/0 conn(0x7f66dc0d0970 0x7f66dc0b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e2179700 1 -- 172.21.15.16:0/1128691572 >> v2:172.21.15.117:3300/0 conn(0x7f66dc0d0970 msgr2=0x7f66dc0b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:56.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e2179700 1 --2- 172.21.15.16:0/1128691572 >> v2:172.21.15.117:3300/0 conn(0x7f66dc0d0970 0x7f66dc0b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e2179700 1 -- 172.21.15.16:0/1128691572 >> v1:172.21.15.117:6789/0 conn(0x7f66dc0b2fa0 legacy=0x7f66dc0ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e2179700 1 -- 172.21.15.16:0/1128691572 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc0cd340 con 0x7f66dc15b380 2023-08-25T04:43:56.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e1978700 1 --2- 172.21.15.16:0/1128691572 >> v2:172.21.15.117:3300/0 conn(0x7f66dc0d0970 0x7f66dc0b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:56.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e2179700 1 --2- 172.21.15.16:0/1128691572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66dc15b380 0x7f66dc0701f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f66dc06f030 tx=0x7f66d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63737e2ed9218b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:56.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e1177700 1 -- 172.21.15.16:0/1128691572 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d800b870 con 0x7f66dc15b380 2023-08-25T04:43:56.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e1177700 1 -- 172.21.15.16:0/1128691572 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d800b9d0 con 0x7f66dc15b380 2023-08-25T04:43:56.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.894+0000 7f66e1177700 1 -- 172.21.15.16:0/1128691572 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d800bd60 con 0x7f66dc15b380 2023-08-25T04:43:56.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.895+0000 7f66e43dd700 1 -- 172.21.15.16:0/1128691572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66dc15b380 msgr2=0x7f66dc0701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.895+0000 7f66e43dd700 1 --2- 172.21.15.16:0/1128691572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66dc15b380 0x7f66dc0701f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f66dc06f030 tx=0x7f66d8009bd0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.895+0000 7f66e43dd700 1 -- 172.21.15.16:0/1128691572 shutdown_connections 2023-08-25T04:43:56.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.895+0000 7f66e43dd700 1 --2- 172.21.15.16:0/1128691572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66dc15b380 0x7f66dc0701f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.895+0000 7f66e43dd700 1 --2- 172.21.15.16:0/1128691572 >> v2:172.21.15.117:3300/0 conn(0x7f66dc0d0970 0x7f66dc0b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.895+0000 7f66e43dd700 1 -- 172.21.15.16:0/1128691572 >> 172.21.15.16:0/1128691572 conn(0x7f66dc0d0fe0 msgr2=0x7f66dc0d13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:56.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.895+0000 7f66e43dd700 1 -- 172.21.15.16:0/1128691572 shutdown_connections 2023-08-25T04:43:56.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.895+0000 7f66e43dd700 1 -- 172.21.15.16:0/1128691572 wait complete. 2023-08-25T04:43:56.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.896+0000 7f66e43dd700 1 Processor -- start 2023-08-25T04:43:56.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.896+0000 7f66e43dd700 1 -- start start 2023-08-25T04:43:56.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.897+0000 7f66e43dd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66dc0b2fa0 0x7f66dc0af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.897+0000 7f66e43dd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66dc0d0970 0x7f66dc06be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.897+0000 7f66e43dd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66dc15b380 0x7f66dc0ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.897+0000 7f66e43dd700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc15b950 con 0x7f66dc15b380 2023-08-25T04:43:56.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.897+0000 7f66e43dd700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc1590b0 con 0x7f66dc0d0970 2023-08-25T04:43:56.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.897+0000 7f66e43dd700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc06c6b0 con 0x7f66dc0b2fa0 2023-08-25T04:43:56.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.897+0000 7f66e297a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66dc15b380 0x7f66dc0ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.897+0000 7f66e297a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66dc15b380 0x7f66dc0ae1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49708/0 (socket says 172.21.15.16:49708) 2023-08-25T04:43:56.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.897+0000 7f66e297a700 1 -- 172.21.15.16:0/369520209 learned_addr learned my addr 172.21.15.16:0/369520209 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:56.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.897+0000 7f66e1978700 1 --2- 172.21.15.16:0/369520209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66dc0d0970 0x7f66dc06be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.897+0000 7f66e2179700 1 --2- 172.21.15.16:0/369520209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66dc0b2fa0 0x7f66dc0af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.898+0000 7f66e297a700 1 -- 172.21.15.16:0/369520209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66dc0b2fa0 msgr2=0x7f66dc0af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.898+0000 7f66e297a700 1 --2- 172.21.15.16:0/369520209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66dc0b2fa0 0x7f66dc0af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.898+0000 7f66e297a700 1 -- 172.21.15.16:0/369520209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66dc0d0970 msgr2=0x7f66dc06be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:56.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.898+0000 7f66e297a700 1 --2- 172.21.15.16:0/369520209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66dc0d0970 0x7f66dc06be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:56.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.898+0000 7f66e297a700 1 -- 172.21.15.16:0/369520209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d8009550 con 0x7f66dc15b380 2023-08-25T04:43:56.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.898+0000 7f66e297a700 1 --2- 172.21.15.16:0/369520209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66dc15b380 0x7f66dc0ae1b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66d400cc50 tx=0x7f66d400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:56.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.898+0000 7f66d2ffd700 1 -- 172.21.15.16:0/369520209 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4003c00 con 0x7f66dc15b380 2023-08-25T04:43:56.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.898+0000 7f66d2ffd700 1 -- 172.21.15.16:0/369520209 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d4003d60 con 0x7f66dc15b380 2023-08-25T04:43:56.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.898+0000 7f66e43dd700 1 -- 172.21.15.16:0/369520209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc06c990 con 0x7f66dc15b380 2023-08-25T04:43:56.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.898+0000 7f66d2ffd700 1 -- 172.21.15.16:0/369520209 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d400aab0 con 0x7f66dc15b380 2023-08-25T04:43:56.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.898+0000 7f66e43dd700 1 -- 172.21.15.16:0/369520209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc15bbf0 con 0x7f66dc15b380 2023-08-25T04:43:56.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.899+0000 7f66e43dd700 1 -- 172.21.15.16:0/369520209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66dc04ee70 con 0x7f66dc15b380 2023-08-25T04:43:56.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.899+0000 7f66d2ffd700 1 -- 172.21.15.16:0/369520209 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f66d400ac10 con 0x7f66dc15b380 2023-08-25T04:43:56.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.900+0000 7f66d2ffd700 1 --2- 172.21.15.16:0/369520209 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f66c006a0e0 0x7f66c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:56.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.900+0000 7f66d2ffd700 1 -- 172.21.15.16:0/369520209 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f66d4088500 con 0x7f66dc15b380 2023-08-25T04:43:56.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.900+0000 7f66e2179700 1 --2- 172.21.15.16:0/369520209 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f66c006a0e0 0x7f66c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:56.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.900+0000 7f66e2179700 1 --2- 172.21.15.16:0/369520209 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f66c006a0e0 0x7f66c006c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f66d8014040 tx=0x7f66d8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:56.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:56.904+0000 7f66d2ffd700 1 -- 172.21.15.16:0/369520209 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f66d4053bf0 con 0x7f66dc15b380 2023-08-25T04:43:57.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.153+0000 7f66e43dd700 1 -- 172.21.15.16:0/369520209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66dc0cf1f0 con 0x7f66dc15b380 2023-08-25T04:43:57.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.153+0000 7f66d2ffd700 1 -- 172.21.15.16:0/369520209 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4863 (secure 0 0 0) 0x7f66d4057210 con 0x7f66dc15b380 2023-08-25T04:43:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:57.154 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/397913125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":397913125},{"type":"v1","addr":"172.21.15.16:6834","nonce":397913125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1401503507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1401503507},{"type":"v1","addr":"172.21.15.117:6835","nonce":1401503507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/899398848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":899398848},{"type":"v1","addr":"172.21.15.16:6835","nonce":899398848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:43:42.297594+0000","modified":"2023-08-25T04:43:45.899399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/36836471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":36836471},{"type":"v1","addr":"172.21.15.117:6837","nonce":36836471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:43:57.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.155+0000 7f66e43dd700 1 -- 172.21.15.16:0/369520209 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f66c006a0e0 msgr2=0x7f66c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:57.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.155+0000 7f66e43dd700 1 --2- 172.21.15.16:0/369520209 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f66c006a0e0 0x7f66c006c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f66d8014040 tx=0x7f66d8008030 comp rx=0 tx=0).stop 2023-08-25T04:43:57.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.156+0000 7f66e43dd700 1 -- 172.21.15.16:0/369520209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66dc15b380 msgr2=0x7f66dc0ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:57.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.156+0000 7f66e43dd700 1 --2- 172.21.15.16:0/369520209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66dc15b380 0x7f66dc0ae1b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66d400cc50 tx=0x7f66d400cf60 comp rx=0 tx=0).stop 2023-08-25T04:43:57.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.156+0000 7f66e43dd700 1 -- 172.21.15.16:0/369520209 shutdown_connections 2023-08-25T04:43:57.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.156+0000 7f66e43dd700 1 --2- 172.21.15.16:0/369520209 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f66c006a0e0 0x7f66c006c5a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.156+0000 7f66e43dd700 1 --2- 172.21.15.16:0/369520209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66dc15b380 0x7f66dc0ae1b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.156+0000 7f66e43dd700 1 --2- 172.21.15.16:0/369520209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66dc0b2fa0 0x7f66dc0af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.156+0000 7f66e43dd700 1 --2- 172.21.15.16:0/369520209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66dc0d0970 0x7f66dc06be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.156+0000 7f66e43dd700 1 -- 172.21.15.16:0/369520209 >> 172.21.15.16:0/369520209 conn(0x7f66dc0d0fe0 msgr2=0x7f66dc0cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:57.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.156+0000 7f66e43dd700 1 -- 172.21.15.16:0/369520209 shutdown_connections 2023-08-25T04:43:57.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.156+0000 7f66e43dd700 1 -- 172.21.15.16:0/369520209 wait complete. 2023-08-25T04:43:57.158 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2023-08-25T04:43:57.168 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:43:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.292+0000 7f4c858bc700 1 Processor -- start 2023-08-25T04:43:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.292+0000 7f4c858bc700 1 -- start start 2023-08-25T04:43:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c858bc700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4c800d3dc0 0x7f4c800d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:57.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c858bc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4c800b3070 0x7f4c800b3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:57.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c858bc700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c800b2be0 con 0x7f4c8015d520 2023-08-25T04:43:57.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c858bc700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c800ce6f0 con 0x7f4c800b3070 2023-08-25T04:43:57.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c858bc700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8015d900 con 0x7f4c800d3dc0 2023-08-25T04:43:57.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c7f7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4c800b3070 0x7f4c800b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:57.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c7effd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4c8015d520 0x7f4c800d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40126/0 (socket says 172.21.15.16:40126) 2023-08-25T04:43:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c7effd700 1 -- 172.21.15.16:0/2840508345 learned_addr learned my addr 172.21.15.16:0/2840508345 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c7e7fc700 1 --2- 172.21.15.16:0/2840508345 >> v2:172.21.15.117:3300/0 conn(0x7f4c800d3dc0 0x7f4c800d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c7f7fe700 1 -- 172.21.15.16:0/2840508345 >> v2:172.21.15.117:3300/0 conn(0x7f4c800d3dc0 msgr2=0x7f4c800d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c7f7fe700 1 --2- 172.21.15.16:0/2840508345 >> v2:172.21.15.117:3300/0 conn(0x7f4c800d3dc0 0x7f4c800d13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c7f7fe700 1 -- 172.21.15.16:0/2840508345 >> v1:172.21.15.16:6789/0 conn(0x7f4c8015d520 legacy=0x7f4c800d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c7f7fe700 1 -- 172.21.15.16:0/2840508345 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c800d0a40 con 0x7f4c800b3070 2023-08-25T04:43:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c7dffb700 1 -- 172.21.15.16:0/2840508345 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130413921 0 0) 0x7f4c800b2be0 con 0x7f4c8015d520 2023-08-25T04:43:57.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c7f7fe700 1 --2- 172.21.15.16:0/2840508345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c800b3070 0x7f4c800b3500 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4c80072980 tx=0x7f4c7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b772fc4ede5c2533 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:57.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.293+0000 7f4c7dffb700 1 -- 172.21.15.16:0/2840508345 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7800e070 con 0x7f4c800b3070 2023-08-25T04:43:57.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.294+0000 7f4c7dffb700 1 -- 172.21.15.16:0/2840508345 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7800bbd0 con 0x7f4c800b3070 2023-08-25T04:43:57.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.294+0000 7f4c7dffb700 1 -- 172.21.15.16:0/2840508345 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78012430 con 0x7f4c800b3070 2023-08-25T04:43:57.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.294+0000 7f4c858bc700 1 -- 172.21.15.16:0/2840508345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c800b3070 msgr2=0x7f4c800b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:57.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.294+0000 7f4c858bc700 1 --2- 172.21.15.16:0/2840508345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c800b3070 0x7f4c800b3500 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4c80072980 tx=0x7f4c7800b330 comp rx=0 tx=0).stop 2023-08-25T04:43:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.294+0000 7f4c858bc700 1 -- 172.21.15.16:0/2840508345 shutdown_connections 2023-08-25T04:43:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.294+0000 7f4c858bc700 1 --2- 172.21.15.16:0/2840508345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c800b3070 0x7f4c800b3500 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.294+0000 7f4c858bc700 1 --2- 172.21.15.16:0/2840508345 >> v2:172.21.15.117:3300/0 conn(0x7f4c800d3dc0 0x7f4c800d13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.294+0000 7f4c858bc700 1 -- 172.21.15.16:0/2840508345 >> 172.21.15.16:0/2840508345 conn(0x7f4c800d3110 msgr2=0x7f4c800d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.294+0000 7f4c858bc700 1 -- 172.21.15.16:0/2840508345 shutdown_connections 2023-08-25T04:43:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.294+0000 7f4c858bc700 1 -- 172.21.15.16:0/2840508345 wait complete. 2023-08-25T04:43:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.295+0000 7f4c858bc700 1 Processor -- start 2023-08-25T04:43:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.295+0000 7f4c858bc700 1 -- start start 2023-08-25T04:43:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.296+0000 7f4c858bc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c800b3070 0x7f4c801f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.296+0000 7f4c858bc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c800d3dc0 0x7f4c8006c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.296+0000 7f4c858bc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c8015d520 0x7f4c8006c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.296+0000 7f4c858bc700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c801f7140 con 0x7f4c8015d520 2023-08-25T04:43:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.296+0000 7f4c858bc700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c801f6500 con 0x7f4c800d3dc0 2023-08-25T04:43:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.296+0000 7f4c858bc700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c801f67a0 con 0x7f4c800b3070 2023-08-25T04:43:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.296+0000 7f4c7f7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c8015d520 0x7f4c8006c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:57.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.296+0000 7f4c7f7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c8015d520 0x7f4c8006c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49722/0 (socket says 172.21.15.16:49722) 2023-08-25T04:43:57.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.296+0000 7f4c7f7fe700 1 -- 172.21.15.16:0/3576317008 learned_addr learned my addr 172.21.15.16:0/3576317008 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:57.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.296+0000 7f4c7e7fc700 1 --2- 172.21.15.16:0/3576317008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c800d3dc0 0x7f4c8006c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:57.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.296+0000 7f4c7effd700 1 --2- 172.21.15.16:0/3576317008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c800b3070 0x7f4c801f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:57.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.297+0000 7f4c7f7fe700 1 -- 172.21.15.16:0/3576317008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c800b3070 msgr2=0x7f4c801f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:57.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.297+0000 7f4c7f7fe700 1 --2- 172.21.15.16:0/3576317008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c800b3070 0x7f4c801f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.297+0000 7f4c7f7fe700 1 -- 172.21.15.16:0/3576317008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c800d3dc0 msgr2=0x7f4c8006c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:57.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.297+0000 7f4c7f7fe700 1 --2- 172.21.15.16:0/3576317008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c800d3dc0 0x7f4c8006c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.297+0000 7f4c7f7fe700 1 -- 172.21.15.16:0/3576317008 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78009a70 con 0x7f4c8015d520 2023-08-25T04:43:57.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.297+0000 7f4c7f7fe700 1 --2- 172.21.15.16:0/3576317008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c8015d520 0x7f4c8006c600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4c80072a50 tx=0x7f4c78004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:57.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.297+0000 7f4c67fff700 1 -- 172.21.15.16:0/3576317008 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78012430 con 0x7f4c8015d520 2023-08-25T04:43:57.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.297+0000 7f4c67fff700 1 -- 172.21.15.16:0/3576317008 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c78020070 con 0x7f4c8015d520 2023-08-25T04:43:57.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.297+0000 7f4c858bc700 1 -- 172.21.15.16:0/3576317008 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c801f6a80 con 0x7f4c8015d520 2023-08-25T04:43:57.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.297+0000 7f4c67fff700 1 -- 172.21.15.16:0/3576317008 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78004280 con 0x7f4c8015d520 2023-08-25T04:43:57.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.297+0000 7f4c858bc700 1 -- 172.21.15.16:0/3576317008 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c801f2c80 con 0x7f4c8015d520 2023-08-25T04:43:57.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.298+0000 7f4c858bc700 1 -- 172.21.15.16:0/3576317008 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c800d24d0 con 0x7f4c8015d520 2023-08-25T04:43:57.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.298+0000 7f4c67fff700 1 -- 172.21.15.16:0/3576317008 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4c780043e0 con 0x7f4c8015d520 2023-08-25T04:43:57.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.299+0000 7f4c67fff700 1 --2- 172.21.15.16:0/3576317008 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4c6c06a0e0 0x7f4c6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:57.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.299+0000 7f4c67fff700 1 -- 172.21.15.16:0/3576317008 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4c78022070 con 0x7f4c8015d520 2023-08-25T04:43:57.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.299+0000 7f4c7effd700 1 --2- 172.21.15.16:0/3576317008 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4c6c06a0e0 0x7f4c6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:57.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.299+0000 7f4c7effd700 1 --2- 172.21.15.16:0/3576317008 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4c6c06a0e0 0x7f4c6c06c5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4c74000f60 tx=0x7f4c74007c90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:57.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.303+0000 7f4c67fff700 1 -- 172.21.15.16:0/3576317008 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4c78056110 con 0x7f4c8015d520 2023-08-25T04:43:57.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.505+0000 7f4c858bc700 1 -- 172.21.15.16:0/3576317008 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c8004ee70 con 0x7f4c8015d520 2023-08-25T04:43:57.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.506+0000 7f4c67fff700 1 -- 172.21.15.16:0/3576317008 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18233 (secure 0 0 0) 0x7f4c78059730 con 0x7f4c8015d520 2023-08-25T04:43:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:57.507 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:43:43.870075+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:43:40.197381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:43:41.268759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:43:57.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.508+0000 7f4c858bc700 1 -- 172.21.15.16:0/3576317008 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4c6c06a0e0 msgr2=0x7f4c6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:57.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.508+0000 7f4c858bc700 1 --2- 172.21.15.16:0/3576317008 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4c6c06a0e0 0x7f4c6c06c5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4c74000f60 tx=0x7f4c74007c90 comp rx=0 tx=0).stop 2023-08-25T04:43:57.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.508+0000 7f4c858bc700 1 -- 172.21.15.16:0/3576317008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c8015d520 msgr2=0x7f4c8006c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:57.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.508+0000 7f4c858bc700 1 --2- 172.21.15.16:0/3576317008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c8015d520 0x7f4c8006c600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4c80072a50 tx=0x7f4c78004ad0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.508+0000 7f4c858bc700 1 -- 172.21.15.16:0/3576317008 shutdown_connections 2023-08-25T04:43:57.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.508+0000 7f4c858bc700 1 --2- 172.21.15.16:0/3576317008 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4c6c06a0e0 0x7f4c6c06c5a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.508+0000 7f4c858bc700 1 --2- 172.21.15.16:0/3576317008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c8015d520 0x7f4c8006c600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.508+0000 7f4c858bc700 1 --2- 172.21.15.16:0/3576317008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c800b3070 0x7f4c801f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.508+0000 7f4c858bc700 1 --2- 172.21.15.16:0/3576317008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c800d3dc0 0x7f4c8006c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.508+0000 7f4c858bc700 1 -- 172.21.15.16:0/3576317008 >> 172.21.15.16:0/3576317008 conn(0x7f4c800d3110 msgr2=0x7f4c800b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:57.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.508+0000 7f4c858bc700 1 -- 172.21.15.16:0/3576317008 shutdown_connections 2023-08-25T04:43:57.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.509+0000 7f4c858bc700 1 -- 172.21.15.16:0/3576317008 wait complete. 2023-08-25T04:43:57.521 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:43:57.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.646+0000 7f5a356ab700 1 Processor -- start 2023-08-25T04:43:57.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.646+0000 7f5a356ab700 1 -- start start 2023-08-25T04:43:57.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a356ab700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a3015d520 0x7f5a300d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:57.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a356ab700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5a300d3dc0 0x7f5a300d1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:57.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a356ab700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5a300d1760 0x7f5a300cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:57.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a356ab700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a300ce6f0 con 0x7f5a300d3dc0 2023-08-25T04:43:57.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a356ab700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3015d900 con 0x7f5a300d1760 2023-08-25T04:43:57.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a356ab700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300b2be0 con 0x7f5a3015d520 2023-08-25T04:43:57.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a2e7fc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5a300d3dc0 0x7f5a300d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:57.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a2e7fc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5a300d3dc0 0x7f5a300d1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49728/0 (socket says 172.21.15.16:49728) 2023-08-25T04:43:57.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a2e7fc700 1 -- 172.21.15.16:0/3814306058 learned_addr learned my addr 172.21.15.16:0/3814306058 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:57.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a2f7fe700 1 --2- 172.21.15.16:0/3814306058 >> v2:172.21.15.117:3300/0 conn(0x7f5a300d1760 0x7f5a300cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:57.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a2effd700 1 --2- 172.21.15.16:0/3814306058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a3015d520 0x7f5a300d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:57.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a2e7fc700 1 -- 172.21.15.16:0/3814306058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a3015d520 msgr2=0x7f5a300d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:57.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a2e7fc700 1 --2- 172.21.15.16:0/3814306058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a3015d520 0x7f5a300d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a2e7fc700 1 -- 172.21.15.16:0/3814306058 >> v2:172.21.15.117:3300/0 conn(0x7f5a300d1760 msgr2=0x7f5a300cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:57.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a2e7fc700 1 --2- 172.21.15.16:0/3814306058 >> v2:172.21.15.117:3300/0 conn(0x7f5a300d1760 0x7f5a300cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.647+0000 7f5a2e7fc700 1 -- 172.21.15.16:0/3814306058 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a300ce900 con 0x7f5a300d3dc0 2023-08-25T04:43:57.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.648+0000 7f5a2e7fc700 1 --2- 172.21.15.16:0/3814306058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a300d3dc0 0x7f5a300d1220 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a3008d320 tx=0x7f5a20009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fddfd5e4ed50858 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:57.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.648+0000 7f5a2dffb700 1 -- 172.21.15.16:0/3814306058 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2000b870 con 0x7f5a300d3dc0 2023-08-25T04:43:57.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.648+0000 7f5a2dffb700 1 -- 172.21.15.16:0/3814306058 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2000b9d0 con 0x7f5a300d3dc0 2023-08-25T04:43:57.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.648+0000 7f5a2dffb700 1 -- 172.21.15.16:0/3814306058 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2000bd60 con 0x7f5a300d3dc0 2023-08-25T04:43:57.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.648+0000 7f5a356ab700 1 -- 172.21.15.16:0/3814306058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a300d3dc0 msgr2=0x7f5a300d1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:57.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.648+0000 7f5a356ab700 1 --2- 172.21.15.16:0/3814306058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a300d3dc0 0x7f5a300d1220 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a3008d320 tx=0x7f5a20009bd0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.648+0000 7f5a356ab700 1 -- 172.21.15.16:0/3814306058 shutdown_connections 2023-08-25T04:43:57.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.648+0000 7f5a356ab700 1 --2- 172.21.15.16:0/3814306058 >> v2:172.21.15.117:3300/0 conn(0x7f5a300d1760 0x7f5a300cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.648+0000 7f5a356ab700 1 --2- 172.21.15.16:0/3814306058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a3015d520 0x7f5a300d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.648+0000 7f5a356ab700 1 --2- 172.21.15.16:0/3814306058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a300d3dc0 0x7f5a300d1220 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.648+0000 7f5a356ab700 1 -- 172.21.15.16:0/3814306058 >> 172.21.15.16:0/3814306058 conn(0x7f5a300d3110 msgr2=0x7f5a300d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:57.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.648+0000 7f5a356ab700 1 -- 172.21.15.16:0/3814306058 shutdown_connections 2023-08-25T04:43:57.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.648+0000 7f5a356ab700 1 -- 172.21.15.16:0/3814306058 wait complete. 2023-08-25T04:43:57.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.650+0000 7f5a356ab700 1 Processor -- start 2023-08-25T04:43:57.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.650+0000 7f5a356ab700 1 -- start start 2023-08-25T04:43:57.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.650+0000 7f5a356ab700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a300d1760 0x7f5a3014d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:57.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.650+0000 7f5a356ab700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a300d3dc0 0x7f5a300ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:57.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.650+0000 7f5a356ab700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a3015d520 0x7f5a300b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:57.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.650+0000 7f5a356ab700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3015e3a0 con 0x7f5a300d3dc0 2023-08-25T04:43:57.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.650+0000 7f5a356ab700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300cd140 con 0x7f5a3015d520 2023-08-25T04:43:57.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.650+0000 7f5a356ab700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300ccb80 con 0x7f5a300d1760 2023-08-25T04:43:57.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a2e7fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a300d3dc0 0x7f5a300ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:57.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a2e7fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a300d3dc0 0x7f5a300ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49734/0 (socket says 172.21.15.16:49734) 2023-08-25T04:43:57.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a2e7fc700 1 -- 172.21.15.16:0/3182711670 learned_addr learned my addr 172.21.15.16:0/3182711670 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:57.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a2f7fe700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a3015d520 0x7f5a300b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:57.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a2effd700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a300d1760 0x7f5a3014d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:57.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a2e7fc700 1 -- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a300d1760 msgr2=0x7f5a3014d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:57.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a2e7fc700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a300d1760 0x7f5a3014d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a2e7fc700 1 -- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a3015d520 msgr2=0x7f5a300b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:57.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a2e7fc700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a3015d520 0x7f5a300b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a2e7fc700 1 -- 172.21.15.16:0/3182711670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a20009550 con 0x7f5a300d3dc0 2023-08-25T04:43:57.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a2f7fe700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a3015d520 0x7f5a300b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:57.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a2e7fc700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a300d3dc0 0x7f5a300ca1e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a20000c00 tx=0x7f5a20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:57.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a177fe700 1 -- 172.21.15.16:0/3182711670 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20004540 con 0x7f5a300d3dc0 2023-08-25T04:43:57.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a177fe700 1 -- 172.21.15.16:0/3182711670 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a200036a0 con 0x7f5a300d3dc0 2023-08-25T04:43:57.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a356ab700 1 -- 172.21.15.16:0/3182711670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a300cce60 con 0x7f5a300d3dc0 2023-08-25T04:43:57.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a177fe700 1 -- 172.21.15.16:0/3182711670 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20003a50 con 0x7f5a300d3dc0 2023-08-25T04:43:57.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.651+0000 7f5a356ab700 1 -- 172.21.15.16:0/3182711670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a30159960 con 0x7f5a300d3dc0 2023-08-25T04:43:57.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.652+0000 7f5a356ab700 1 -- 172.21.15.16:0/3182711670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3004ee70 con 0x7f5a300d3dc0 2023-08-25T04:43:57.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.653+0000 7f5a177fe700 1 -- 172.21.15.16:0/3182711670 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5a20021070 con 0x7f5a300d3dc0 2023-08-25T04:43:57.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.653+0000 7f5a177fe700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f5a1c06a0e0 0x7f5a1c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:57.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.653+0000 7f5a177fe700 1 -- 172.21.15.16:0/3182711670 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5a20089b80 con 0x7f5a300d3dc0 2023-08-25T04:43:57.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.653+0000 7f5a2effd700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f5a1c06a0e0 0x7f5a1c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:57.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.654+0000 7f5a2effd700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f5a1c06a0e0 0x7f5a1c06c5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a3015fe80 tx=0x7f5a24008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:57.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.657+0000 7f5a177fe700 1 -- 172.21.15.16:0/3182711670 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5a20055300 con 0x7f5a300d3dc0 2023-08-25T04:43:57.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.902+0000 7f5a356ab700 1 -- 172.21.15.16:0/3182711670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a300afdc0 con 0x7f5a300d3dc0 2023-08-25T04:43:57.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.902+0000 7f5a177fe700 1 -- 172.21.15.16:0/3182711670 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4863 (secure 0 0 0) 0x7f5a20015090 con 0x7f5a300d3dc0 2023-08-25T04:43:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:43:57.903 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/397913125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":397913125},{"type":"v1","addr":"172.21.15.16:6834","nonce":397913125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1401503507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1401503507},{"type":"v1","addr":"172.21.15.117:6835","nonce":1401503507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/899398848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":899398848},{"type":"v1","addr":"172.21.15.16:6835","nonce":899398848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:43:42.297594+0000","modified":"2023-08-25T04:43:45.899399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/36836471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":36836471},{"type":"v1","addr":"172.21.15.117:6837","nonce":36836471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:43:57.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.905+0000 7f5a356ab700 1 -- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f5a1c06a0e0 msgr2=0x7f5a1c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:57.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.905+0000 7f5a356ab700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f5a1c06a0e0 0x7f5a1c06c5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a3015fe80 tx=0x7f5a24008040 comp rx=0 tx=0).stop 2023-08-25T04:43:57.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.905+0000 7f5a356ab700 1 -- 172.21.15.16:0/3182711670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a300d3dc0 msgr2=0x7f5a300ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:57.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.905+0000 7f5a356ab700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a300d3dc0 0x7f5a300ca1e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a20000c00 tx=0x7f5a20004750 comp rx=0 tx=0).stop 2023-08-25T04:43:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.905+0000 7f5a356ab700 1 -- 172.21.15.16:0/3182711670 shutdown_connections 2023-08-25T04:43:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.905+0000 7f5a356ab700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f5a1c06a0e0 0x7f5a1c06c5a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.905+0000 7f5a356ab700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a3015d520 0x7f5a300b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.905+0000 7f5a356ab700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a300d1760 0x7f5a3014d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.905+0000 7f5a356ab700 1 --2- 172.21.15.16:0/3182711670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a300d3dc0 0x7f5a300ca1e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.905+0000 7f5a356ab700 1 -- 172.21.15.16:0/3182711670 >> 172.21.15.16:0/3182711670 conn(0x7f5a300d3110 msgr2=0x7f5a3015b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.905+0000 7f5a356ab700 1 -- 172.21.15.16:0/3182711670 shutdown_connections 2023-08-25T04:43:57.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:57.905+0000 7f5a356ab700 1 -- 172.21.15.16:0/3182711670 wait complete. 2023-08-25T04:43:57.907 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2023-08-25T04:43:58.320 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T04:43:42.297594+0000', 'modified': '2023-08-25T04:43:45.899399+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6837/36836471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6836', 'nonce': 36836471}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 36836471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T04:43:58.321 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T04:43:58.322 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-25T04:43:58.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.451+0000 7fb2f94f5700 1 Processor -- start 2023-08-25T04:43:58.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.451+0000 7fb2f94f5700 1 -- start start 2023-08-25T04:43:58.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.451+0000 7fb2f94f5700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb2f40d3dc0 0x7fb2f40d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.451+0000 7fb2f94f5700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f40b2be0 con 0x7fb2f40b3070 2023-08-25T04:43:58.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.451+0000 7fb2f94f5700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f40d0a40 con 0x7fb2f415d520 2023-08-25T04:43:58.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.452+0000 7fb2f94f5700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f40ce6f0 con 0x7fb2f40d3dc0 2023-08-25T04:43:58.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.452+0000 7fb2f27fc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb2f40d3dc0 0x7fb2f40d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.452+0000 7fb2f37fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb2f40b3070 0x7fb2f40b3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40158/0 (socket says 172.21.15.16:40158) 2023-08-25T04:43:58.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.452+0000 7fb2f37fe700 1 -- 172.21.15.16:0/2428734971 learned_addr learned my addr 172.21.15.16:0/2428734971 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:43:58.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.452+0000 7fb2f27fc700 1 -- 172.21.15.16:0/2428734971 >> v1:172.21.15.117:6789/0 conn(0x7fb2f415d520 legacy=0x7fb2f40d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:58.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.452+0000 7fb2f27fc700 1 -- 172.21.15.16:0/2428734971 >> v1:172.21.15.16:6789/0 conn(0x7fb2f40b3070 legacy=0x7fb2f40b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:58.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.452+0000 7fb2f27fc700 1 -- 172.21.15.16:0/2428734971 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f40ce900 con 0x7fb2f40d3dc0 2023-08-25T04:43:58.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.452+0000 7fb2f1ffb700 1 -- 172.21.15.16:0/2428734971 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262857396 0 0) 0x7fb2f40b2be0 con 0x7fb2f40b3070 2023-08-25T04:43:58.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.452+0000 7fb2f27fc700 1 --2- 172.21.15.16:0/2428734971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2f40d3dc0 0x7fb2f40d13f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8009840 tx=0x7fb2e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba9a7b36fde11a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:58.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.452+0000 7fb2f1ffb700 1 -- 172.21.15.16:0/2428734971 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8004230 con 0x7fb2f40d3dc0 2023-08-25T04:43:58.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.452+0000 7fb2f1ffb700 1 -- 172.21.15.16:0/2428734971 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e8004390 con 0x7fb2f40d3dc0 2023-08-25T04:43:58.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.452+0000 7fb2f1ffb700 1 -- 172.21.15.16:0/2428734971 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80036a0 con 0x7fb2f40d3dc0 2023-08-25T04:43:58.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.453+0000 7fb2f94f5700 1 -- 172.21.15.16:0/2428734971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2f40d3dc0 msgr2=0x7fb2f40d13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:58.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.453+0000 7fb2f94f5700 1 --2- 172.21.15.16:0/2428734971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2f40d3dc0 0x7fb2f40d13f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8009840 tx=0x7fb2e8009b50 comp rx=0 tx=0).stop 2023-08-25T04:43:58.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.453+0000 7fb2f94f5700 1 -- 172.21.15.16:0/2428734971 shutdown_connections 2023-08-25T04:43:58.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.453+0000 7fb2f94f5700 1 --2- 172.21.15.16:0/2428734971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2f40d3dc0 0x7fb2f40d13f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.453+0000 7fb2f94f5700 1 -- 172.21.15.16:0/2428734971 >> 172.21.15.16:0/2428734971 conn(0x7fb2f40d3110 msgr2=0x7fb2f40d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:58.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.453+0000 7fb2f94f5700 1 -- 172.21.15.16:0/2428734971 shutdown_connections 2023-08-25T04:43:58.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.453+0000 7fb2f94f5700 1 -- 172.21.15.16:0/2428734971 wait complete. 2023-08-25T04:43:58.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.454+0000 7fb2f94f5700 1 Processor -- start 2023-08-25T04:43:58.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.454+0000 7fb2f94f5700 1 -- start start 2023-08-25T04:43:58.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f94f5700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2f40b3070 0x7fb2f4158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f94f5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2f40d3dc0 0x7fb2f40b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f94f5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2f415d520 0x7fb2f40b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f94f5700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f41f5fa0 con 0x7fb2f40b3070 2023-08-25T04:43:58.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f94f5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f41f61f0 con 0x7fb2f415d520 2023-08-25T04:43:58.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f94f5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f41f64d0 con 0x7fb2f40d3dc0 2023-08-25T04:43:58.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2f40b3070 0x7fb2f4158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2f40b3070 0x7fb2f4158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49746/0 (socket says 172.21.15.16:49746) 2023-08-25T04:43:58.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f2ffd700 1 -- 172.21.15.16:0/2146543971 learned_addr learned my addr 172.21.15.16:0/2146543971 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:58.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f2ffd700 1 -- 172.21.15.16:0/2146543971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2f40d3dc0 msgr2=0x7fb2f40b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:58.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f2ffd700 1 --2- 172.21.15.16:0/2146543971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2f40d3dc0 0x7fb2f40b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f37fe700 1 --2- 172.21.15.16:0/2146543971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2f415d520 0x7fb2f40b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f2ffd700 1 -- 172.21.15.16:0/2146543971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2f415d520 msgr2=0x7fb2f40b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:58.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f2ffd700 1 --2- 172.21.15.16:0/2146543971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2f415d520 0x7fb2f40b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f2ffd700 1 -- 172.21.15.16:0/2146543971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e80094a0 con 0x7fb2f40b3070 2023-08-25T04:43:58.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f37fe700 1 --2- 172.21.15.16:0/2146543971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2f415d520 0x7fb2f40b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:58.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.455+0000 7fb2f2ffd700 1 --2- 172.21.15.16:0/2146543971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2f40b3070 0x7fb2f4158690 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400c4d0 tx=0x7fb2e400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:58.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.456+0000 7fb2db7fe700 1 -- 172.21.15.16:0/2146543971 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4011790 con 0x7fb2f40b3070 2023-08-25T04:43:58.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.456+0000 7fb2db7fe700 1 -- 172.21.15.16:0/2146543971 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e40118f0 con 0x7fb2f40b3070 2023-08-25T04:43:58.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.456+0000 7fb2f94f5700 1 -- 172.21.15.16:0/2146543971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f41f67b0 con 0x7fb2f40b3070 2023-08-25T04:43:58.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.456+0000 7fb2db7fe700 1 -- 172.21.15.16:0/2146543971 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4011ca0 con 0x7fb2f40b3070 2023-08-25T04:43:58.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.456+0000 7fb2f94f5700 1 -- 172.21.15.16:0/2146543971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f4158bd0 con 0x7fb2f40b3070 2023-08-25T04:43:58.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.457+0000 7fb2db7fe700 1 -- 172.21.15.16:0/2146543971 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb2e401c460 con 0x7fb2f40b3070 2023-08-25T04:43:58.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.457+0000 7fb2db7fe700 1 --2- 172.21.15.16:0/2146543971 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb2e006a110 0x7fb2e006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.458+0000 7fb2db7fe700 1 -- 172.21.15.16:0/2146543971 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2e40882a0 con 0x7fb2f40b3070 2023-08-25T04:43:58.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.458+0000 7fb2f27fc700 1 --2- 172.21.15.16:0/2146543971 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb2e006a110 0x7fb2e006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.458+0000 7fb2f27fc700 1 --2- 172.21.15.16:0/2146543971 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb2e006a110 0x7fb2e006c5d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80090b0 tx=0x7fb2e8013040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:58.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.460+0000 7fb305699b80 1 Processor -- start 2023-08-25T04:43:58.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.460+0000 7fb305699b80 1 -- start start 2023-08-25T04:43:58.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb305699b80 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be2b790 0x55749be2bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb305699b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be26db0 0x55749be71da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb305699b80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be28f80 0x55749be4de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb305699b80 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749bd92760 con 0x55749be2b790 2023-08-25T04:43:58.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb305699b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749bd83730 con 0x55749be26db0 2023-08-25T04:43:58.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb305699b80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55749bd81050 con 0x55749be28f80 2023-08-25T04:43:58.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2f2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be2b790 0x55749be2bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2f2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be2b790 0x55749be2bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49754/0 (socket says 172.21.15.16:49754) 2023-08-25T04:43:58.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2f2ffd700 1 -- 172.21.15.16:0/2322880424 learned_addr learned my addr 172.21.15.16:0/2322880424 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:58.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2f27fc700 1 --2- 172.21.15.16:0/2322880424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be26db0 0x55749be71da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2f37fe700 1 --2- 172.21.15.16:0/2322880424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be28f80 0x55749be4de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2f2ffd700 1 -- 172.21.15.16:0/2322880424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be28f80 msgr2=0x55749be4de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:58.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2f2ffd700 1 --2- 172.21.15.16:0/2322880424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be28f80 0x55749be4de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2f2ffd700 1 -- 172.21.15.16:0/2322880424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be26db0 msgr2=0x55749be71da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:58.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2f2ffd700 1 --2- 172.21.15.16:0/2322880424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be26db0 0x55749be71da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2f2ffd700 1 -- 172.21.15.16:0/2322880424 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55749bbfc5e0 con 0x55749be2b790 2023-08-25T04:43:58.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2f27fc700 1 --2- 172.21.15.16:0/2322880424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be26db0 0x55749be71da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:58.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2f2ffd700 1 --2- 172.21.15.16:0/2322880424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be2b790 0x55749be2bb70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb2e405eec0 tx=0x7fb2e40570c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86099b44293d02b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:58.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2d8ff9700 1 -- 172.21.15.16:0/2322880424 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4057d70 con 0x55749be2b790 2023-08-25T04:43:58.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2d8ff9700 1 -- 172.21.15.16:0/2322880424 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e405b4a0 con 0x55749be2b790 2023-08-25T04:43:58.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.461+0000 7fb2d8ff9700 1 -- 172.21.15.16:0/2322880424 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e405f3f0 con 0x55749be2b790 2023-08-25T04:43:58.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.462+0000 7fb305699b80 1 -- 172.21.15.16:0/2322880424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be2b790 msgr2=0x55749be2bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:58.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.462+0000 7fb305699b80 1 --2- 172.21.15.16:0/2322880424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be2b790 0x55749be2bb70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb2e405eec0 tx=0x7fb2e40570c0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.462+0000 7fb305699b80 1 -- 172.21.15.16:0/2322880424 shutdown_connections 2023-08-25T04:43:58.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.462+0000 7fb305699b80 1 --2- 172.21.15.16:0/2322880424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be28f80 0x55749be4de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.462+0000 7fb305699b80 1 --2- 172.21.15.16:0/2322880424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be2b790 0x55749be2bb70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.462+0000 7fb305699b80 1 --2- 172.21.15.16:0/2322880424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be26db0 0x55749be71da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.462+0000 7fb305699b80 1 -- 172.21.15.16:0/2322880424 >> 172.21.15.16:0/2322880424 conn(0x55749bd9f090 msgr2=0x55749be70920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:58.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.462+0000 7fb305699b80 1 -- 172.21.15.16:0/2322880424 shutdown_connections 2023-08-25T04:43:58.478 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.462+0000 7fb305699b80 1 -- 172.21.15.16:0/2322880424 wait complete. 2023-08-25T04:43:58.478 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.463+0000 7fb305699b80 1 -- start start 2023-08-25T04:43:58.478 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.463+0000 7fb305699b80 1 Processor -- start 2023-08-25T04:43:58.478 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.463+0000 7fb305699b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be26db0 0x55749be56e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.478 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.463+0000 7fb305699b80 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be28f80 0x55749be83530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.479 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb305699b80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be2b790 0x55749be83a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.479 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb305699b80 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749bd7c940 con 0x55749be28f80 2023-08-25T04:43:58.479 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb305699b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749bd1ab60 con 0x55749be26db0 2023-08-25T04:43:58.479 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb305699b80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55749bd1a860 con 0x55749be2b790 2023-08-25T04:43:58.479 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb305699b80 10 client.0 _ll_register_callbacks cb 0x55749bc64a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:43:58.479 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2f27fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be28f80 0x55749be83530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.479 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2f27fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be28f80 0x55749be83530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49760/0 (socket says 172.21.15.16:49760) 2023-08-25T04:43:58.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2f27fc700 1 -- 172.21.15.16:0/4145157619 learned_addr learned my addr 172.21.15.16:0/4145157619 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:58.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2f37fe700 1 --2- 172.21.15.16:0/4145157619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be2b790 0x55749be83a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2f2ffd700 1 --2- 172.21.15.16:0/4145157619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be26db0 0x55749be56e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2f27fc700 1 -- 172.21.15.16:0/4145157619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be2b790 msgr2=0x55749be83a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:58.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2f27fc700 1 --2- 172.21.15.16:0/4145157619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be2b790 0x55749be83a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2f27fc700 1 -- 172.21.15.16:0/4145157619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be26db0 msgr2=0x55749be56e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:58.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2f27fc700 1 --2- 172.21.15.16:0/4145157619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be26db0 0x55749be56e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2f27fc700 1 -- 172.21.15.16:0/4145157619 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f4158bd0 con 0x55749be28f80 2023-08-25T04:43:58.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2f2ffd700 1 --2- 172.21.15.16:0/4145157619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be26db0 0x55749be56e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:43:58.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2f27fc700 1 --2- 172.21.15.16:0/4145157619 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be28f80 0x55749be83530 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4072a50 tx=0x7fb2e80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb409861aeaa0630 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:58.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2023-08-25T04:43:58.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2d1ffb700 1 -- 172.21.15.16:0/4145157619 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8011630 con 0x55749be28f80 2023-08-25T04:43:58.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb305699b80 1 -- 172.21.15.16:0/4145157619 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55749be1de00 con 0x55749be28f80 2023-08-25T04:43:58.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2d1ffb700 1 -- 172.21.15.16:0/4145157619 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2e802c070 con 0x55749be28f80 2023-08-25T04:43:58.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb2d1ffb700 1 -- 172.21.15.16:0/4145157619 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2e8011790 con 0x55749be28f80 2023-08-25T04:43:58.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb305699b80 10 client.4644 fetch_fsmap learned FSMap version 7 2023-08-25T04:43:58.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.464+0000 7fb305699b80 1 -- 172.21.15.16:0/4145157619 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55749bba8d90 con 0x55749be28f80 2023-08-25T04:43:58.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.465+0000 7fb2d1ffb700 1 -- 172.21.15.16:0/4145157619 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55749be1de00 con 0x55749be28f80 2023-08-25T04:43:58.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.465+0000 7fb2d1ffb700 1 -- 172.21.15.16:0/4145157619 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb2e80118f0 con 0x55749be28f80 2023-08-25T04:43:58.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.465+0000 7fb305699b80 10 client.4644 fetch_fsmap finished waiting for FSMap version 7 2023-08-25T04:43:58.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.465+0000 7fb305699b80 10 client.4644 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-25T04:43:58.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.465+0000 7fb305699b80 20 client.4644 populate_metadata read hostname 'smithi016' 2023-08-25T04:43:58.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.465+0000 7fb305699b80 1 --2- 172.21.15.16:0/4145157619 >> [v2:172.21.15.117:6836/36836471,v1:172.21.15.117:6837/36836471] conn(0x55749be3f4f0 0x55749be7f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.465+0000 7fb305699b80 4 client.4644 mds_command: new command op to 4294 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T04:43:58.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.465+0000 7fb305699b80 1 -- 172.21.15.16:0/4145157619 --> [v2:172.21.15.117:6836/36836471,v1:172.21.15.117:6837/36836471] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55749bd22b50 con 0x55749be3f4f0 2023-08-25T04:43:58.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.465+0000 7fb2f2ffd700 1 --2- 172.21.15.16:0/4145157619 >> [v2:172.21.15.117:6836/36836471,v1:172.21.15.117:6837/36836471] conn(0x55749be3f4f0 0x55749be7f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.465+0000 7fb2d1ffb700 10 client.4644 ms_handle_connect on v2:172.21.15.117:6836/36836471 2023-08-25T04:43:58.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.465+0000 7fb2f2ffd700 1 --2- 172.21.15.16:0/4145157619 >> [v2:172.21.15.117:6836/36836471,v1:172.21.15.117:6837/36836471] conn(0x55749be3f4f0 0x55749be7f090 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecf9a11dbd9e703d server_cookie=31715252c7e2fb02 in_seq=0 out_seq=0 2023-08-25T04:43:58.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb2d1ffb700 1 -- 172.21.15.16:0/4145157619 <== mds.0 v2:172.21.15.117:6836/36836471 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55749bd22b50 con 0x55749be3f4f0 2023-08-25T04:43:58.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb2d1ffb700 10 client.4644 handle_command_reply: tid=0 2023-08-25T04:43:58.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb305699b80 1 client.4644 shutdown 2023-08-25T04:43:58.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb305699b80 1 -- 172.21.15.16:0/4145157619 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be28f80 msgr2=0x55749be83530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:58.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb305699b80 1 --2- 172.21.15.16:0/4145157619 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be28f80 0x55749be83530 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4072a50 tx=0x7fb2e80047c0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb305699b80 1 -- 172.21.15.16:0/4145157619 shutdown_connections 2023-08-25T04:43:58.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb305699b80 1 --2- 172.21.15.16:0/4145157619 >> [v2:172.21.15.117:6836/36836471,v1:172.21.15.117:6837/36836471] conn(0x55749be3f4f0 0x55749be7f090 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb305699b80 1 --2- 172.21.15.16:0/4145157619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be2b790 0x55749be83a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb305699b80 1 --2- 172.21.15.16:0/4145157619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be26db0 0x55749be56e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb305699b80 1 --2- 172.21.15.16:0/4145157619 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be28f80 0x55749be83530 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb2d1ffb700 0 client.4644 ms_handle_reset on v2:172.21.15.117:6836/36836471 2023-08-25T04:43:58.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb305699b80 1 -- 172.21.15.16:0/4145157619 >> 172.21.15.16:0/4145157619 conn(0x55749bd9f090 msgr2=0x55749be2bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:58.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb305699b80 1 -- 172.21.15.16:0/4145157619 shutdown_connections 2023-08-25T04:43:58.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb305699b80 1 -- 172.21.15.16:0/4145157619 wait complete. 2023-08-25T04:43:58.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.466+0000 7fb305699b80 20 client.4644 trim_cache size 0 max 16384 2023-08-25T04:43:58.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.484+0000 7fb305699b80 1 Processor -- start 2023-08-25T04:43:58.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.484+0000 7fb305699b80 1 -- start start 2023-08-25T04:43:58.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb305699b80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be26db0 0x55749be408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb305699b80 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be28f80 0x55749be40e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb305699b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be2b790 0x55749be73ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb305699b80 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749bbfe8d0 con 0x55749be28f80 2023-08-25T04:43:58.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb305699b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749be41360 con 0x55749be2b790 2023-08-25T04:43:58.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb305699b80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55749be22090 con 0x55749be26db0 2023-08-25T04:43:58.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb2f27fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be28f80 0x55749be40e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb2f27fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be28f80 0x55749be40e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49770/0 (socket says 172.21.15.16:49770) 2023-08-25T04:43:58.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb2f27fc700 1 -- 172.21.15.16:0/4122335284 learned_addr learned my addr 172.21.15.16:0/4122335284 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:58.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb2f37fe700 1 --2- 172.21.15.16:0/4122335284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be2b790 0x55749be73ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb2f2ffd700 1 --2- 172.21.15.16:0/4122335284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be26db0 0x55749be408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb2f27fc700 1 -- 172.21.15.16:0/4122335284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be26db0 msgr2=0x55749be408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:58.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb2f27fc700 1 --2- 172.21.15.16:0/4122335284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be26db0 0x55749be408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb2f27fc700 1 -- 172.21.15.16:0/4122335284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be2b790 msgr2=0x55749be73ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:58.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb2f27fc700 1 --2- 172.21.15.16:0/4122335284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be2b790 0x55749be73ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.485+0000 7fb2f27fc700 1 -- 172.21.15.16:0/4122335284 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55749bb91c10 con 0x55749be28f80 2023-08-25T04:43:58.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.486+0000 7fb2f27fc700 1 --2- 172.21.15.16:0/4122335284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be28f80 0x55749be40e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8006db0 tx=0x7fb2e8028070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139955c52136efb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:58.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.486+0000 7fb2d97fa700 1 -- 172.21.15.16:0/4122335284 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8011630 con 0x55749be28f80 2023-08-25T04:43:58.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.486+0000 7fb2d97fa700 1 -- 172.21.15.16:0/4122335284 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e802a070 con 0x55749be28f80 2023-08-25T04:43:58.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.486+0000 7fb2d97fa700 1 -- 172.21.15.16:0/4122335284 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80119f0 con 0x55749be28f80 2023-08-25T04:43:58.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.486+0000 7fb305699b80 1 -- 172.21.15.16:0/4122335284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be28f80 msgr2=0x55749be40e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:58.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.486+0000 7fb305699b80 1 --2- 172.21.15.16:0/4122335284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be28f80 0x55749be40e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8006db0 tx=0x7fb2e8028070 comp rx=0 tx=0).stop 2023-08-25T04:43:58.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.486+0000 7fb305699b80 1 -- 172.21.15.16:0/4122335284 shutdown_connections 2023-08-25T04:43:58.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.486+0000 7fb305699b80 1 --2- 172.21.15.16:0/4122335284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be2b790 0x55749be73ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.486+0000 7fb305699b80 1 --2- 172.21.15.16:0/4122335284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be26db0 0x55749be408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.486+0000 7fb305699b80 1 --2- 172.21.15.16:0/4122335284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be28f80 0x55749be40e20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.486+0000 7fb305699b80 1 -- 172.21.15.16:0/4122335284 >> 172.21.15.16:0/4122335284 conn(0x55749bd9f090 msgr2=0x55749be4d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:58.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.486+0000 7fb305699b80 1 -- 172.21.15.16:0/4122335284 shutdown_connections 2023-08-25T04:43:58.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.486+0000 7fb305699b80 1 -- 172.21.15.16:0/4122335284 wait complete. 2023-08-25T04:43:58.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.487+0000 7fb305699b80 1 -- start start 2023-08-25T04:43:58.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.487+0000 7fb305699b80 1 Processor -- start 2023-08-25T04:43:58.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb305699b80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be26db0 0x55749bed76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb305699b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be28f80 0x55749bed65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb305699b80 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be2b790 0x55749be58660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb305699b80 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749be732c0 con 0x55749be2b790 2023-08-25T04:43:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb305699b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749bed7bf0 con 0x55749be28f80 2023-08-25T04:43:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb305699b80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55749bedaed0 con 0x55749be26db0 2023-08-25T04:43:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb305699b80 10 client.0 _ll_register_callbacks cb 0x7fb2e8003720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:43:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb2f37fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be2b790 0x55749be58660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb2f37fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be2b790 0x55749be58660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49778/0 (socket says 172.21.15.16:49778) 2023-08-25T04:43:58.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb2f37fe700 1 -- 172.21.15.16:0/2520150553 learned_addr learned my addr 172.21.15.16:0/2520150553 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:58.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb2f27fc700 1 --2- 172.21.15.16:0/2520150553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be28f80 0x55749bed65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb2f2ffd700 1 --2- 172.21.15.16:0/2520150553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be26db0 0x55749bed76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb2f37fe700 1 -- 172.21.15.16:0/2520150553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be26db0 msgr2=0x55749bed76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:58.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb2f37fe700 1 --2- 172.21.15.16:0/2520150553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be26db0 0x55749bed76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb2f37fe700 1 -- 172.21.15.16:0/2520150553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be28f80 msgr2=0x55749bed65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb2f37fe700 1 --2- 172.21.15.16:0/2520150553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be28f80 0x55749bed65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb2f37fe700 1 -- 172.21.15.16:0/2520150553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55749bba8d90 con 0x55749be2b790 2023-08-25T04:43:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb2f37fe700 1 --2- 172.21.15.16:0/2520150553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be2b790 0x55749be58660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0076f0 tx=0x7fb2ec007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae244998e85d1f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb2d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2023-08-25T04:43:58.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb2d1ffb700 1 -- 172.21.15.16:0/2520150553 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0139d0 con 0x55749be2b790 2023-08-25T04:43:58.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb2d1ffb700 1 -- 172.21.15.16:0/2520150553 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2ec013b30 con 0x55749be2b790 2023-08-25T04:43:58.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.488+0000 7fb305699b80 1 -- 172.21.15.16:0/2520150553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb2e405b4a0 con 0x55749be2b790 2023-08-25T04:43:58.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.489+0000 7fb2d1ffb700 1 -- 172.21.15.16:0/2520150553 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2ec013cf0 con 0x55749be2b790 2023-08-25T04:43:58.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.489+0000 7fb305699b80 10 client.4650 fetch_fsmap learned FSMap version 7 2023-08-25T04:43:58.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.489+0000 7fb305699b80 1 -- 172.21.15.16:0/2520150553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55749bbcf200 con 0x55749be2b790 2023-08-25T04:43:58.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.489+0000 7fb2d1ffb700 1 -- 172.21.15.16:0/2520150553 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e405b4a0 con 0x55749be2b790 2023-08-25T04:43:58.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.489+0000 7fb2d1ffb700 1 -- 172.21.15.16:0/2520150553 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb2ec016450 con 0x55749be2b790 2023-08-25T04:43:58.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.489+0000 7fb305699b80 10 client.4650 fetch_fsmap finished waiting for FSMap version 7 2023-08-25T04:43:58.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.489+0000 7fb305699b80 10 client.4650 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-25T04:43:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.489+0000 7fb305699b80 20 client.4650 populate_metadata read hostname 'smithi016' 2023-08-25T04:43:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.489+0000 7fb305699b80 1 --2- 172.21.15.16:0/2520150553 >> [v2:172.21.15.117:6836/36836471,v1:172.21.15.117:6837/36836471] conn(0x55749beda460 0x55749beda840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.489+0000 7fb305699b80 4 client.4650 mds_command: new command op to 4294 tid=0[{"prefix": "status"}] 2023-08-25T04:43:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.489+0000 7fb305699b80 1 -- 172.21.15.16:0/2520150553 --> [v2:172.21.15.117:6836/36836471,v1:172.21.15.117:6837/36836471] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55749bd75920 con 0x55749beda460 2023-08-25T04:43:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.489+0000 7fb2f2ffd700 1 --2- 172.21.15.16:0/2520150553 >> [v2:172.21.15.117:6836/36836471,v1:172.21.15.117:6837/36836471] conn(0x55749beda460 0x55749beda840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.489+0000 7fb2d1ffb700 10 client.4650 ms_handle_connect on v2:172.21.15.117:6836/36836471 2023-08-25T04:43:58.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.489+0000 7fb2f2ffd700 1 --2- 172.21.15.16:0/2520150553 >> [v2:172.21.15.117:6836/36836471,v1:172.21.15.117:6837/36836471] conn(0x55749beda460 0x55749beda840 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4f2fd50c5e0c547 server_cookie=4bc729b851eccd29 in_seq=0 out_seq=0 2023-08-25T04:43:58.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2d1ffb700 1 -- 172.21.15.16:0/2520150553 <== mds.0 v2:172.21.15.117:6836/36836471 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55749bd75920 con 0x55749beda460 2023-08-25T04:43:58.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2d1ffb700 10 client.4650 handle_command_reply: tid=0 2023-08-25T04:43:58.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb305699b80 1 client.4650 shutdown 2023-08-25T04:43:58.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb305699b80 1 -- 172.21.15.16:0/2520150553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be2b790 msgr2=0x55749be58660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:58.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb305699b80 1 --2- 172.21.15.16:0/2520150553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be2b790 0x55749be58660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0076f0 tx=0x7fb2ec007a00 comp rx=0 tx=0).stop 2023-08-25T04:43:58.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb305699b80 1 -- 172.21.15.16:0/2520150553 shutdown_connections 2023-08-25T04:43:58.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb305699b80 1 --2- 172.21.15.16:0/2520150553 >> [v2:172.21.15.117:6836/36836471,v1:172.21.15.117:6837/36836471] conn(0x55749beda460 0x55749beda840 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb305699b80 1 --2- 172.21.15.16:0/2520150553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55749be2b790 0x55749be58660 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb305699b80 1 --2- 172.21.15.16:0/2520150553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55749be26db0 0x55749bed76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2d1ffb700 0 client.4650 ms_handle_reset on v2:172.21.15.117:6836/36836471 2023-08-25T04:43:58.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb305699b80 1 --2- 172.21.15.16:0/2520150553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55749be28f80 0x55749bed65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb305699b80 1 -- 172.21.15.16:0/2520150553 >> 172.21.15.16:0/2520150553 conn(0x55749bd9f090 msgr2=0x55749be73ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:58.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb305699b80 1 -- 172.21.15.16:0/2520150553 shutdown_connections 2023-08-25T04:43:58.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb305699b80 1 -- 172.21.15.16:0/2520150553 wait complete. 2023-08-25T04:43:58.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb305699b80 20 client.4650 trim_cache size 0 max 16384 2023-08-25T04:43:58.512 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-08-25T04:43:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "53372d9f-1238-45a2-a21f-2a854d90c0cf", 2023-08-25T04:43:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2023-08-25T04:43:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4294, 2023-08-25T04:43:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2023-08-25T04:43:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2023-08-25T04:43:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2023-08-25T04:43:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 15.619097534, 2023-08-25T04:43:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 7, 2023-08-25T04:43:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 21, 2023-08-25T04:43:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 21, 2023-08-25T04:43:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 21.582130148000001 2023-08-25T04:43:58.514 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-08-25T04:43:58.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2f94f5700 1 -- 172.21.15.16:0/2146543971 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb2e006a110 msgr2=0x7fb2e006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:58.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2f94f5700 1 --2- 172.21.15.16:0/2146543971 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb2e006a110 0x7fb2e006c5d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80090b0 tx=0x7fb2e8013040 comp rx=0 tx=0).stop 2023-08-25T04:43:58.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2f94f5700 1 -- 172.21.15.16:0/2146543971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2f40b3070 msgr2=0x7fb2f4158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:58.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2f94f5700 1 --2- 172.21.15.16:0/2146543971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2f40b3070 0x7fb2f4158690 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400c4d0 tx=0x7fb2e400c890 comp rx=0 tx=0).stop 2023-08-25T04:43:58.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2f94f5700 1 -- 172.21.15.16:0/2146543971 shutdown_connections 2023-08-25T04:43:58.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2f94f5700 1 --2- 172.21.15.16:0/2146543971 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb2e006a110 0x7fb2e006c5d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2f94f5700 1 --2- 172.21.15.16:0/2146543971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2f415d520 0x7fb2f40b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2f94f5700 1 --2- 172.21.15.16:0/2146543971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2f40b3070 0x7fb2f4158690 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2f94f5700 1 --2- 172.21.15.16:0/2146543971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2f40d3dc0 0x7fb2f40b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:58.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2f94f5700 1 -- 172.21.15.16:0/2146543971 >> 172.21.15.16:0/2146543971 conn(0x7fb2f40d3110 msgr2=0x7fb2f40b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:58.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2f94f5700 1 -- 172.21.15.16:0/2146543971 shutdown_connections 2023-08-25T04:43:58.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:58.490+0000 7fb2f94f5700 1 -- 172.21.15.16:0/2146543971 wait complete. 2023-08-25T04:43:58.518 INFO:teuthology.run_tasks:Running task kclient... 2023-08-25T04:43:58.543 INFO:tasks.kclient:Mounting kernel clients... 2023-08-25T04:43:58.544 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-25T04:43:58.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:58.545 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-08-25T04:43:58.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:58.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2023-08-25T04:43:58.631 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2023-08-25T04:43:58.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:43:58.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:58.633 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-08-25T04:43:58.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:58.690 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2023-08-25T04:43:58.758 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2023-08-25T04:43:58.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:43:58.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:58.760 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-25T04:43:58.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:58.782 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2023-08-25T04:43:58.856 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2023-08-25T04:43:58.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:43:58.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:58.859 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-25T04:43:58.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:58.918 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2023-08-25T04:43:58.989 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2023-08-25T04:43:58.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:43:58.991 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-08-25T04:43:58.992 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-25T04:43:58.992 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T04:43:58.992 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:43:59.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.117+0000 7f7b90088700 1 Processor -- start 2023-08-25T04:43:59.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.118+0000 7f7b90088700 1 -- start start 2023-08-25T04:43:59.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.118+0000 7f7b90088700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7b880cc830 0x7f7b880ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:59.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.118+0000 7f7b90088700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7b880cedc0 0x7f7b8806d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:59.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.118+0000 7f7b90088700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b880cbfe0 con 0x7f7b880caf10 2023-08-25T04:43:59.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.118+0000 7f7b90088700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b880cd150 con 0x7f7b880cc830 2023-08-25T04:43:59.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.118+0000 7f7b90088700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b880cb3d0 con 0x7f7b880cedc0 2023-08-25T04:43:59.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.119+0000 7f7b8de24700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7b880cc830 0x7f7b880ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:59.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.119+0000 7f7b8de24700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7b880cc830 0x7f7b880ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49782/0 (socket says 172.21.15.16:49782) 2023-08-25T04:43:59.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.119+0000 7f7b8de24700 1 -- 172.21.15.16:0/4289453013 learned_addr learned my addr 172.21.15.16:0/4289453013 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:59.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.119+0000 7f7b8e625700 1 --2- 172.21.15.16:0/4289453013 >> v2:172.21.15.117:3300/0 conn(0x7f7b880cedc0 0x7f7b8806d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:59.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.119+0000 7f7b8de24700 1 -- 172.21.15.16:0/4289453013 >> v2:172.21.15.117:3300/0 conn(0x7f7b880cedc0 msgr2=0x7f7b8806d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:43:59.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.119+0000 7f7b8de24700 1 --2- 172.21.15.16:0/4289453013 >> v2:172.21.15.117:3300/0 conn(0x7f7b880cedc0 0x7f7b8806d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:59.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.119+0000 7f7b8de24700 1 -- 172.21.15.16:0/4289453013 >> v1:172.21.15.117:6789/0 conn(0x7f7b880caf10 legacy=0x7f7b8806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:59.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.119+0000 7f7b8de24700 1 -- 172.21.15.16:0/4289453013 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880cb6b0 con 0x7f7b880cc830 2023-08-25T04:43:59.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.119+0000 7f7b8de24700 1 --2- 172.21.15.16:0/4289453013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b880cc830 0x7f7b880ccc10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7b880cc780 tx=0x7f7b8400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b3a81914f5b6ea server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:59.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.119+0000 7f7b8ce22700 1 -- 172.21.15.16:0/4289453013 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8400dd30 con 0x7f7b880cc830 2023-08-25T04:43:59.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.119+0000 7f7b8ce22700 1 -- 172.21.15.16:0/4289453013 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8400de90 con 0x7f7b880cc830 2023-08-25T04:43:59.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.119+0000 7f7b8ce22700 1 -- 172.21.15.16:0/4289453013 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84010690 con 0x7f7b880cc830 2023-08-25T04:43:59.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.120+0000 7f7b90088700 1 -- 172.21.15.16:0/4289453013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b880cc830 msgr2=0x7f7b880ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:59.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.120+0000 7f7b90088700 1 --2- 172.21.15.16:0/4289453013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b880cc830 0x7f7b880ccc10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7b880cc780 tx=0x7f7b8400be70 comp rx=0 tx=0).stop 2023-08-25T04:43:59.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.120+0000 7f7b90088700 1 -- 172.21.15.16:0/4289453013 shutdown_connections 2023-08-25T04:43:59.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.120+0000 7f7b90088700 1 --2- 172.21.15.16:0/4289453013 >> v2:172.21.15.117:3300/0 conn(0x7f7b880cedc0 0x7f7b8806d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:59.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.120+0000 7f7b90088700 1 --2- 172.21.15.16:0/4289453013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b880cc830 0x7f7b880ccc10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:59.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.120+0000 7f7b90088700 1 -- 172.21.15.16:0/4289453013 >> 172.21.15.16:0/4289453013 conn(0x7f7b880b1a10 msgr2=0x7f7b880b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:59.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.120+0000 7f7b90088700 1 -- 172.21.15.16:0/4289453013 shutdown_connections 2023-08-25T04:43:59.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.120+0000 7f7b90088700 1 -- 172.21.15.16:0/4289453013 wait complete. 2023-08-25T04:43:59.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.121+0000 7f7b90088700 1 Processor -- start 2023-08-25T04:43:59.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.122+0000 7f7b90088700 1 -- start start 2023-08-25T04:43:59.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.122+0000 7f7b90088700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b880caf10 0x7f7b880c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:59.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.122+0000 7f7b90088700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b880cc830 0x7f7b880b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:59.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.122+0000 7f7b90088700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b880cedc0 0x7f7b880b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:59.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b90088700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880c5e50 con 0x7f7b880cc830 2023-08-25T04:43:59.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b90088700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880c50a0 con 0x7f7b880caf10 2023-08-25T04:43:59.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b90088700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880c52d0 con 0x7f7b880cedc0 2023-08-25T04:43:59.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b8d623700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b880cc830 0x7f7b880b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:59.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b8d623700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b880cc830 0x7f7b880b0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49788/0 (socket says 172.21.15.16:49788) 2023-08-25T04:43:59.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b8d623700 1 -- 172.21.15.16:0/1420571363 learned_addr learned my addr 172.21.15.16:0/1420571363 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:43:59.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b8de24700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b880caf10 0x7f7b880c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:59.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b8e625700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b880cedc0 0x7f7b880b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:59.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b8d623700 1 -- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b880cedc0 msgr2=0x7f7b880b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:59.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b8d623700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b880cedc0 0x7f7b880b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:59.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b8d623700 1 -- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b880caf10 msgr2=0x7f7b880c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:59.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b8d623700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b880caf10 0x7f7b880c4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:59.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b8d623700 1 -- 172.21.15.16:0/1420571363 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8400b7f0 con 0x7f7b880cc830 2023-08-25T04:43:59.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b8e625700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b880cedc0 0x7f7b880b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:43:59.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b8d623700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b880cc830 0x7f7b880b0430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00c450 tx=0x7f7b7c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:59.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b7a7fc700 1 -- 172.21.15.16:0/1420571363 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c0052d0 con 0x7f7b880cc830 2023-08-25T04:43:59.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b7a7fc700 1 -- 172.21.15.16:0/1420571363 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c005430 con 0x7f7b880cc830 2023-08-25T04:43:59.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b90088700 1 -- 172.21.15.16:0/1420571363 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b880c55b0 con 0x7f7b880cc830 2023-08-25T04:43:59.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b7a7fc700 1 -- 172.21.15.16:0/1420571363 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c0038c0 con 0x7f7b880cc830 2023-08-25T04:43:59.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.123+0000 7f7b90088700 1 -- 172.21.15.16:0/1420571363 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b880c5b70 con 0x7f7b880cc830 2023-08-25T04:43:59.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.124+0000 7f7b90088700 1 -- 172.21.15.16:0/1420571363 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8804ee70 con 0x7f7b880cc830 2023-08-25T04:43:59.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.125+0000 7f7b7a7fc700 1 -- 172.21.15.16:0/1420571363 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7b7c003a20 con 0x7f7b880cc830 2023-08-25T04:43:59.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.125+0000 7f7b7a7fc700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f7b6c06a0e0 0x7f7b6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:43:59.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.125+0000 7f7b7a7fc700 1 -- 172.21.15.16:0/1420571363 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b7c0878f0 con 0x7f7b880cc830 2023-08-25T04:43:59.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.125+0000 7f7b8de24700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f7b6c06a0e0 0x7f7b6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:43:59.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.126+0000 7f7b8de24700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f7b6c06a0e0 0x7f7b6c06c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400b6f0 tx=0x7f7b84012000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:43:59.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.129+0000 7f7b7a7fc700 1 -- 172.21.15.16:0/1420571363 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7b7c052fe0 con 0x7f7b880cc830 2023-08-25T04:43:59.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.377+0000 7f7b90088700 1 -- 172.21.15.16:0/1420571363 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7b880afa20 con 0x7f7b880cc830 2023-08-25T04:43:59.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.377+0000 7f7b7a7fc700 1 -- 172.21.15.16:0/1420571363 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7b7c017060 con 0x7f7b880cc830 2023-08-25T04:43:59.377 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:43:59.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.379+0000 7f7b90088700 1 -- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f7b6c06a0e0 msgr2=0x7f7b6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:59.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.379+0000 7f7b90088700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f7b6c06a0e0 0x7f7b6c06c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400b6f0 tx=0x7f7b84012000 comp rx=0 tx=0).stop 2023-08-25T04:43:59.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.379+0000 7f7b90088700 1 -- 172.21.15.16:0/1420571363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b880cc830 msgr2=0x7f7b880b0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:43:59.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.379+0000 7f7b90088700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b880cc830 0x7f7b880b0430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00c450 tx=0x7f7b7c00c760 comp rx=0 tx=0).stop 2023-08-25T04:43:59.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.379+0000 7f7b90088700 1 -- 172.21.15.16:0/1420571363 shutdown_connections 2023-08-25T04:43:59.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.379+0000 7f7b90088700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f7b6c06a0e0 0x7f7b6c06c5a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:59.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.379+0000 7f7b90088700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b880cedc0 0x7f7b880b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:59.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.379+0000 7f7b90088700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b880caf10 0x7f7b880c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:59.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.379+0000 7f7b90088700 1 --2- 172.21.15.16:0/1420571363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b880cc830 0x7f7b880b0430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:43:59.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.379+0000 7f7b90088700 1 -- 172.21.15.16:0/1420571363 >> 172.21.15.16:0/1420571363 conn(0x7f7b880b1a10 msgr2=0x7f7b880cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:43:59.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.379+0000 7f7b90088700 1 -- 172.21.15.16:0/1420571363 shutdown_connections 2023-08-25T04:43:59.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:43:59.379+0000 7f7b90088700 1 -- 172.21.15.16:0/1420571363 wait complete. 2023-08-25T04:43:59.392 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-25T04:43:59.392 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:43:59.393 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2023-08-25T04:43:59.393 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T04:43:59.393 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T04:43:59.394 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-25T04:43:59.394 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T04:43:59.395 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:43:59.396 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:43:59.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:59.397 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2023-08-25T04:43:59.417 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:43:59.418 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:43:59.418 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:43:59.418 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:43:59.418 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2023-08-25T04:43:59.418 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:43:59.418 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:43:59.419 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:43:59.419 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:43:59.419 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:43:59.419 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:43:59.419 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:43:59.419 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-25T04:43:59.419 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42305sec preferred_lft 42305sec 2023-08-25T04:43:59.420 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2023-08-25T04:43:59.420 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:43:59.420 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:43:59.420 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:43:59.420 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-25T04:43:59.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:59.421 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-08-25T04:43:59.421 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-08-25T04:43:59.422 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add name ceph-brx type bridge 2023-08-25T04:43:59.422 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr flush dev ceph-brx 2023-08-25T04:43:59.422 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set ceph-brx up 2023-08-25T04:43:59.422 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-25T04:43:59.422 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-08-25T04:43:59.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:59.594 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:43:59.623 INFO:teuthology.orchestra.run.smithi016.stdout:1 2023-08-25T04:43:59.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:59.625 DEBUG:teuthology.orchestra.run.smithi016:> route 2023-08-25T04:43:59.693 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2023-08-25T04:43:59.693 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:43:59.693 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-25T04:43:59.694 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-25T04:43:59.694 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:43:59.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:59.695 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-08-25T04:43:59.695 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-08-25T04:43:59.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T04:43:59.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T04:43:59.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T04:43:59.696 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-08-25T04:43:59.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:59.943 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-08-25T04:43:59.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:43:59.961 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2023-08-25T04:44:00.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:00.018 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-08-25T04:44:00.019 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-08-25T04:44:00.019 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:44:00.019 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-25T04:44:00.019 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-08-25T04:44:00.113 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-25T04:44:00.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:00.114 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-08-25T04:44:00.114 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-08-25T04:44:00.115 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-25T04:44:00.115 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-25T04:44:00.116 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-25T04:44:00.116 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-25T04:44:00.117 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-25T04:44:00.117 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-08-25T04:44:00.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:00.331 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-08-25T04:44:00.331 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-08-25T04:44:00.332 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2023-08-25T04:44:00.332 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.0 master ceph-brx 2023-08-25T04:44:00.332 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-08-25T04:44:00.436 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:44:00.436 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T04:44:00.459 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:44:00.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:44:00.460 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:44:00.515 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-25T04:44:00.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:00.516 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-25T04:44:00.616 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-25T04:44:00.617 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-25T04:44:00.617 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-08-25T04:44:00.725 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-25T04:44:00.726 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-25T04:44:00.726 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-08-25T04:44:00.726 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-25T04:44:00.726 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-25T04:44:00.800 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-25T04:44:00.801 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-25T04:44:00.801 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-08-25T04:44:00.801 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-25T04:44:00.801 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-25T04:44:00.801 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.117:6789,172.21.15.117:6790" 2023-08-25T04:44:00.802 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2023-08-25T04:44:00.802 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=53372d9f-1238-45a2-a21f-2a854d90c0cf" will pass to kernel 2023-08-25T04:44:00.803 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:44:00.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:00.805 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:44:00.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:00.837 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:44:00.926 INFO:teuthology.orchestra.run.smithi016.stdout:client4502 2023-08-25T04:44:00.927 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:44:00.927 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:44:00.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:00.945 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:44:01.033 INFO:teuthology.orchestra.run.smithi016.stdout:client4502 2023-08-25T04:44:01.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:01.035 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:44:01.083 INFO:teuthology.orchestra.run.smithi016.stdout:client4502 2023-08-25T04:44:01.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:01.085 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/53372d9f-1238-45a2-a21f-2a854d90c0cf.client4502/status') 2023-08-25T04:44:01.140 INFO:teuthology.orchestra.run.smithi016.stdout:instance: client.4502 (3)172.21.15.16:0/582292486 2023-08-25T04:44:01.141 INFO:teuthology.orchestra.run.smithi016.stdout:blocklisted: false 2023-08-25T04:44:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2023-08-25T04:44:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2023-08-25T04:44:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:69 bytes copied, 2.4772e-05 s, 2.8 MB/s 2023-08-25T04:44:01.142 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-08-25T04:44:01.143 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-25T04:44:01.143 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-25T04:44:01.143 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:44:01.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.268+0000 7f70d7844700 1 Processor -- start 2023-08-25T04:44:01.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.268+0000 7f70d7844700 1 -- start start 2023-08-25T04:44:01.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.269+0000 7f70d7844700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d00b3170 0x7f70d00701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:01.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.269+0000 7f70d7844700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d00cd340 con 0x7f70d015b380 2023-08-25T04:44:01.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.269+0000 7f70d7844700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d00cd620 con 0x7f70d00d0970 2023-08-25T04:44:01.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.269+0000 7f70d7844700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00cd900 con 0x7f70d00b3170 2023-08-25T04:44:01.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.269+0000 7f70d55e0700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f70d015b380 0x7f70d00b2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40220/0 (socket says 172.21.15.16:40220) 2023-08-25T04:44:01.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.269+0000 7f70d55e0700 1 -- 172.21.15.16:0/1235241066 learned_addr learned my addr 172.21.15.16:0/1235241066 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:44:01.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.269+0000 7f70d4ddf700 1 --2- 172.21.15.16:0/1235241066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d00b3170 0x7f70d00701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:01.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.269+0000 7f70c7fff700 1 -- 172.21.15.16:0/1235241066 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629386785 0 0) 0x7f70d00cd340 con 0x7f70d015b380 2023-08-25T04:44:01.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.269+0000 7f70c7fff700 1 -- 172.21.15.16:0/1235241066 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70bc0035b0 con 0x7f70d015b380 2023-08-25T04:44:01.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.269+0000 7f70c7fff700 1 -- 172.21.15.16:0/1235241066 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13683241 0 0) 0x7f70d00cd620 con 0x7f70d00d0970 2023-08-25T04:44:01.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.269+0000 7f70c7fff700 1 -- 172.21.15.16:0/1235241066 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d00cd340 con 0x7f70d00d0970 2023-08-25T04:44:01.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.269+0000 7f70d4ddf700 1 -- 172.21.15.16:0/1235241066 >> v1:172.21.15.117:6789/0 conn(0x7f70d00d0970 legacy=0x7f70d00b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:01.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.269+0000 7f70d4ddf700 1 -- 172.21.15.16:0/1235241066 >> v1:172.21.15.16:6789/0 conn(0x7f70d015b380 legacy=0x7f70d00b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:01.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.269+0000 7f70d4ddf700 1 -- 172.21.15.16:0/1235241066 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d00cb6b0 con 0x7f70d00b3170 2023-08-25T04:44:01.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.270+0000 7f70d4ddf700 1 --2- 172.21.15.16:0/1235241066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d00b3170 0x7f70d00701f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009870 tx=0x7f70c0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b346227ab5f351f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:44:01.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.270+0000 7f70c7fff700 1 -- 172.21.15.16:0/1235241066 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0010a90 con 0x7f70d00b3170 2023-08-25T04:44:01.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.270+0000 7f70c7fff700 1 -- 172.21.15.16:0/1235241066 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0010bf0 con 0x7f70d00b3170 2023-08-25T04:44:01.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.270+0000 7f70c7fff700 1 -- 172.21.15.16:0/1235241066 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0018440 con 0x7f70d00b3170 2023-08-25T04:44:01.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.270+0000 7f70d7844700 1 -- 172.21.15.16:0/1235241066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d00b3170 msgr2=0x7f70d00701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:01.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.270+0000 7f70d7844700 1 --2- 172.21.15.16:0/1235241066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d00b3170 0x7f70d00701f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009870 tx=0x7f70c0009b80 comp rx=0 tx=0).stop 2023-08-25T04:44:01.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.270+0000 7f70d7844700 1 -- 172.21.15.16:0/1235241066 shutdown_connections 2023-08-25T04:44:01.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.270+0000 7f70d7844700 1 --2- 172.21.15.16:0/1235241066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d00b3170 0x7f70d00701f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:01.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.270+0000 7f70d7844700 1 -- 172.21.15.16:0/1235241066 >> 172.21.15.16:0/1235241066 conn(0x7f70d00d0fe0 msgr2=0x7f70d00d13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:44:01.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.270+0000 7f70d7844700 1 -- 172.21.15.16:0/1235241066 shutdown_connections 2023-08-25T04:44:01.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.271+0000 7f70d7844700 1 -- 172.21.15.16:0/1235241066 wait complete. 2023-08-25T04:44:01.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.272+0000 7f70d7844700 1 Processor -- start 2023-08-25T04:44:01.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.272+0000 7f70d7844700 1 -- start start 2023-08-25T04:44:01.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.272+0000 7f70d7844700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d00b3170 0x7f70d00cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:01.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.272+0000 7f70d7844700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d00d0970 0x7f70d00c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:01.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.272+0000 7f70d7844700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d015b380 0x7f70d01edd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:01.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d7844700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00c6a90 con 0x7f70d015b380 2023-08-25T04:44:01.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d7844700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00c9de0 con 0x7f70d00d0970 2023-08-25T04:44:01.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d7844700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0158160 con 0x7f70d00b3170 2023-08-25T04:44:01.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d5de1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d015b380 0x7f70d01edd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:01.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d5de1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d015b380 0x7f70d01edd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49814/0 (socket says 172.21.15.16:49814) 2023-08-25T04:44:01.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d5de1700 1 -- 172.21.15.16:0/803650771 learned_addr learned my addr 172.21.15.16:0/803650771 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:44:01.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d55e0700 1 --2- 172.21.15.16:0/803650771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d00b3170 0x7f70d00cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:01.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d4ddf700 1 --2- 172.21.15.16:0/803650771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d00d0970 0x7f70d00c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:01.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d5de1700 1 -- 172.21.15.16:0/803650771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d00b3170 msgr2=0x7f70d00cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:01.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d5de1700 1 --2- 172.21.15.16:0/803650771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d00b3170 0x7f70d00cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:01.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d5de1700 1 -- 172.21.15.16:0/803650771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d00d0970 msgr2=0x7f70d00c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:01.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d5de1700 1 --2- 172.21.15.16:0/803650771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d00d0970 0x7f70d00c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:01.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d5de1700 1 -- 172.21.15.16:0/803650771 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c00094a0 con 0x7f70d015b380 2023-08-25T04:44:01.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d5de1700 1 --2- 172.21.15.16:0/803650771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d015b380 0x7f70d01edd00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f70c800cc20 tx=0x7f70c800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:44:01.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70c5ffb700 1 -- 172.21.15.16:0/803650771 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c800ac20 con 0x7f70d015b380 2023-08-25T04:44:01.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70c5ffb700 1 -- 172.21.15.16:0/803650771 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c800ad80 con 0x7f70d015b380 2023-08-25T04:44:01.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70c5ffb700 1 -- 172.21.15.16:0/803650771 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8003c20 con 0x7f70d015b380 2023-08-25T04:44:01.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d7844700 1 -- 172.21.15.16:0/803650771 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d0156de0 con 0x7f70d015b380 2023-08-25T04:44:01.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.273+0000 7f70d7844700 1 -- 172.21.15.16:0/803650771 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d01573a0 con 0x7f70d015b380 2023-08-25T04:44:01.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.274+0000 7f70d7844700 1 -- 172.21.15.16:0/803650771 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d004ee70 con 0x7f70d015b380 2023-08-25T04:44:01.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.275+0000 7f70c5ffb700 1 -- 172.21.15.16:0/803650771 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f70c80050d0 con 0x7f70d015b380 2023-08-25T04:44:01.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.275+0000 7f70c5ffb700 1 --2- 172.21.15.16:0/803650771 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f70b406a0e0 0x7f70b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:01.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.275+0000 7f70c5ffb700 1 -- 172.21.15.16:0/803650771 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70c80886f0 con 0x7f70d015b380 2023-08-25T04:44:01.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.275+0000 7f70d55e0700 1 --2- 172.21.15.16:0/803650771 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f70b406a0e0 0x7f70b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:01.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.276+0000 7f70d55e0700 1 --2- 172.21.15.16:0/803650771 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f70b406a0e0 0x7f70b406c5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0011e0 tx=0x7f70cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:44:01.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.280+0000 7f70c5ffb700 1 -- 172.21.15.16:0/803650771 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f70c8053de0 con 0x7f70d015b380 2023-08-25T04:44:01.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.529+0000 7f70d7844700 1 -- 172.21.15.16:0/803650771 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f70d00b04c0 con 0x7f70d015b380 2023-08-25T04:44:01.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.530+0000 7f70c5ffb700 1 -- 172.21.15.16:0/803650771 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f70c8057400 con 0x7f70d015b380 2023-08-25T04:44:01.530 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:44:01.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.532+0000 7f70d7844700 1 -- 172.21.15.16:0/803650771 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f70b406a0e0 msgr2=0x7f70b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:01.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.532+0000 7f70d7844700 1 --2- 172.21.15.16:0/803650771 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f70b406a0e0 0x7f70b406c5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0011e0 tx=0x7f70cc009040 comp rx=0 tx=0).stop 2023-08-25T04:44:01.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.532+0000 7f70d7844700 1 -- 172.21.15.16:0/803650771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d015b380 msgr2=0x7f70d01edd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:01.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.532+0000 7f70d7844700 1 --2- 172.21.15.16:0/803650771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d015b380 0x7f70d01edd00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f70c800cc20 tx=0x7f70c800a060 comp rx=0 tx=0).stop 2023-08-25T04:44:01.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.532+0000 7f70d7844700 1 -- 172.21.15.16:0/803650771 shutdown_connections 2023-08-25T04:44:01.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.532+0000 7f70d7844700 1 --2- 172.21.15.16:0/803650771 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f70b406a0e0 0x7f70b406c5a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:01.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.532+0000 7f70d7844700 1 --2- 172.21.15.16:0/803650771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d015b380 0x7f70d01edd00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:01.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.532+0000 7f70d7844700 1 --2- 172.21.15.16:0/803650771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d00b3170 0x7f70d00cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:01.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.532+0000 7f70d7844700 1 --2- 172.21.15.16:0/803650771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d00d0970 0x7f70d00c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:01.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.532+0000 7f70d7844700 1 -- 172.21.15.16:0/803650771 >> 172.21.15.16:0/803650771 conn(0x7f70d00d0fe0 msgr2=0x7f70d00cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:44:01.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.532+0000 7f70d7844700 1 -- 172.21.15.16:0/803650771 shutdown_connections 2023-08-25T04:44:01.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:01.532+0000 7f70d7844700 1 -- 172.21.15.16:0/803650771 wait complete. 2023-08-25T04:44:01.545 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-25T04:44:01.545 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:44:01.545 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2023-08-25T04:44:01.545 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-25T04:44:01.546 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-25T04:44:01.546 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-25T04:44:01.546 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T04:44:01.546 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:44:01.546 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-25T04:44:01.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:01.547 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2023-08-25T04:44:01.566 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:44:01.566 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:44:01.567 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:44:01.567 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:01.567 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2023-08-25T04:44:01.567 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:01.568 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:44:01.568 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:44:01.568 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:44:01.569 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:44:01.569 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:44:01.569 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:44:01.570 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-25T04:44:01.570 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42302sec preferred_lft 42302sec 2023-08-25T04:44:01.570 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2023-08-25T04:44:01.570 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:01.571 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:44:01.571 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:44:01.571 INFO:teuthology.orchestra.run.smithi016.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:44:01.571 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether f6:7c:c1:5c:62:1d brd ff:ff:ff:ff:ff:ff 2023-08-25T04:44:01.572 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T04:44:01.572 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:01.572 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::dc3e:deff:fef6:c05e/64 scope link 2023-08-25T04:44:01.573 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:01.573 INFO:teuthology.orchestra.run.smithi016.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:44:01.573 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether f6:7c:c1:5c:62:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:44:01.573 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::f47c:c1ff:fe5c:621d/64 scope link tentative 2023-08-25T04:44:01.574 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:01.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:01.575 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:44:01.632 INFO:teuthology.orchestra.run.smithi016.stdout:1 2023-08-25T04:44:01.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:01.635 DEBUG:teuthology.orchestra.run.smithi016:> route 2023-08-25T04:44:01.693 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2023-08-25T04:44:01.693 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:44:01.693 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-25T04:44:01.693 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-25T04:44:01.694 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:44:01.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:01.694 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-08-25T04:44:01.695 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-08-25T04:44:01.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T04:44:01.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T04:44:01.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T04:44:01.696 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-08-25T04:44:01.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:01.800 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-08-25T04:44:01.817 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T04:44:01.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:01.818 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2023-08-25T04:44:01.874 INFO:teuthology.orchestra.run.smithi016.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-25T04:44:01.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:01.875 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-08-25T04:44:01.876 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-08-25T04:44:01.876 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T04:44:01.876 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-25T04:44:01.876 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-08-25T04:44:01.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:01.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-25T04:44:02.009 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:44:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:44:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:44:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2023-08-25T04:44:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:02.010 INFO:teuthology.orchestra.run.smithi016.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:44:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether e2:dc:28:3d:56:d8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-25T04:44:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-25T04:44:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::e0dc:28ff:fe3d:56d8/64 scope link 2023-08-25T04:44:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:02.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:02.024 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-25T04:44:02.111 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:44:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:44:02.111 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:44:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2023-08-25T04:44:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:02.112 INFO:teuthology.orchestra.run.smithi016.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:44:02.112 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether e2:dc:28:3d:56:d8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-25T04:44:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-25T04:44:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::e0dc:28ff:fe3d:56d8/64 scope link 2023-08-25T04:44:02.113 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:02.123 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-25T04:44:02.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:02.124 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-08-25T04:44:02.124 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-08-25T04:44:02.124 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-25T04:44:02.125 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-25T04:44:02.125 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-25T04:44:02.125 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-25T04:44:02.125 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-25T04:44:02.126 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-08-25T04:44:02.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:02.342 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-08-25T04:44:02.342 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-08-25T04:44:02.342 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.1 up 2023-08-25T04:44:02.342 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.1 master ceph-brx 2023-08-25T04:44:02.343 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-08-25T04:44:02.461 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:44:02.461 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-08-25T04:44:02.497 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-08-25T04:44:02.497 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:44:02.498 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-08-25T04:44:02.554 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-25T04:44:02.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:02.555 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-08-25T04:44:02.641 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-08-25T04:44:02.642 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-08-25T04:44:02.642 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-08-25T04:44:02.650 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-08-25T04:44:02.651 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-08-25T04:44:02.651 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-08-25T04:44:02.651 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-25T04:44:02.651 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-25T04:44:02.724 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-08-25T04:44:02.724 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-08-25T04:44:02.724 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-08-25T04:44:02.725 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-25T04:44:02.725 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-25T04:44:02.725 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.117:6789,172.21.15.117:6790" 2023-08-25T04:44:02.725 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2023-08-25T04:44:02.725 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=53372d9f-1238-45a2-a21f-2a854d90c0cf" will pass to kernel 2023-08-25T04:44:02.726 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:44:02.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:02.727 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-25T04:44:02.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:02.760 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:44:02.833 INFO:teuthology.orchestra.run.smithi016.stdout:client4636 2023-08-25T04:44:02.833 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:44:02.834 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:44:02.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:02.890 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:44:02.963 INFO:teuthology.orchestra.run.smithi016.stdout:client4636 2023-08-25T04:44:02.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:02.963 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:44:03.036 INFO:teuthology.orchestra.run.smithi016.stdout:client4636 2023-08-25T04:44:03.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:03.037 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/53372d9f-1238-45a2-a21f-2a854d90c0cf.client4636/status') 2023-08-25T04:44:03.117 INFO:teuthology.orchestra.run.smithi016.stdout:instance: client.4636 (3)172.21.15.16:0/3694851687 2023-08-25T04:44:03.117 INFO:teuthology.orchestra.run.smithi016.stdout:blocklisted: false 2023-08-25T04:44:03.118 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2023-08-25T04:44:03.119 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2023-08-25T04:44:03.119 INFO:teuthology.orchestra.run.smithi016.stderr:70 bytes copied, 2.5785e-05 s, 2.7 MB/s 2023-08-25T04:44:03.119 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-08-25T04:44:03.119 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-25T04:44:03.120 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-25T04:44:03.120 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:44:03.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.283+0000 7f309cc32700 1 Processor -- start 2023-08-25T04:44:03.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.283+0000 7f309cc32700 1 -- start start 2023-08-25T04:44:03.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.284+0000 7f309cc32700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f309815d3e0 0x7f30980ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:03.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.284+0000 7f309cc32700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30980b36e0 0x7f30980cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:03.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.284+0000 7f309cc32700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30980d0e50 con 0x7f3098161080 2023-08-25T04:44:03.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.284+0000 7f309cc32700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3098161d00 con 0x7f309815d3e0 2023-08-25T04:44:03.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.284+0000 7f309cc32700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30980b2c00 con 0x7f30980b36e0 2023-08-25T04:44:03.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.285+0000 7f309659c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f309815d3e0 0x7f30980ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:03.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.285+0000 7f3095d9b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30980b36e0 0x7f30980cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:03.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.285+0000 7f3096d9d700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f3098161080 0x7f3098161510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.16:48336/0 (socket says 172.21.15.16:48336) 2023-08-25T04:44:03.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.285+0000 7f3096d9d700 1 -- 172.21.15.16:0/2433805746 learned_addr learned my addr 172.21.15.16:0/2433805746 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:44:03.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.285+0000 7f309559a700 1 -- 172.21.15.16:0/2433805746 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103033763 0 0) 0x7f30980d0e50 con 0x7f3098161080 2023-08-25T04:44:03.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.285+0000 7f309559a700 1 -- 172.21.15.16:0/2433805746 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30840035b0 con 0x7f3098161080 2023-08-25T04:44:03.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.285+0000 7f309659c700 1 -- 172.21.15.16:0/2433805746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30980b36e0 msgr2=0x7f30980cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:44:03.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.285+0000 7f309659c700 1 --2- 172.21.15.16:0/2433805746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30980b36e0 0x7f30980cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:03.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.285+0000 7f309659c700 1 -- 172.21.15.16:0/2433805746 >> v1:172.21.15.117:6789/0 conn(0x7f3098161080 legacy=0x7f3098161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:03.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.285+0000 7f309659c700 1 -- 172.21.15.16:0/2433805746 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3098161fe0 con 0x7f309815d3e0 2023-08-25T04:44:03.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.285+0000 7f3095d9b700 1 --2- 172.21.15.16:0/2433805746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30980b36e0 0x7f30980cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:44:03.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.285+0000 7f309659c700 1 --2- 172.21.15.16:0/2433805746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f309815d3e0 0x7f30980ceb20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3088009840 tx=0x7f3088009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70cacd3161a160c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:44:03.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.285+0000 7f309559a700 1 -- 172.21.15.16:0/2433805746 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088011830 con 0x7f309815d3e0 2023-08-25T04:44:03.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.286+0000 7f309559a700 1 -- 172.21.15.16:0/2433805746 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3088011990 con 0x7f309815d3e0 2023-08-25T04:44:03.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.286+0000 7f309559a700 1 -- 172.21.15.16:0/2433805746 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088011d20 con 0x7f309815d3e0 2023-08-25T04:44:03.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.286+0000 7f309cc32700 1 -- 172.21.15.16:0/2433805746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f309815d3e0 msgr2=0x7f30980ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:03.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.286+0000 7f309cc32700 1 --2- 172.21.15.16:0/2433805746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f309815d3e0 0x7f30980ceb20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3088009840 tx=0x7f3088009b50 comp rx=0 tx=0).stop 2023-08-25T04:44:03.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.286+0000 7f309cc32700 1 -- 172.21.15.16:0/2433805746 shutdown_connections 2023-08-25T04:44:03.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.286+0000 7f309cc32700 1 --2- 172.21.15.16:0/2433805746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f309815d3e0 0x7f30980ceb20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:03.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.286+0000 7f309cc32700 1 --2- 172.21.15.16:0/2433805746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30980b36e0 0x7f30980cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:03.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.286+0000 7f309cc32700 1 -- 172.21.15.16:0/2433805746 >> 172.21.15.16:0/2433805746 conn(0x7f30980d0fe0 msgr2=0x7f30980d13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:44:03.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.286+0000 7f309cc32700 1 -- 172.21.15.16:0/2433805746 shutdown_connections 2023-08-25T04:44:03.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.286+0000 7f309cc32700 1 -- 172.21.15.16:0/2433805746 wait complete. 2023-08-25T04:44:03.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.288+0000 7f309cc32700 1 Processor -- start 2023-08-25T04:44:03.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.288+0000 7f309cc32700 1 -- start start 2023-08-25T04:44:03.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.288+0000 7f309cc32700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30980b36e0 0x7f309815c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:03.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.288+0000 7f309cc32700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f309815d3e0 0x7f30980c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:03.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.288+0000 7f309cc32700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3098161080 0x7f309815fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:03.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.288+0000 7f309cc32700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30981593c0 con 0x7f3098161080 2023-08-25T04:44:03.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.288+0000 7f309cc32700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3098159c60 con 0x7f309815d3e0 2023-08-25T04:44:03.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.288+0000 7f309cc32700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309815c890 con 0x7f30980b36e0 2023-08-25T04:44:03.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f3096d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3098161080 0x7f309815fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:03.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f3096d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3098161080 0x7f309815fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49832/0 (socket says 172.21.15.16:49832) 2023-08-25T04:44:03.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f3096d9d700 1 -- 172.21.15.16:0/2353603230 learned_addr learned my addr 172.21.15.16:0/2353603230 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:44:03.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f3095d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f309815d3e0 0x7f30980c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f309659c700 1 --2- 172.21.15.16:0/2353603230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30980b36e0 0x7f309815c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f3096d9d700 1 -- 172.21.15.16:0/2353603230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30980b36e0 msgr2=0x7f309815c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f3096d9d700 1 --2- 172.21.15.16:0/2353603230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30980b36e0 0x7f309815c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f3096d9d700 1 -- 172.21.15.16:0/2353603230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f309815d3e0 msgr2=0x7f30980c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f3096d9d700 1 --2- 172.21.15.16:0/2353603230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f309815d3e0 0x7f30980c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f3096d9d700 1 -- 172.21.15.16:0/2353603230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30800094a0 con 0x7f3098161080 2023-08-25T04:44:03.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f3095d9b700 1 --2- 172.21.15.16:0/2353603230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f309815d3e0 0x7f30980c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:44:03.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f3096d9d700 1 --2- 172.21.15.16:0/2353603230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3098161080 0x7f309815fcf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f309000cb70 tx=0x7f309000ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:44:03.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f308effd700 1 -- 172.21.15.16:0/2353603230 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309000aa60 con 0x7f3098161080 2023-08-25T04:44:03.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f308effd700 1 -- 172.21.15.16:0/2353603230 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309000abc0 con 0x7f3098161080 2023-08-25T04:44:03.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f309cc32700 1 -- 172.21.15.16:0/2353603230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30880094a0 con 0x7f3098161080 2023-08-25T04:44:03.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f308effd700 1 -- 172.21.15.16:0/2353603230 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090012400 con 0x7f3098161080 2023-08-25T04:44:03.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.289+0000 7f309cc32700 1 -- 172.21.15.16:0/2353603230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3098159610 con 0x7f3098161080 2023-08-25T04:44:03.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.290+0000 7f309cc32700 1 -- 172.21.15.16:0/2353603230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309804ee70 con 0x7f3098161080 2023-08-25T04:44:03.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.291+0000 7f308effd700 1 -- 172.21.15.16:0/2353603230 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f309001b3b0 con 0x7f3098161080 2023-08-25T04:44:03.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.291+0000 7f308effd700 1 --2- 172.21.15.16:0/2353603230 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f307806a0e0 0x7f307806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:03.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.291+0000 7f308effd700 1 -- 172.21.15.16:0/2353603230 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f30900881e0 con 0x7f3098161080 2023-08-25T04:44:03.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.291+0000 7f309659c700 1 --2- 172.21.15.16:0/2353603230 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f307806a0e0 0x7f307806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:03.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.292+0000 7f309659c700 1 --2- 172.21.15.16:0/2353603230 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f307806a0e0 0x7f307806c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3088000c00 tx=0x7f3088008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:44:03.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.296+0000 7f308effd700 1 -- 172.21.15.16:0/2353603230 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f30900538d0 con 0x7f3098161080 2023-08-25T04:44:03.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.541+0000 7f309cc32700 1 -- 172.21.15.16:0/2353603230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f30980b6f60 con 0x7f3098161080 2023-08-25T04:44:03.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.541+0000 7f308effd700 1 -- 172.21.15.16:0/2353603230 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3090056ef0 con 0x7f3098161080 2023-08-25T04:44:03.543 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:44:03.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.543+0000 7f309cc32700 1 -- 172.21.15.16:0/2353603230 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f307806a0e0 msgr2=0x7f307806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:03.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.543+0000 7f309cc32700 1 --2- 172.21.15.16:0/2353603230 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f307806a0e0 0x7f307806c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3088000c00 tx=0x7f3088008030 comp rx=0 tx=0).stop 2023-08-25T04:44:03.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.543+0000 7f309cc32700 1 -- 172.21.15.16:0/2353603230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3098161080 msgr2=0x7f309815fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:03.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.543+0000 7f309cc32700 1 --2- 172.21.15.16:0/2353603230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3098161080 0x7f309815fcf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f309000cb70 tx=0x7f309000ce80 comp rx=0 tx=0).stop 2023-08-25T04:44:03.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.543+0000 7f309cc32700 1 -- 172.21.15.16:0/2353603230 shutdown_connections 2023-08-25T04:44:03.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.543+0000 7f309cc32700 1 --2- 172.21.15.16:0/2353603230 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f307806a0e0 0x7f307806c5a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:03.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.543+0000 7f309cc32700 1 --2- 172.21.15.16:0/2353603230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3098161080 0x7f309815fcf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:03.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.543+0000 7f309cc32700 1 --2- 172.21.15.16:0/2353603230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30980b36e0 0x7f309815c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:03.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.543+0000 7f309cc32700 1 --2- 172.21.15.16:0/2353603230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f309815d3e0 0x7f30980c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:03.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.543+0000 7f309cc32700 1 -- 172.21.15.16:0/2353603230 >> 172.21.15.16:0/2353603230 conn(0x7f30980d0fe0 msgr2=0x7f3098152640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:44:03.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.543+0000 7f309cc32700 1 -- 172.21.15.16:0/2353603230 shutdown_connections 2023-08-25T04:44:03.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:03.543+0000 7f309cc32700 1 -- 172.21.15.16:0/2353603230 wait complete. 2023-08-25T04:44:03.556 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-25T04:44:03.557 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:44:03.557 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-08-25T04:44:03.557 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-25T04:44:03.557 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-25T04:44:03.558 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-25T04:44:03.558 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T04:44:03.558 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:44:03.558 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-25T04:44:03.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:03.559 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-08-25T04:44:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:44:03.581 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:44:03.581 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:44:03.581 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:03.581 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-25T04:44:03.581 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:44:03.581 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-08-25T04:44:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:44:03.582 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-08-25T04:44:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:44:03.582 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:44:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:44:03.582 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:44:03.582 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-25T04:44:03.582 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42308sec preferred_lft 42308sec 2023-08-25T04:44:03.583 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ef38:bc01:7caf:5ef/64 scope link noprefixroute 2023-08-25T04:44:03.583 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:03.583 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-25T04:44:03.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:03.584 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-25T04:44:03.584 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-25T04:44:03.584 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add name ceph-brx type bridge 2023-08-25T04:44:03.585 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr flush dev ceph-brx 2023-08-25T04:44:03.585 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set ceph-brx up 2023-08-25T04:44:03.585 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-25T04:44:03.586 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-25T04:44:03.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:03.754 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:44:03.782 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-25T04:44:03.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:03.784 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-08-25T04:44:03.862 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-08-25T04:44:03.862 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:44:03.863 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-25T04:44:03.863 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-25T04:44:03.863 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:44:03.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:03.864 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-25T04:44:03.865 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-25T04:44:03.865 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-25T04:44:03.866 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-25T04:44:03.866 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-25T04:44:03.866 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-25T04:44:04.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:04.122 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-25T04:44:04.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:04.140 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2023-08-25T04:44:04.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:04.196 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-25T04:44:04.197 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-25T04:44:04.197 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-25T04:44:04.197 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-25T04:44:04.197 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-25T04:44:04.290 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-25T04:44:04.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:04.291 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-25T04:44:04.291 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-25T04:44:04.291 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-25T04:44:04.291 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-25T04:44:04.292 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-25T04:44:04.292 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-25T04:44:04.292 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-25T04:44:04.292 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-25T04:44:04.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:04.500 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-25T04:44:04.500 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-25T04:44:04.500 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-08-25T04:44:04.501 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.0 master ceph-brx 2023-08-25T04:44:04.501 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-25T04:44:04.599 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:44:04.599 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-25T04:44:04.619 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-25T04:44:04.620 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:44:04.620 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-25T04:44:04.675 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-25T04:44:04.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:04.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-25T04:44:04.764 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-25T04:44:04.765 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-25T04:44:04.765 INFO:teuthology.orchestra.run.smithi117.stdout:invalid new device string format 2023-08-25T04:44:04.868 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-25T04:44:04.868 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-25T04:44:04.868 INFO:teuthology.orchestra.run.smithi117.stdout:invalid new device string format 2023-08-25T04:44:04.869 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-25T04:44:04.869 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-25T04:44:04.900 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-25T04:44:04.900 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-25T04:44:04.900 INFO:teuthology.orchestra.run.smithi117.stdout:invalid new device string format 2023-08-25T04:44:04.901 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-25T04:44:04.901 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-25T04:44:04.901 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.117:6789,172.21.15.117:6790" 2023-08-25T04:44:04.901 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2023-08-25T04:44:04.901 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=53372d9f-1238-45a2-a21f-2a854d90c0cf" will pass to kernel 2023-08-25T04:44:04.904 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:44:04.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:04.905 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-25T04:44:04.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:04.936 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:44:05.008 INFO:teuthology.orchestra.run.smithi117.stdout:client4517 2023-08-25T04:44:05.008 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:44:05.009 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:44:05.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:05.066 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:44:05.145 INFO:teuthology.orchestra.run.smithi117.stdout:client4517 2023-08-25T04:44:05.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:05.146 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:44:05.217 INFO:teuthology.orchestra.run.smithi117.stdout:client4517 2023-08-25T04:44:05.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:05.218 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/53372d9f-1238-45a2-a21f-2a854d90c0cf.client4517/status') 2023-08-25T04:44:05.297 INFO:teuthology.orchestra.run.smithi117.stdout:instance: client.4517 (3)192.168.0.1:0/4247030193 2023-08-25T04:44:05.297 INFO:teuthology.orchestra.run.smithi117.stdout:blocklisted: false 2023-08-25T04:44:05.298 INFO:teuthology.orchestra.run.smithi117.stderr:0+1 records in 2023-08-25T04:44:05.298 INFO:teuthology.orchestra.run.smithi117.stderr:0+1 records out 2023-08-25T04:44:05.298 INFO:teuthology.orchestra.run.smithi117.stderr:69 bytes copied, 2.0468e-05 s, 3.4 MB/s 2023-08-25T04:44:05.299 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-08-25T04:44:05.299 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-25T04:44:05.299 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-25T04:44:05.299 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:44:05.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.438+0000 7f7e9f21e700 1 Processor -- start 2023-08-25T04:44:05.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.438+0000 7f7e9f21e700 1 -- start start 2023-08-25T04:44:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.439+0000 7f7e9f21e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7e9815e920 0x7f7e98065fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.439+0000 7f7e9f21e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e980b1990 con 0x7f7e980ae960 2023-08-25T04:44:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.439+0000 7f7e9f21e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e980cbe50 con 0x7f7e9806a550 2023-08-25T04:44:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.439+0000 7f7e9f21e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980ccd20 con 0x7f7e9815e920 2023-08-25T04:44:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.439+0000 7f7e9cfba700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7e9815e920 0x7f7e98065fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.439+0000 7f7e97fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7e980ae960 0x7f7e980cc610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40252/0 (socket says 172.21.15.16:40252) 2023-08-25T04:44:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.439+0000 7f7e97fff700 1 -- 172.21.15.16:0/4266109631 learned_addr learned my addr 172.21.15.16:0/4266109631 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:44:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.440+0000 7f7e9cfba700 1 -- 172.21.15.16:0/4266109631 >> v1:172.21.15.117:6789/0 conn(0x7f7e9806a550 legacy=0x7f7e980cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.440+0000 7f7e9cfba700 1 -- 172.21.15.16:0/4266109631 >> v1:172.21.15.16:6789/0 conn(0x7f7e980ae960 legacy=0x7f7e980cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.440+0000 7f7e977fe700 1 -- 172.21.15.16:0/4266109631 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582185952 0 0) 0x7f7e980b1990 con 0x7f7e980ae960 2023-08-25T04:44:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.440+0000 7f7e9cfba700 1 -- 172.21.15.16:0/4266109631 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e980b1c10 con 0x7f7e9815e920 2023-08-25T04:44:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.440+0000 7f7e9cfba700 1 --2- 172.21.15.16:0/4266109631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9815e920 0x7f7e98065fe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009820 tx=0x7f7e8c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a635ef6fa533bb6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:44:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.440+0000 7f7e977fe700 1 -- 172.21.15.16:0/4266109631 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c005e30 con 0x7f7e9815e920 2023-08-25T04:44:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.440+0000 7f7e977fe700 1 -- 172.21.15.16:0/4266109631 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c006030 con 0x7f7e9815e920 2023-08-25T04:44:05.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.440+0000 7f7e977fe700 1 -- 172.21.15.16:0/4266109631 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0063e0 con 0x7f7e9815e920 2023-08-25T04:44:05.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.441+0000 7f7e9f21e700 1 -- 172.21.15.16:0/4266109631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9815e920 msgr2=0x7f7e98065fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:05.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.441+0000 7f7e9f21e700 1 --2- 172.21.15.16:0/4266109631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9815e920 0x7f7e98065fe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009820 tx=0x7f7e8c009b30 comp rx=0 tx=0).stop 2023-08-25T04:44:05.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.441+0000 7f7e9f21e700 1 -- 172.21.15.16:0/4266109631 shutdown_connections 2023-08-25T04:44:05.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.441+0000 7f7e9f21e700 1 --2- 172.21.15.16:0/4266109631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9815e920 0x7f7e98065fe0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:05.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.441+0000 7f7e9f21e700 1 -- 172.21.15.16:0/4266109631 >> 172.21.15.16:0/4266109631 conn(0x7f7e980b2480 msgr2=0x7f7e980b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:44:05.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.441+0000 7f7e9f21e700 1 -- 172.21.15.16:0/4266109631 shutdown_connections 2023-08-25T04:44:05.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.441+0000 7f7e9f21e700 1 -- 172.21.15.16:0/4266109631 wait complete. 2023-08-25T04:44:05.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.442+0000 7f7e9f21e700 1 Processor -- start 2023-08-25T04:44:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.442+0000 7f7e9f21e700 1 -- start start 2023-08-25T04:44:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.443+0000 7f7e9f21e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9806a550 0x7f7e981f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.443+0000 7f7e9f21e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e980ae960 0x7f7e980b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.443+0000 7f7e9f21e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e9815e920 0x7f7e980b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.443+0000 7f7e9f21e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980ad5c0 con 0x7f7e9806a550 2023-08-25T04:44:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.443+0000 7f7e9f21e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9815a820 con 0x7f7e9815e920 2023-08-25T04:44:05.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.443+0000 7f7e9f21e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9815a260 con 0x7f7e980ae960 2023-08-25T04:44:05.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.443+0000 7f7e9cfba700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9806a550 0x7f7e981f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:05.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.443+0000 7f7e9cfba700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9806a550 0x7f7e981f23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49840/0 (socket says 172.21.15.16:49840) 2023-08-25T04:44:05.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.443+0000 7f7e9cfba700 1 -- 172.21.15.16:0/2494096435 learned_addr learned my addr 172.21.15.16:0/2494096435 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:44:05.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.443+0000 7f7e9d7bb700 1 --2- 172.21.15.16:0/2494096435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e9815e920 0x7f7e980b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:05.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.443+0000 7f7e97fff700 1 --2- 172.21.15.16:0/2494096435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e980ae960 0x7f7e980b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:05.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.444+0000 7f7e9cfba700 1 -- 172.21.15.16:0/2494096435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e980ae960 msgr2=0x7f7e980b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:05.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.444+0000 7f7e9cfba700 1 --2- 172.21.15.16:0/2494096435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e980ae960 0x7f7e980b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:05.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.444+0000 7f7e9cfba700 1 -- 172.21.15.16:0/2494096435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e9815e920 msgr2=0x7f7e980b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:05.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.444+0000 7f7e9cfba700 1 --2- 172.21.15.16:0/2494096435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e9815e920 0x7f7e980b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:05.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.444+0000 7f7e9cfba700 1 -- 172.21.15.16:0/2494096435 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c009430 con 0x7f7e9806a550 2023-08-25T04:44:05.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.444+0000 7f7e9cfba700 1 --2- 172.21.15.16:0/2494096435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9806a550 0x7f7e981f23e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c000c00 tx=0x7f7e8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:44:05.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.444+0000 7f7e957fa700 1 -- 172.21.15.16:0/2494096435 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c025430 con 0x7f7e9806a550 2023-08-25T04:44:05.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.444+0000 7f7e957fa700 1 -- 172.21.15.16:0/2494096435 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c020070 con 0x7f7e9806a550 2023-08-25T04:44:05.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.444+0000 7f7e9f21e700 1 -- 172.21.15.16:0/2494096435 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9815a540 con 0x7f7e9806a550 2023-08-25T04:44:05.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.444+0000 7f7e957fa700 1 -- 172.21.15.16:0/2494096435 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0257d0 con 0x7f7e9806a550 2023-08-25T04:44:05.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.444+0000 7f7e9f21e700 1 -- 172.21.15.16:0/2494096435 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e981594d0 con 0x7f7e9806a550 2023-08-25T04:44:05.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.445+0000 7f7e9f21e700 1 -- 172.21.15.16:0/2494096435 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e981591f0 con 0x7f7e9806a550 2023-08-25T04:44:05.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.445+0000 7f7e957fa700 1 -- 172.21.15.16:0/2494096435 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e8c022030 con 0x7f7e9806a550 2023-08-25T04:44:05.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.446+0000 7f7e957fa700 1 --2- 172.21.15.16:0/2494096435 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f7e7c06a0e0 0x7f7e7c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:44:05.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.446+0000 7f7e957fa700 1 -- 172.21.15.16:0/2494096435 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e8c089b00 con 0x7f7e9806a550 2023-08-25T04:44:05.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.446+0000 7f7e97fff700 1 --2- 172.21.15.16:0/2494096435 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f7e7c06a0e0 0x7f7e7c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:44:05.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.446+0000 7f7e97fff700 1 --2- 172.21.15.16:0/2494096435 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f7e7c06a0e0 0x7f7e7c06c5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7e98154e20 tx=0x7f7e84004a50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:44:05.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.450+0000 7f7e957fa700 1 -- 172.21.15.16:0/2494096435 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7e981591f0 con 0x7f7e9806a550 2023-08-25T04:44:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.698+0000 7f7e9f21e700 1 -- 172.21.15.16:0/2494096435 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7e981591f0 con 0x7f7e9806a550 2023-08-25T04:44:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.698+0000 7f7e957fa700 1 -- 172.21.15.16:0/2494096435 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7e981591f0 con 0x7f7e9806a550 2023-08-25T04:44:05.699 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:44:05.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.700+0000 7f7e9f21e700 1 -- 172.21.15.16:0/2494096435 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f7e7c06a0e0 msgr2=0x7f7e7c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:05.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.700+0000 7f7e9f21e700 1 --2- 172.21.15.16:0/2494096435 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f7e7c06a0e0 0x7f7e7c06c5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7e98154e20 tx=0x7f7e84004a50 comp rx=0 tx=0).stop 2023-08-25T04:44:05.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.700+0000 7f7e9f21e700 1 -- 172.21.15.16:0/2494096435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9806a550 msgr2=0x7f7e981f23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:44:05.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.700+0000 7f7e9f21e700 1 --2- 172.21.15.16:0/2494096435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9806a550 0x7f7e981f23e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c000c00 tx=0x7f7e8c004750 comp rx=0 tx=0).stop 2023-08-25T04:44:05.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.701+0000 7f7e9f21e700 1 -- 172.21.15.16:0/2494096435 shutdown_connections 2023-08-25T04:44:05.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.701+0000 7f7e9f21e700 1 --2- 172.21.15.16:0/2494096435 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f7e7c06a0e0 0x7f7e7c06c5a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:05.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.701+0000 7f7e9f21e700 1 --2- 172.21.15.16:0/2494096435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e9815e920 0x7f7e980b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:05.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.701+0000 7f7e9f21e700 1 --2- 172.21.15.16:0/2494096435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9806a550 0x7f7e981f23e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:05.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.701+0000 7f7e9f21e700 1 --2- 172.21.15.16:0/2494096435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e980ae960 0x7f7e980b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:44:05.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.701+0000 7f7e9f21e700 1 -- 172.21.15.16:0/2494096435 >> 172.21.15.16:0/2494096435 conn(0x7f7e980b2480 msgr2=0x7f7e980cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:44:05.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.701+0000 7f7e9f21e700 1 -- 172.21.15.16:0/2494096435 shutdown_connections 2023-08-25T04:44:05.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:44:05.701+0000 7f7e9f21e700 1 -- 172.21.15.16:0/2494096435 wait complete. 2023-08-25T04:44:05.713 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-25T04:44:05.714 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:44:05.714 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-08-25T04:44:05.714 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-25T04:44:05.715 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-25T04:44:05.715 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-25T04:44:05.715 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T04:44:05.716 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:44:05.716 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-25T04:44:05.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:05.716 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-08-25T04:44:05.735 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:44:05.735 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:44:05.735 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:44:05.736 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:05.736 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-25T04:44:05.736 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:05.736 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:44:05.736 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-08-25T04:44:05.737 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:44:05.737 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-08-25T04:44:05.737 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:44:05.737 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:44:05.737 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:44:05.737 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:44:05.738 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-25T04:44:05.738 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42305sec preferred_lft 42305sec 2023-08-25T04:44:05.738 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ef38:bc01:7caf:5ef/64 scope link noprefixroute 2023-08-25T04:44:05.739 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:05.739 INFO:teuthology.orchestra.run.smithi117.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:44:05.739 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 82:ca:48:4f:a1:bc brd ff:ff:ff:ff:ff:ff 2023-08-25T04:44:05.739 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T04:44:05.739 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:05.739 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::e0b7:beff:fe64:af4d/64 scope link 2023-08-25T04:44:05.740 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:05.740 INFO:teuthology.orchestra.run.smithi117.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:44:05.740 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 82:ca:48:4f:a1:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-25T04:44:05.740 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::80ca:48ff:fe4f:a1bc/64 scope link tentative 2023-08-25T04:44:05.740 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:05.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:05.741 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:44:05.801 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-08-25T04:44:05.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:05.803 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-08-25T04:44:05.861 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-08-25T04:44:05.862 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:44:05.862 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-25T04:44:05.862 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-25T04:44:05.862 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:44:05.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:05.863 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-25T04:44:05.863 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-25T04:44:05.863 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-25T04:44:05.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-25T04:44:05.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-25T04:44:05.864 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-25T04:44:05.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:05.968 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-25T04:44:05.984 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-25T04:44:05.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:05.985 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2023-08-25T04:44:06.040 INFO:teuthology.orchestra.run.smithi117.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-25T04:44:06.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:06.041 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-25T04:44:06.042 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-25T04:44:06.042 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-25T04:44:06.042 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-25T04:44:06.042 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-25T04:44:06.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:06.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-25T04:44:06.168 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:44:06.168 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:44:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:44:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-25T04:44:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:06.169 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:44:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 62:af:85:aa:f3:33 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-25T04:44:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-25T04:44:06.170 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:06.170 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::60af:85ff:feaa:f333/64 scope link tentative 2023-08-25T04:44:06.170 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:06.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:06.185 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-25T04:44:06.265 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:44:06.265 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:44:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:44:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-08-25T04:44:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:06.266 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:44:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 62:af:85:aa:f3:33 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-25T04:44:06.267 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-25T04:44:06.267 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:06.267 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::60af:85ff:feaa:f333/64 scope link tentative 2023-08-25T04:44:06.267 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:44:06.279 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-25T04:44:06.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:06.279 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-25T04:44:06.280 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-25T04:44:06.280 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-25T04:44:06.280 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-25T04:44:06.280 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-25T04:44:06.281 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-25T04:44:06.281 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-25T04:44:06.281 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-25T04:44:06.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:06.540 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-08-25T04:44:06.541 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-08-25T04:44:06.541 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.1 up 2023-08-25T04:44:06.541 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.1 master ceph-brx 2023-08-25T04:44:06.541 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-08-25T04:44:06.659 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:44:06.659 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-08-25T04:44:06.678 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-08-25T04:44:06.679 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:44:06.679 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-08-25T04:44:06.735 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-25T04:44:06.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:06.736 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-08-25T04:44:06.820 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-08-25T04:44:06.821 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-08-25T04:44:06.821 INFO:teuthology.orchestra.run.smithi117.stdout:invalid new device string format 2023-08-25T04:44:06.829 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-08-25T04:44:06.829 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-08-25T04:44:06.829 INFO:teuthology.orchestra.run.smithi117.stdout:invalid new device string format 2023-08-25T04:44:06.829 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-25T04:44:06.830 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-25T04:44:06.902 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-08-25T04:44:06.903 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-08-25T04:44:06.903 INFO:teuthology.orchestra.run.smithi117.stdout:invalid new device string format 2023-08-25T04:44:06.903 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.117:3300,172.21.15.117:3301" 2023-08-25T04:44:06.903 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-25T04:44:06.903 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.117:6789,172.21.15.117:6790" 2023-08-25T04:44:06.903 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2023-08-25T04:44:06.904 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=53372d9f-1238-45a2-a21f-2a854d90c0cf" will pass to kernel 2023-08-25T04:44:06.905 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:44:06.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:06.905 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-25T04:44:06.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:06.933 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:44:07.003 INFO:teuthology.orchestra.run.smithi117.stdout:client4677 2023-08-25T04:44:07.004 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:44:07.004 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:44:07.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:07.061 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:44:07.132 INFO:teuthology.orchestra.run.smithi117.stdout:client4677 2023-08-25T04:44:07.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:07.133 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:44:07.204 INFO:teuthology.orchestra.run.smithi117.stdout:client4677 2023-08-25T04:44:07.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:44:07.205 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/53372d9f-1238-45a2-a21f-2a854d90c0cf.client4677/status') 2023-08-25T04:44:07.284 INFO:teuthology.orchestra.run.smithi117.stdout:instance: client.4677 (3)172.21.15.117:0/615070383 2023-08-25T04:44:07.284 INFO:teuthology.orchestra.run.smithi117.stdout:blocklisted: false 2023-08-25T04:44:07.286 INFO:teuthology.orchestra.run.smithi117.stderr:0+1 records in 2023-08-25T04:44:07.286 INFO:teuthology.orchestra.run.smithi117.stderr:0+1 records out 2023-08-25T04:44:07.286 INFO:teuthology.orchestra.run.smithi117.stderr:70 bytes copied, 2.2994e-05 s, 3.0 MB/s 2023-08-25T04:44:07.289 INFO:teuthology.run_tasks:Running task workunit... 2023-08-25T04:44:07.306 INFO:tasks.workunit:Pulling workunits from ref ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:44:07.306 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-08-25T04:44:07.306 INFO:tasks.workunit:timeout=3h 2023-08-25T04:44:07.307 INFO:tasks.workunit:cleanup=True 2023-08-25T04:44:07.307 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2023-08-25T04:44:07.330 INFO:teuthology.orchestra.run.smithi016.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-08-25T04:44:07.331 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-08-25T04:44:07.331 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 2fh/47d Inode: 1 Links: 2 2023-08-25T04:44:07.331 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:44:07.332 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:cephfs_t:s0 2023-08-25T04:44:07.332 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-08-25T04:44:07.332 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-08-25 04:43:42.871743872 +0000 2023-08-25T04:44:07.332 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-08-25 04:44:00.832101337 +0000 2023-08-25T04:44:07.333 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2023-08-25 04:43:42.871743872 +0000 2023-08-25T04:44:07.333 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-08-25T04:44:07.334 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-08-25T04:44:07.408 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.2 2023-08-25T04:44:07.471 INFO:teuthology.orchestra.run.smithi016.stdout: File: /home/ubuntu/cephtest/mnt.2 2023-08-25T04:44:07.471 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-08-25T04:44:07.471 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 30h/48d Inode: 1 Links: 3 2023-08-25T04:44:07.471 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:44:07.472 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:cephfs_t:s0 2023-08-25T04:44:07.472 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-08-25T04:44:07.472 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-08-25 04:44:07.402994056 +0000 2023-08-25T04:44:07.472 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-08-25 04:44:07.402994056 +0000 2023-08-25T04:44:07.472 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2023-08-25 04:43:42.871743872 +0000 2023-08-25T04:44:07.472 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.2 2023-08-25T04:44:07.473 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.2 && sudo install -d -m 0755 --owner=ubuntu -- client.2 2023-08-25T04:44:07.547 DEBUG:teuthology.orchestra.run.smithi117:> stat -- /home/ubuntu/cephtest/mnt.1 2023-08-25T04:44:07.565 INFO:teuthology.orchestra.run.smithi117.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-08-25T04:44:07.566 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 2 Blocks: 0 IO Block: 65536 directory 2023-08-25T04:44:07.566 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 2fh/47d Inode: 1 Links: 4 2023-08-25T04:44:07.566 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:44:07.567 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:cephfs_t:s0 2023-08-25T04:44:07.567 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-08-25T04:44:07.567 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-08-25 04:44:07.542991770 +0000 2023-08-25T04:44:07.567 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-08-25 04:44:07.542991770 +0000 2023-08-25T04:44:07.568 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2023-08-25 04:43:42.871743872 +0000 2023-08-25T04:44:07.568 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-08-25T04:44:07.569 DEBUG:teuthology.orchestra.run.smithi117:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-08-25T04:44:07.635 DEBUG:teuthology.orchestra.run.smithi117:> stat -- /home/ubuntu/cephtest/mnt.3 2023-08-25T04:44:07.693 INFO:teuthology.orchestra.run.smithi117.stdout: File: /home/ubuntu/cephtest/mnt.3 2023-08-25T04:44:07.693 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 3 Blocks: 0 IO Block: 65536 directory 2023-08-25T04:44:07.694 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 30h/48d Inode: 1 Links: 5 2023-08-25T04:44:07.694 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:44:07.694 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:cephfs_t:s0 2023-08-25T04:44:07.694 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-08-25T04:44:07.694 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-08-25 04:44:07.630510655 +0000 2023-08-25T04:44:07.695 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-08-25 04:44:07.630510655 +0000 2023-08-25T04:44:07.695 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2023-08-25 04:43:42.871743872 +0000 2023-08-25T04:44:07.696 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.3 2023-08-25T04:44:07.697 DEBUG:teuthology.orchestra.run.smithi117:> cd -- /home/ubuntu/cephtest/mnt.3 && sudo install -d -m 0755 --owner=ubuntu -- client.3 2023-08-25T04:44:07.763 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:44:07.764 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.2 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.2 && cd /home/ubuntu/cephtest/clone.client.2 && git checkout ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:44:07.764 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:44:07.765 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf /home/ubuntu/cephtest/clone.client.3 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.3 && cd /home/ubuntu/cephtest/clone.client.3 && git checkout ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:44:07.787 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-08-25T04:44:07.787 INFO:tasks.workunit.client.2.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.2'... 2023-08-25T04:44:07.821 INFO:tasks.workunit.client.1.smithi117.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-08-25T04:44:07.821 INFO:tasks.workunit.client.3.smithi117.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.3'... 2023-08-25T04:44:13.684 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:44:13.687 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:44:43.752 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:44:43.754 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:45:13.830 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:45:13.881 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:45:21.964 INFO:tasks.workunit.client.1.smithi117.stderr:Updating files: 87% (10446/11928) Updating files: 88% (10497/11928) Updating files: 89% (10616/11928) Updating files: 90% (10736/11928) Updating files: 91% (10855/11928) Updating files: 92% (10974/11928) Updating files: 93% (11094/11928) Updating files: 94% (11213/11928) Updating files: 95% (11332/11928) Updating files: 96% (11451/11928) Updating files: 97% (11571/11928) Updating files: 98% (11690/11928) Updating files: 99% (11809/11928) Updating files: 100% (11928/11928) Updating files: 100% (11928/11928), done. 2023-08-25T04:45:22.274 INFO:tasks.workunit.client.3.smithi117.stderr:Updating files: 99% (11900/11928) Updating files: 100% (11928/11928) Updating files: 100% (11928/11928), done. 2023-08-25T04:45:22.562 INFO:tasks.workunit.client.1.smithi117.stderr:Note: switching to 'ba6b39e4f4f77fb95c747099b53db0467d435f56'. 2023-08-25T04:45:22.563 INFO:tasks.workunit.client.1.smithi117.stderr: 2023-08-25T04:45:22.563 INFO:tasks.workunit.client.1.smithi117.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-08-25T04:45:22.563 INFO:tasks.workunit.client.1.smithi117.stderr:changes and commit them, and you can discard any commits you make in this 2023-08-25T04:45:22.563 INFO:tasks.workunit.client.1.smithi117.stderr:state without impacting any branches by switching back to a branch. 2023-08-25T04:45:22.563 INFO:tasks.workunit.client.1.smithi117.stderr: 2023-08-25T04:45:22.563 INFO:tasks.workunit.client.1.smithi117.stderr:If you want to create a new branch to retain commits you create, you may 2023-08-25T04:45:22.564 INFO:tasks.workunit.client.1.smithi117.stderr:do so (now or later) by using -c with the switch command. Example: 2023-08-25T04:45:22.564 INFO:tasks.workunit.client.1.smithi117.stderr: 2023-08-25T04:45:22.564 INFO:tasks.workunit.client.1.smithi117.stderr: git switch -c 2023-08-25T04:45:22.564 INFO:tasks.workunit.client.1.smithi117.stderr: 2023-08-25T04:45:22.564 INFO:tasks.workunit.client.1.smithi117.stderr:Or undo this operation with: 2023-08-25T04:45:22.564 INFO:tasks.workunit.client.1.smithi117.stderr: 2023-08-25T04:45:22.564 INFO:tasks.workunit.client.1.smithi117.stderr: git switch - 2023-08-25T04:45:22.565 INFO:tasks.workunit.client.1.smithi117.stderr: 2023-08-25T04:45:22.565 INFO:tasks.workunit.client.1.smithi117.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-08-25T04:45:22.565 INFO:tasks.workunit.client.1.smithi117.stderr: 2023-08-25T04:45:22.565 INFO:tasks.workunit.client.1.smithi117.stderr:HEAD is now at ba6b39e4f4f Merge remote-tracking branch 'rishabh/better-errmsg-for-perm' into wip-rishabh-2023aug3-b5 2023-08-25T04:45:22.566 DEBUG:teuthology.orchestra.run.smithi117:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-08-25T04:45:22.592 INFO:tasks.workunit.client.3.smithi117.stderr:Note: switching to 'ba6b39e4f4f77fb95c747099b53db0467d435f56'. 2023-08-25T04:45:22.593 INFO:tasks.workunit.client.3.smithi117.stderr: 2023-08-25T04:45:22.593 INFO:tasks.workunit.client.3.smithi117.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-08-25T04:45:22.593 INFO:tasks.workunit.client.3.smithi117.stderr:changes and commit them, and you can discard any commits you make in this 2023-08-25T04:45:22.593 INFO:tasks.workunit.client.3.smithi117.stderr:state without impacting any branches by switching back to a branch. 2023-08-25T04:45:22.593 INFO:tasks.workunit.client.3.smithi117.stderr: 2023-08-25T04:45:22.593 INFO:tasks.workunit.client.3.smithi117.stderr:If you want to create a new branch to retain commits you create, you may 2023-08-25T04:45:22.593 INFO:tasks.workunit.client.3.smithi117.stderr:do so (now or later) by using -c with the switch command. Example: 2023-08-25T04:45:22.594 INFO:tasks.workunit.client.3.smithi117.stderr: 2023-08-25T04:45:22.594 INFO:tasks.workunit.client.3.smithi117.stderr: git switch -c 2023-08-25T04:45:22.594 INFO:tasks.workunit.client.3.smithi117.stderr: 2023-08-25T04:45:22.594 INFO:tasks.workunit.client.3.smithi117.stderr:Or undo this operation with: 2023-08-25T04:45:22.594 INFO:tasks.workunit.client.3.smithi117.stderr: 2023-08-25T04:45:22.594 INFO:tasks.workunit.client.3.smithi117.stderr: git switch - 2023-08-25T04:45:22.594 INFO:tasks.workunit.client.3.smithi117.stderr: 2023-08-25T04:45:22.595 INFO:tasks.workunit.client.3.smithi117.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-08-25T04:45:22.595 INFO:tasks.workunit.client.3.smithi117.stderr: 2023-08-25T04:45:22.595 INFO:tasks.workunit.client.3.smithi117.stderr:HEAD is now at ba6b39e4f4f Merge remote-tracking branch 'rishabh/better-errmsg-for-perm' into wip-rishabh-2023aug3-b5 2023-08-25T04:45:22.596 DEBUG:teuthology.orchestra.run.smithi117:> cd -- /home/ubuntu/cephtest/clone.client.3/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.3 2023-08-25T04:45:22.606 INFO:tasks.workunit.client.1.smithi117.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-08-25T04:45:22.608 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-08-25T04:45:22.608 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-08-25T04:45:22.622 INFO:tasks.workunit.client.3.smithi117.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-08-25T04:45:22.624 INFO:tasks.workunit.client.3.smithi117.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2023-08-25T04:45:22.624 INFO:tasks.workunit.client.3.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-08-25T04:45:23.150 INFO:tasks.workunit.client.3.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-08-25T04:45:23.151 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-08-25T04:45:23.201 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-08-25T04:45:23.202 INFO:tasks.workunit.client.3.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-08-25T04:45:23.239 INFO:tasks.workunit.client.3.smithi117.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2023-08-25T04:45:23.240 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-08-25T04:45:23.241 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-08-25T04:45:23.241 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-08-25T04:45:23.241 INFO:tasks.workunit.client.3.smithi117.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2023-08-25T04:45:23.242 INFO:tasks.workunit.client.3.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-08-25T04:45:23.277 INFO:tasks.workunit.client.3.smithi117.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2023-08-25T04:45:23.278 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-08-25T04:45:23.281 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:45:23.282 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/home/ubuntu/cephtest/workunits.list.client.3 of=/dev/stdout 2023-08-25T04:45:23.282 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:45:23.282 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-08-25T04:45:23.339 INFO:tasks.workunit:Running workunits matching fs/quota on client.3... 2023-08-25T04:45:23.340 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-08-25T04:45:23.341 DEBUG:teuthology.orchestra.run.smithi117:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ba6b39e4f4f77fb95c747099b53db0467d435f56 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh 2023-08-25T04:45:23.343 INFO:tasks.workunit:Running workunits matching fs/quota on client.1... 2023-08-25T04:45:23.344 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-08-25T04:45:23.344 DEBUG:teuthology.orchestra.run.smithi117:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ba6b39e4f4f77fb95c747099b53db0467d435f56 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/quota/quota.sh 2023-08-25T04:45:23.401 INFO:tasks.workunit.client.3.smithi117.stderr:+ mkdir quota-test 2023-08-25T04:45:23.402 INFO:tasks.workunit.client.1.smithi117.stderr:+ mkdir quota-test 2023-08-25T04:45:23.403 INFO:tasks.workunit.client.3.smithi117.stderr:+ cd quota-test 2023-08-25T04:45:23.403 INFO:tasks.workunit.client.3.smithi117.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-08-25T04:45:23.403 INFO:tasks.workunit.client.1.smithi117.stderr:+ cd quota-test 2023-08-25T04:45:23.404 INFO:tasks.workunit.client.1.smithi117.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-08-25T04:45:23.502 INFO:tasks.workunit.client.3.smithi117.stderr:+ expect_false write_file big 1000 2023-08-25T04:45:23.502 INFO:tasks.workunit.client.3.smithi117.stderr:+ set -x 2023-08-25T04:45:23.502 INFO:tasks.workunit.client.3.smithi117.stderr:+ write_file big 1000 2023-08-25T04:45:23.503 INFO:tasks.workunit.client.3.smithi117.stderr:+ set +x 2023-08-25T04:45:23.504 INFO:tasks.workunit.client.1.smithi117.stderr:+ expect_false write_file big 1000 2023-08-25T04:45:23.504 INFO:tasks.workunit.client.1.smithi117.stderr:+ set -x 2023-08-25T04:45:23.504 INFO:tasks.workunit.client.1.smithi117.stderr:+ write_file big 1000 2023-08-25T04:45:23.505 INFO:tasks.workunit.client.1.smithi117.stderr:+ set +x 2023-08-25T04:45:25.064 INFO:tasks.workunit.client.2.smithi016.stderr:Updating files: 90% (10780/11928) Updating files: 91% (10855/11928) Updating files: 92% (10974/11928) Updating files: 93% (11094/11928) Updating files: 94% (11213/11928) Updating files: 95% (11332/11928) Updating files: 96% (11451/11928) Updating files: 97% (11571/11928) Updating files: 98% (11690/11928) Updating files: 99% (11809/11928) Updating files: 100% (11928/11928) Updating files: 100% (11928/11928), done. 2023-08-25T04:45:25.064 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 90% (10783/11928) Updating files: 91% (10855/11928) Updating files: 92% (10974/11928) Updating files: 93% (11094/11928) Updating files: 94% (11213/11928) Updating files: 95% (11332/11928) Updating files: 96% (11451/11928) Updating files: 97% (11571/11928) Updating files: 98% (11690/11928) Updating files: 99% (11809/11928) Updating files: 100% (11928/11928) Updating files: 100% (11928/11928), done. 2023-08-25T04:45:25.214 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to 'ba6b39e4f4f77fb95c747099b53db0467d435f56'. 2023-08-25T04:45:25.215 INFO:tasks.workunit.client.0.smithi016.stderr: 2023-08-25T04:45:25.215 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-08-25T04:45:25.215 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2023-08-25T04:45:25.215 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2023-08-25T04:45:25.215 INFO:tasks.workunit.client.0.smithi016.stderr: 2023-08-25T04:45:25.215 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2023-08-25T04:45:25.215 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2023-08-25T04:45:25.216 INFO:tasks.workunit.client.0.smithi016.stderr: 2023-08-25T04:45:25.216 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2023-08-25T04:45:25.216 INFO:tasks.workunit.client.0.smithi016.stderr: 2023-08-25T04:45:25.216 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2023-08-25T04:45:25.216 INFO:tasks.workunit.client.0.smithi016.stderr: 2023-08-25T04:45:25.216 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2023-08-25T04:45:25.216 INFO:tasks.workunit.client.0.smithi016.stderr: 2023-08-25T04:45:25.217 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-08-25T04:45:25.217 INFO:tasks.workunit.client.0.smithi016.stderr: 2023-08-25T04:45:25.217 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at ba6b39e4f4f Merge remote-tracking branch 'rishabh/better-errmsg-for-perm' into wip-rishabh-2023aug3-b5 2023-08-25T04:45:25.218 INFO:tasks.workunit.client.2.smithi016.stderr:Note: switching to 'ba6b39e4f4f77fb95c747099b53db0467d435f56'. 2023-08-25T04:45:25.218 INFO:tasks.workunit.client.2.smithi016.stderr: 2023-08-25T04:45:25.219 INFO:tasks.workunit.client.2.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-08-25T04:45:25.219 INFO:tasks.workunit.client.2.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2023-08-25T04:45:25.219 INFO:tasks.workunit.client.2.smithi016.stderr:state without impacting any branches by switching back to a branch. 2023-08-25T04:45:25.219 INFO:tasks.workunit.client.2.smithi016.stderr: 2023-08-25T04:45:25.219 INFO:tasks.workunit.client.2.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2023-08-25T04:45:25.219 INFO:tasks.workunit.client.2.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2023-08-25T04:45:25.219 INFO:tasks.workunit.client.2.smithi016.stderr: 2023-08-25T04:45:25.220 INFO:tasks.workunit.client.2.smithi016.stderr: git switch -c 2023-08-25T04:45:25.220 INFO:tasks.workunit.client.2.smithi016.stderr: 2023-08-25T04:45:25.220 INFO:tasks.workunit.client.2.smithi016.stderr:Or undo this operation with: 2023-08-25T04:45:25.220 INFO:tasks.workunit.client.2.smithi016.stderr: 2023-08-25T04:45:25.220 INFO:tasks.workunit.client.2.smithi016.stderr: git switch - 2023-08-25T04:45:25.220 INFO:tasks.workunit.client.2.smithi016.stderr: 2023-08-25T04:45:25.220 INFO:tasks.workunit.client.2.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-08-25T04:45:25.220 INFO:tasks.workunit.client.2.smithi016.stderr: 2023-08-25T04:45:25.221 INFO:tasks.workunit.client.2.smithi016.stderr:HEAD is now at ba6b39e4f4f Merge remote-tracking branch 'rishabh/better-errmsg-for-perm' into wip-rishabh-2023aug3-b5 2023-08-25T04:45:25.221 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.2/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.2 2023-08-25T04:45:25.222 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-08-25T04:45:25.287 INFO:tasks.workunit.client.2.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-08-25T04:45:25.287 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-08-25T04:45:25.289 INFO:tasks.workunit.client.2.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/direct_io' 2023-08-25T04:45:25.289 INFO:tasks.workunit.client.2.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-08-25T04:45:25.289 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-08-25T04:45:25.289 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-08-25T04:45:25.876 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-08-25T04:45:25.877 INFO:tasks.workunit.client.2.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-08-25T04:45:25.932 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-08-25T04:45:25.932 INFO:tasks.workunit.client.2.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-08-25T04:45:25.972 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-08-25T04:45:25.973 INFO:tasks.workunit.client.2.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/direct_io' 2023-08-25T04:45:25.974 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-08-25T04:45:25.974 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-08-25T04:45:25.974 INFO:tasks.workunit.client.2.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/fs' 2023-08-25T04:45:25.975 INFO:tasks.workunit.client.2.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-08-25T04:45:26.013 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-08-25T04:45:26.013 INFO:tasks.workunit.client.2.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/fs' 2023-08-25T04:45:26.016 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:45:26.017 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.2 of=/dev/stdout 2023-08-25T04:45:26.017 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:45:26.017 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-08-25T04:45:26.074 INFO:tasks.workunit:Running workunits matching fs/quota on client.2... 2023-08-25T04:45:26.075 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-08-25T04:45:26.076 DEBUG:teuthology.orchestra.run.smithi016:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && cd -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ba6b39e4f4f77fb95c747099b53db0467d435f56 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="2" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.2 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.2 CEPH_MNT=/home/ubuntu/cephtest/mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.2/qa/workunits/fs/quota/quota.sh 2023-08-25T04:45:26.077 INFO:tasks.workunit:Running workunits matching fs/quota on client.0... 2023-08-25T04:45:26.078 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-08-25T04:45:26.078 DEBUG:teuthology.orchestra.run.smithi016:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ba6b39e4f4f77fb95c747099b53db0467d435f56 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/quota/quota.sh 2023-08-25T04:45:26.137 INFO:tasks.workunit.client.2.smithi016.stderr:+ mkdir quota-test 2023-08-25T04:45:26.138 INFO:tasks.workunit.client.0.smithi016.stderr:+ mkdir quota-test 2023-08-25T04:45:26.139 INFO:tasks.workunit.client.2.smithi016.stderr:+ cd quota-test 2023-08-25T04:45:26.139 INFO:tasks.workunit.client.2.smithi016.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-08-25T04:45:26.140 INFO:tasks.workunit.client.0.smithi016.stderr:+ cd quota-test 2023-08-25T04:45:26.140 INFO:tasks.workunit.client.0.smithi016.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-08-25T04:45:26.157 INFO:tasks.workunit.client.0.smithi016.stderr:+ expect_false write_file big 1000 2023-08-25T04:45:26.157 INFO:tasks.workunit.client.0.smithi016.stderr:+ set -x 2023-08-25T04:45:26.157 INFO:tasks.workunit.client.0.smithi016.stderr:+ write_file big 1000 2023-08-25T04:45:26.157 INFO:tasks.workunit.client.0.smithi016.stderr:+ set +x 2023-08-25T04:45:26.158 INFO:tasks.workunit.client.2.smithi016.stderr:+ expect_false write_file big 1000 2023-08-25T04:45:26.158 INFO:tasks.workunit.client.2.smithi016.stderr:+ set -x 2023-08-25T04:45:26.158 INFO:tasks.workunit.client.2.smithi016.stderr:+ write_file big 1000 2023-08-25T04:45:26.158 INFO:tasks.workunit.client.2.smithi016.stderr:+ set +x 2023-08-25T04:45:29.040 INFO:tasks.workunit.client.3.smithi117.stdout:Try to write 111149056 2023-08-25T04:45:29.040 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 1 2023-08-25T04:45:29.040 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 0 2023-08-25T04:45:29.041 INFO:tasks.workunit.client.3.smithi117.stderr:+ expect_false write_file second 10 2023-08-25T04:45:29.041 INFO:tasks.workunit.client.3.smithi117.stderr:+ set -x 2023-08-25T04:45:29.041 INFO:tasks.workunit.client.3.smithi117.stderr:+ write_file second 10 2023-08-25T04:45:29.041 INFO:tasks.workunit.client.3.smithi117.stderr:+ set +x 2023-08-25T04:45:29.043 INFO:tasks.workunit.client.3.smithi117.stdout:Try to write 1048576 2023-08-25T04:45:29.043 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 1 2023-08-25T04:45:29.043 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 0 2023-08-25T04:45:29.043 INFO:tasks.workunit.client.3.smithi117.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-08-25T04:45:29.045 INFO:tasks.workunit.client.1.smithi117.stdout:Try to write 111149056 2023-08-25T04:45:29.046 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 1 2023-08-25T04:45:29.046 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 0 2023-08-25T04:45:29.046 INFO:tasks.workunit.client.1.smithi117.stderr:+ expect_false write_file second 10 2023-08-25T04:45:29.046 INFO:tasks.workunit.client.1.smithi117.stderr:+ set -x 2023-08-25T04:45:29.046 INFO:tasks.workunit.client.1.smithi117.stderr:+ write_file second 10 2023-08-25T04:45:29.046 INFO:tasks.workunit.client.1.smithi117.stderr:+ set +x 2023-08-25T04:45:29.048 INFO:tasks.workunit.client.1.smithi117.stdout:Try to write 1048576 2023-08-25T04:45:29.049 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 1 2023-08-25T04:45:29.049 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 0 2023-08-25T04:45:29.049 INFO:tasks.workunit.client.1.smithi117.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-08-25T04:45:29.147 INFO:tasks.workunit.client.3.smithi117.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-08-25T04:45:29.147 INFO:tasks.workunit.client.1.smithi117.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-08-25T04:45:29.158 INFO:tasks.workunit.client.3.smithi117.stderr:10+0 records in 2023-08-25T04:45:29.158 INFO:tasks.workunit.client.3.smithi117.stderr:10+0 records out 2023-08-25T04:45:29.158 INFO:tasks.workunit.client.3.smithi117.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00972743 s, 1.1 GB/s 2023-08-25T04:45:29.159 INFO:tasks.workunit.client.3.smithi117.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-08-25T04:45:29.159 INFO:tasks.workunit.client.1.smithi117.stderr:10+0 records in 2023-08-25T04:45:29.159 INFO:tasks.workunit.client.1.smithi117.stderr:10+0 records out 2023-08-25T04:45:29.160 INFO:tasks.workunit.client.1.smithi117.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0096826 s, 1.1 GB/s 2023-08-25T04:45:29.160 INFO:tasks.workunit.client.1.smithi117.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-08-25T04:45:29.213 INFO:tasks.workunit.client.3.smithi117.stderr:100+0 records in 2023-08-25T04:45:29.213 INFO:tasks.workunit.client.3.smithi117.stderr:100+0 records out 2023-08-25T04:45:29.213 INFO:tasks.workunit.client.3.smithi117.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.052463 s, 2.0 GB/s 2023-08-25T04:45:29.214 INFO:tasks.workunit.client.3.smithi117.stderr:+ rm -rf big big2 second third 2023-08-25T04:45:29.220 INFO:tasks.workunit.client.1.smithi117.stderr:100+0 records in 2023-08-25T04:45:29.220 INFO:tasks.workunit.client.1.smithi117.stderr:100+0 records out 2023-08-25T04:45:29.220 INFO:tasks.workunit.client.1.smithi117.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.059169 s, 1.8 GB/s 2023-08-25T04:45:29.222 INFO:tasks.workunit.client.1.smithi117.stderr:+ rm -rf big big2 second third 2023-08-25T04:45:29.223 INFO:tasks.workunit.client.3.smithi117.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-08-25T04:45:29.233 INFO:tasks.workunit.client.1.smithi117.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-08-25T04:45:29.234 INFO:tasks.workunit.client.3.smithi117.stderr:+ mkdir ok 2023-08-25T04:45:29.236 INFO:tasks.workunit.client.3.smithi117.stderr:+ touch ok/1 2023-08-25T04:45:29.238 INFO:tasks.workunit.client.3.smithi117.stderr:+ touch ok/2 2023-08-25T04:45:29.240 INFO:tasks.workunit.client.3.smithi117.stderr:+ touch 3 2023-08-25T04:45:29.240 INFO:tasks.workunit.client.1.smithi117.stderr:+ mkdir ok 2023-08-25T04:45:29.242 INFO:tasks.workunit.client.3.smithi117.stderr:+ expect_false touch shouldbefail 2023-08-25T04:45:29.242 INFO:tasks.workunit.client.3.smithi117.stderr:+ set -x 2023-08-25T04:45:29.242 INFO:tasks.workunit.client.3.smithi117.stderr:+ touch shouldbefail 2023-08-25T04:45:29.243 INFO:tasks.workunit.client.3.smithi117.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-08-25T04:45:29.243 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 0 2023-08-25T04:45:29.243 INFO:tasks.workunit.client.3.smithi117.stderr:+ expect_false touch ok/shouldbefail 2023-08-25T04:45:29.243 INFO:tasks.workunit.client.3.smithi117.stderr:+ set -x 2023-08-25T04:45:29.243 INFO:tasks.workunit.client.3.smithi117.stderr:+ touch ok/shouldbefail 2023-08-25T04:45:29.244 INFO:tasks.workunit.client.1.smithi117.stderr:+ touch ok/1 2023-08-25T04:45:29.244 INFO:tasks.workunit.client.3.smithi117.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-08-25T04:45:29.244 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 0 2023-08-25T04:45:29.245 INFO:tasks.workunit.client.3.smithi117.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-08-25T04:45:29.245 INFO:tasks.workunit.client.1.smithi117.stderr:+ touch ok/2 2023-08-25T04:45:29.246 INFO:tasks.workunit.client.1.smithi117.stderr:+ touch 3 2023-08-25T04:45:29.247 INFO:tasks.workunit.client.1.smithi117.stderr:+ expect_false touch shouldbefail 2023-08-25T04:45:29.247 INFO:tasks.workunit.client.1.smithi117.stderr:+ set -x 2023-08-25T04:45:29.248 INFO:tasks.workunit.client.1.smithi117.stderr:+ touch shouldbefail 2023-08-25T04:45:29.248 INFO:tasks.workunit.client.1.smithi117.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-08-25T04:45:29.249 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 0 2023-08-25T04:45:29.249 INFO:tasks.workunit.client.1.smithi117.stderr:+ expect_false touch ok/shouldbefail 2023-08-25T04:45:29.249 INFO:tasks.workunit.client.1.smithi117.stderr:+ set -x 2023-08-25T04:45:29.249 INFO:tasks.workunit.client.1.smithi117.stderr:+ touch ok/shouldbefail 2023-08-25T04:45:29.249 INFO:tasks.workunit.client.1.smithi117.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-08-25T04:45:29.249 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 0 2023-08-25T04:45:29.250 INFO:tasks.workunit.client.1.smithi117.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-08-25T04:45:29.254 INFO:tasks.workunit.client.3.smithi117.stderr:+ touch shouldbecreated 2023-08-25T04:45:29.256 INFO:tasks.workunit.client.3.smithi117.stderr:+ touch shouldbecreated2 2023-08-25T04:45:29.256 INFO:tasks.workunit.client.1.smithi117.stderr:+ touch shouldbecreated 2023-08-25T04:45:29.258 INFO:tasks.workunit.client.1.smithi117.stderr:+ touch shouldbecreated2 2023-08-25T04:45:29.263 INFO:tasks.workunit.client.3.smithi117.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-08-25T04:45:29.265 INFO:tasks.workunit.client.1.smithi117.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-08-25T04:45:29.282 INFO:tasks.workunit.client.3.smithi117.stderr:+ mkdir bytes bytes/files 2023-08-25T04:45:29.287 INFO:tasks.workunit.client.3.smithi117.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-08-25T04:45:29.289 INFO:tasks.workunit.client.1.smithi117.stderr:+ mkdir bytes bytes/files 2023-08-25T04:45:29.291 INFO:tasks.workunit.client.1.smithi117.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-08-25T04:45:29.302 INFO:tasks.workunit.client.3.smithi117.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-08-25T04:45:29.302 INFO:tasks.workunit.client.1.smithi117.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-08-25T04:45:29.308 INFO:tasks.workunit.client.3.smithi117.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-08-25T04:45:29.308 INFO:tasks.workunit.client.1.smithi117.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-08-25T04:45:29.311 INFO:tasks.workunit.client.3.smithi117.stderr:4+0 records in 2023-08-25T04:45:29.311 INFO:tasks.workunit.client.3.smithi117.stderr:4+0 records out 2023-08-25T04:45:29.311 INFO:tasks.workunit.client.3.smithi117.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00155874 s, 2.7 GB/s 2023-08-25T04:45:29.311 INFO:tasks.workunit.client.3.smithi117.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-08-25T04:45:29.312 INFO:tasks.workunit.client.1.smithi117.stderr:4+0 records in 2023-08-25T04:45:29.312 INFO:tasks.workunit.client.1.smithi117.stderr:4+0 records out 2023-08-25T04:45:29.312 INFO:tasks.workunit.client.1.smithi117.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00168701 s, 2.5 GB/s 2023-08-25T04:45:29.312 INFO:tasks.workunit.client.1.smithi117.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-08-25T04:45:29.315 INFO:tasks.workunit.client.3.smithi117.stderr:4+0 records in 2023-08-25T04:45:29.315 INFO:tasks.workunit.client.3.smithi117.stderr:4+0 records out 2023-08-25T04:45:29.315 INFO:tasks.workunit.client.3.smithi117.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.0016277 s, 2.6 GB/s 2023-08-25T04:45:29.316 INFO:tasks.workunit.client.3.smithi117.stderr:+ expect_false write_file bytes/files/3 1000 2023-08-25T04:45:29.316 INFO:tasks.workunit.client.3.smithi117.stderr:+ set -x 2023-08-25T04:45:29.316 INFO:tasks.workunit.client.3.smithi117.stderr:+ write_file bytes/files/3 1000 2023-08-25T04:45:29.316 INFO:tasks.workunit.client.3.smithi117.stderr:+ set +x 2023-08-25T04:45:29.317 INFO:tasks.workunit.client.1.smithi117.stderr:4+0 records in 2023-08-25T04:45:29.317 INFO:tasks.workunit.client.1.smithi117.stderr:4+0 records out 2023-08-25T04:45:29.317 INFO:tasks.workunit.client.1.smithi117.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00154992 s, 2.7 GB/s 2023-08-25T04:45:29.317 INFO:tasks.workunit.client.1.smithi117.stderr:+ expect_false write_file bytes/files/3 1000 2023-08-25T04:45:29.317 INFO:tasks.workunit.client.1.smithi117.stderr:+ set -x 2023-08-25T04:45:29.317 INFO:tasks.workunit.client.1.smithi117.stderr:+ write_file bytes/files/3 1000 2023-08-25T04:45:29.317 INFO:tasks.workunit.client.1.smithi117.stderr:+ set +x 2023-08-25T04:45:30.578 INFO:tasks.workunit.client.3.smithi117.stdout:Try to write 26214400 2023-08-25T04:45:30.578 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 1 2023-08-25T04:45:30.579 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 0 2023-08-25T04:45:30.579 INFO:tasks.workunit.client.1.smithi117.stdout:Try to write 26214400 2023-08-25T04:45:30.579 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 1 2023-08-25T04:45:30.580 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 0 2023-08-25T04:45:30.580 INFO:tasks.workunit.client.3.smithi117.stderr:+ expect_false write_file bytes/files/4 1000 2023-08-25T04:45:30.580 INFO:tasks.workunit.client.3.smithi117.stderr:+ set -x 2023-08-25T04:45:30.580 INFO:tasks.workunit.client.1.smithi117.stderr:+ expect_false write_file bytes/files/4 1000 2023-08-25T04:45:30.581 INFO:tasks.workunit.client.1.smithi117.stderr:+ set -x 2023-08-25T04:45:30.581 INFO:tasks.workunit.client.1.smithi117.stderr:+ write_file bytes/files/4 1000 2023-08-25T04:45:30.581 INFO:tasks.workunit.client.1.smithi117.stderr:+ set +x 2023-08-25T04:45:30.581 INFO:tasks.workunit.client.3.smithi117.stderr:+ write_file bytes/files/4 1000 2023-08-25T04:45:30.581 INFO:tasks.workunit.client.3.smithi117.stderr:+ set +x 2023-08-25T04:45:30.582 INFO:tasks.workunit.client.1.smithi117.stdout:Try to write 1048576 2023-08-25T04:45:30.582 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 1 2023-08-25T04:45:30.582 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 0 2023-08-25T04:45:30.582 INFO:tasks.workunit.client.1.smithi117.stderr:+ expect_false write_file bytes/files/5 1000 2023-08-25T04:45:30.583 INFO:tasks.workunit.client.1.smithi117.stderr:+ set -x 2023-08-25T04:45:30.583 INFO:tasks.workunit.client.1.smithi117.stderr:+ write_file bytes/files/5 1000 2023-08-25T04:45:30.583 INFO:tasks.workunit.client.1.smithi117.stderr:+ set +x 2023-08-25T04:45:30.583 INFO:tasks.workunit.client.3.smithi117.stdout:Try to write 1048576 2023-08-25T04:45:30.584 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 1 2023-08-25T04:45:30.584 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 0 2023-08-25T04:45:30.584 INFO:tasks.workunit.client.3.smithi117.stderr:+ expect_false write_file bytes/files/5 1000 2023-08-25T04:45:30.584 INFO:tasks.workunit.client.3.smithi117.stderr:+ set -x 2023-08-25T04:45:30.585 INFO:tasks.workunit.client.3.smithi117.stderr:+ write_file bytes/files/5 1000 2023-08-25T04:45:30.585 INFO:tasks.workunit.client.3.smithi117.stderr:+ set +x 2023-08-25T04:45:30.585 INFO:tasks.workunit.client.1.smithi117.stdout:Try to write 1048576 2023-08-25T04:45:30.586 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 1 2023-08-25T04:45:30.586 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 0 2023-08-25T04:45:30.586 INFO:tasks.workunit.client.1.smithi117.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-08-25T04:45:30.586 INFO:tasks.workunit.client.3.smithi117.stdout:Try to write 1048576 2023-08-25T04:45:30.587 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 1 2023-08-25T04:45:30.587 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 0 2023-08-25T04:45:30.587 INFO:tasks.workunit.client.3.smithi117.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-08-25T04:45:30.587 INFO:tasks.workunit.client.1.smithi117.stdout:bytes/files/1 4194304 2023-08-25T04:45:30.588 INFO:tasks.workunit.client.1.smithi117.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-08-25T04:45:30.588 INFO:tasks.workunit.client.3.smithi117.stdout:bytes/files/1 4194304 2023-08-25T04:45:30.588 INFO:tasks.workunit.client.3.smithi117.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-08-25T04:45:30.589 INFO:tasks.workunit.client.1.smithi117.stdout:bytes/files/2 4194304 2023-08-25T04:45:30.589 INFO:tasks.workunit.client.1.smithi117.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-08-25T04:45:30.589 INFO:tasks.workunit.client.3.smithi117.stdout:bytes/files/2 4194304 2023-08-25T04:45:30.590 INFO:tasks.workunit.client.3.smithi117.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-08-25T04:45:30.590 INFO:tasks.workunit.client.1.smithi117.stdout:bytes/files/3 25165824 2023-08-25T04:45:30.590 INFO:tasks.workunit.client.1.smithi117.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-08-25T04:45:30.591 INFO:tasks.workunit.client.3.smithi117.stdout:bytes/files/3 25165824 2023-08-25T04:45:30.591 INFO:tasks.workunit.client.3.smithi117.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-08-25T04:45:30.591 INFO:tasks.workunit.client.1.smithi117.stdout:bytes/files/4 0 2023-08-25T04:45:30.592 INFO:tasks.workunit.client.1.smithi117.stderr:+ expect_false stat bytes/files/5 2023-08-25T04:45:30.592 INFO:tasks.workunit.client.1.smithi117.stderr:+ set -x 2023-08-25T04:45:30.592 INFO:tasks.workunit.client.1.smithi117.stderr:+ stat bytes/files/5 2023-08-25T04:45:30.592 INFO:tasks.workunit.client.3.smithi117.stdout:bytes/files/4 0 2023-08-25T04:45:30.593 INFO:tasks.workunit.client.3.smithi117.stderr:+ expect_false stat bytes/files/5 2023-08-25T04:45:30.593 INFO:tasks.workunit.client.3.smithi117.stderr:+ set -x 2023-08-25T04:45:30.593 INFO:tasks.workunit.client.3.smithi117.stderr:+ stat bytes/files/5 2023-08-25T04:45:30.593 INFO:tasks.workunit.client.1.smithi117.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-08-25T04:45:30.594 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 0 2023-08-25T04:45:30.594 INFO:tasks.workunit.client.3.smithi117.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-08-25T04:45:30.594 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 0 2023-08-25T04:45:30.594 INFO:tasks.workunit.client.1.smithi117.stderr:+ rm -rf bytes 2023-08-25T04:45:30.595 INFO:tasks.workunit.client.3.smithi117.stderr:+ rm -rf bytes 2023-08-25T04:45:30.629 INFO:tasks.workunit.client.1.smithi117.stderr:+ mkdir files limit 2023-08-25T04:45:30.631 INFO:tasks.workunit.client.3.smithi117.stderr:+ mkdir files limit 2023-08-25T04:45:30.632 INFO:tasks.workunit.client.1.smithi117.stderr:+ truncate files/file -s 10G 2023-08-25T04:45:30.634 INFO:tasks.workunit.client.3.smithi117.stderr:+ truncate files/file -s 10G 2023-08-25T04:45:30.674 INFO:tasks.workunit.client.3.smithi117.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-08-25T04:45:30.675 INFO:tasks.workunit.client.1.smithi117.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-08-25T04:45:30.684 INFO:tasks.workunit.client.3.smithi117.stderr:+ expect_false mv files limit/ 2023-08-25T04:45:30.684 INFO:tasks.workunit.client.3.smithi117.stderr:+ set -x 2023-08-25T04:45:30.684 INFO:tasks.workunit.client.3.smithi117.stderr:+ mv files limit/ 2023-08-25T04:45:30.685 INFO:tasks.workunit.client.1.smithi117.stderr:+ expect_false mv files limit/ 2023-08-25T04:45:30.685 INFO:tasks.workunit.client.1.smithi117.stderr:+ set -x 2023-08-25T04:45:30.685 INFO:tasks.workunit.client.1.smithi117.stderr:+ mv files limit/ 2023-08-25T04:45:30.692 INFO:tasks.workunit.client.3.smithi117.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-08-25T04:45:30.694 INFO:tasks.workunit.client.1.smithi117.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-08-25T04:45:30.701 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 0 2023-08-25T04:45:30.702 INFO:tasks.workunit.client.3.smithi117.stderr:+ rm -rf files limit 2023-08-25T04:45:30.703 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 0 2023-08-25T04:45:30.704 INFO:tasks.workunit.client.1.smithi117.stderr:+ rm -rf files limit 2023-08-25T04:45:30.736 INFO:tasks.workunit.client.3.smithi117.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-08-25T04:45:30.740 INFO:tasks.workunit.client.1.smithi117.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-08-25T04:45:30.742 INFO:tasks.workunit.client.3.smithi117.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-08-25T04:45:30.745 INFO:tasks.workunit.client.1.smithi117.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-08-25T04:45:30.755 INFO:tasks.workunit.client.3.smithi117.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-08-25T04:45:30.756 INFO:tasks.workunit.client.1.smithi117.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-08-25T04:45:30.759 INFO:tasks.workunit.client.3.smithi117.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-25T04:45:30.760 INFO:tasks.workunit.client.3.smithi117.stderr:+ set -x 2023-08-25T04:45:30.760 INFO:tasks.workunit.client.3.smithi117.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-25T04:45:30.760 INFO:tasks.workunit.client.3.smithi117.stderr:+ set +x 2023-08-25T04:45:30.761 INFO:tasks.workunit.client.1.smithi117.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-25T04:45:30.761 INFO:tasks.workunit.client.1.smithi117.stderr:+ set -x 2023-08-25T04:45:30.761 INFO:tasks.workunit.client.1.smithi117.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-25T04:45:30.761 INFO:tasks.workunit.client.1.smithi117.stderr:+ set +x 2023-08-25T04:45:31.516 INFO:tasks.workunit.client.2.smithi016.stdout:Try to write 106954752 2023-08-25T04:45:31.517 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 1 2023-08-25T04:45:31.517 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 0 2023-08-25T04:45:31.517 INFO:tasks.workunit.client.2.smithi016.stderr:+ expect_false write_file second 10 2023-08-25T04:45:31.517 INFO:tasks.workunit.client.2.smithi016.stderr:+ set -x 2023-08-25T04:45:31.518 INFO:tasks.workunit.client.2.smithi016.stderr:+ write_file second 10 2023-08-25T04:45:31.518 INFO:tasks.workunit.client.2.smithi016.stderr:+ set +x 2023-08-25T04:45:31.520 INFO:tasks.workunit.client.2.smithi016.stdout:Try to write 1048576 2023-08-25T04:45:31.521 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 1 2023-08-25T04:45:31.521 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 0 2023-08-25T04:45:31.521 INFO:tasks.workunit.client.2.smithi016.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-08-25T04:45:31.524 INFO:tasks.workunit.client.0.smithi016.stdout:Try to write 106954752 2023-08-25T04:45:31.525 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 1 2023-08-25T04:45:31.525 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 0 2023-08-25T04:45:31.525 INFO:tasks.workunit.client.0.smithi016.stderr:+ expect_false write_file second 10 2023-08-25T04:45:31.526 INFO:tasks.workunit.client.0.smithi016.stderr:+ set -x 2023-08-25T04:45:31.526 INFO:tasks.workunit.client.0.smithi016.stderr:+ write_file second 10 2023-08-25T04:45:31.526 INFO:tasks.workunit.client.0.smithi016.stderr:+ set +x 2023-08-25T04:45:31.531 INFO:tasks.workunit.client.0.smithi016.stdout:Try to write 1048576 2023-08-25T04:45:31.531 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 1 2023-08-25T04:45:31.532 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 0 2023-08-25T04:45:31.532 INFO:tasks.workunit.client.0.smithi016.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-08-25T04:45:31.627 INFO:tasks.workunit.client.2.smithi016.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-08-25T04:45:31.628 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-08-25T04:45:31.637 INFO:tasks.workunit.client.2.smithi016.stderr:10+0 records in 2023-08-25T04:45:31.637 INFO:tasks.workunit.client.2.smithi016.stderr:10+0 records out 2023-08-25T04:45:31.638 INFO:tasks.workunit.client.2.smithi016.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0081614 s, 1.3 GB/s 2023-08-25T04:45:31.638 INFO:tasks.workunit.client.2.smithi016.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-08-25T04:45:31.643 INFO:tasks.workunit.client.0.smithi016.stderr:10+0 records in 2023-08-25T04:45:31.643 INFO:tasks.workunit.client.0.smithi016.stderr:10+0 records out 2023-08-25T04:45:31.643 INFO:tasks.workunit.client.0.smithi016.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0125138 s, 838 MB/s 2023-08-25T04:45:31.644 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-08-25T04:45:31.690 INFO:tasks.workunit.client.2.smithi016.stderr:100+0 records in 2023-08-25T04:45:31.690 INFO:tasks.workunit.client.2.smithi016.stderr:100+0 records out 2023-08-25T04:45:31.690 INFO:tasks.workunit.client.2.smithi016.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0507985 s, 2.1 GB/s 2023-08-25T04:45:31.691 INFO:tasks.workunit.client.0.smithi016.stderr:100+0 records in 2023-08-25T04:45:31.691 INFO:tasks.workunit.client.0.smithi016.stderr:100+0 records out 2023-08-25T04:45:31.691 INFO:tasks.workunit.client.0.smithi016.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0453158 s, 2.3 GB/s 2023-08-25T04:45:31.692 INFO:tasks.workunit.client.2.smithi016.stderr:+ rm -rf big big2 second third 2023-08-25T04:45:31.692 INFO:tasks.workunit.client.0.smithi016.stderr:+ rm -rf big big2 second third 2023-08-25T04:45:31.699 INFO:tasks.workunit.client.2.smithi016.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-08-25T04:45:31.699 INFO:tasks.workunit.client.0.smithi016.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-08-25T04:45:31.709 INFO:tasks.workunit.client.2.smithi016.stderr:+ mkdir ok 2023-08-25T04:45:31.709 INFO:tasks.workunit.client.0.smithi016.stderr:+ mkdir ok 2023-08-25T04:45:31.711 INFO:tasks.workunit.client.2.smithi016.stderr:+ touch ok/1 2023-08-25T04:45:31.712 INFO:tasks.workunit.client.0.smithi016.stderr:+ touch ok/1 2023-08-25T04:45:31.712 INFO:tasks.workunit.client.2.smithi016.stderr:+ touch ok/2 2023-08-25T04:45:31.713 INFO:tasks.workunit.client.0.smithi016.stderr:+ touch ok/2 2023-08-25T04:45:31.714 INFO:tasks.workunit.client.2.smithi016.stderr:+ touch 3 2023-08-25T04:45:31.715 INFO:tasks.workunit.client.0.smithi016.stderr:+ touch 3 2023-08-25T04:45:31.716 INFO:tasks.workunit.client.2.smithi016.stderr:+ expect_false touch shouldbefail 2023-08-25T04:45:31.716 INFO:tasks.workunit.client.2.smithi016.stderr:+ set -x 2023-08-25T04:45:31.716 INFO:tasks.workunit.client.2.smithi016.stderr:+ touch shouldbefail 2023-08-25T04:45:31.717 INFO:tasks.workunit.client.2.smithi016.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-08-25T04:45:31.717 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 0 2023-08-25T04:45:31.717 INFO:tasks.workunit.client.2.smithi016.stderr:+ expect_false touch ok/shouldbefail 2023-08-25T04:45:31.717 INFO:tasks.workunit.client.2.smithi016.stderr:+ set -x 2023-08-25T04:45:31.717 INFO:tasks.workunit.client.2.smithi016.stderr:+ touch ok/shouldbefail 2023-08-25T04:45:31.718 INFO:tasks.workunit.client.0.smithi016.stderr:+ expect_false touch shouldbefail 2023-08-25T04:45:31.718 INFO:tasks.workunit.client.0.smithi016.stderr:+ set -x 2023-08-25T04:45:31.718 INFO:tasks.workunit.client.0.smithi016.stderr:+ touch shouldbefail 2023-08-25T04:45:31.718 INFO:tasks.workunit.client.2.smithi016.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-08-25T04:45:31.719 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 0 2023-08-25T04:45:31.719 INFO:tasks.workunit.client.2.smithi016.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-08-25T04:45:31.720 INFO:tasks.workunit.client.0.smithi016.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-08-25T04:45:31.720 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 0 2023-08-25T04:45:31.720 INFO:tasks.workunit.client.0.smithi016.stderr:+ expect_false touch ok/shouldbefail 2023-08-25T04:45:31.720 INFO:tasks.workunit.client.0.smithi016.stderr:+ set -x 2023-08-25T04:45:31.720 INFO:tasks.workunit.client.0.smithi016.stderr:+ touch ok/shouldbefail 2023-08-25T04:45:31.720 INFO:tasks.workunit.client.0.smithi016.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-08-25T04:45:31.721 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 0 2023-08-25T04:45:31.721 INFO:tasks.workunit.client.0.smithi016.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-08-25T04:45:31.732 INFO:tasks.workunit.client.2.smithi016.stderr:+ touch shouldbecreated 2023-08-25T04:45:31.733 INFO:tasks.workunit.client.0.smithi016.stderr:+ touch shouldbecreated 2023-08-25T04:45:31.734 INFO:tasks.workunit.client.2.smithi016.stderr:+ touch shouldbecreated2 2023-08-25T04:45:31.735 INFO:tasks.workunit.client.0.smithi016.stderr:+ touch shouldbecreated2 2023-08-25T04:45:31.739 INFO:tasks.workunit.client.2.smithi016.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-08-25T04:45:31.739 INFO:tasks.workunit.client.0.smithi016.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-08-25T04:45:31.758 INFO:tasks.workunit.client.2.smithi016.stderr:+ mkdir bytes bytes/files 2023-08-25T04:45:31.760 INFO:tasks.workunit.client.0.smithi016.stderr:+ mkdir bytes bytes/files 2023-08-25T04:45:31.763 INFO:tasks.workunit.client.2.smithi016.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-08-25T04:45:31.763 INFO:tasks.workunit.client.0.smithi016.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-08-25T04:45:31.775 INFO:tasks.workunit.client.2.smithi016.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-08-25T04:45:31.775 INFO:tasks.workunit.client.0.smithi016.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-08-25T04:45:31.781 INFO:tasks.workunit.client.2.smithi016.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-08-25T04:45:31.781 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-08-25T04:45:31.784 INFO:tasks.workunit.client.2.smithi016.stderr:4+0 records in 2023-08-25T04:45:31.784 INFO:tasks.workunit.client.2.smithi016.stderr:4+0 records out 2023-08-25T04:45:31.784 INFO:tasks.workunit.client.2.smithi016.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00154738 s, 2.7 GB/s 2023-08-25T04:45:31.784 INFO:tasks.workunit.client.2.smithi016.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-08-25T04:45:31.785 INFO:tasks.workunit.client.0.smithi016.stderr:4+0 records in 2023-08-25T04:45:31.785 INFO:tasks.workunit.client.0.smithi016.stderr:4+0 records out 2023-08-25T04:45:31.785 INFO:tasks.workunit.client.0.smithi016.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00151419 s, 2.8 GB/s 2023-08-25T04:45:31.785 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-08-25T04:45:31.787 INFO:tasks.workunit.client.2.smithi016.stderr:4+0 records in 2023-08-25T04:45:31.787 INFO:tasks.workunit.client.2.smithi016.stderr:4+0 records out 2023-08-25T04:45:31.787 INFO:tasks.workunit.client.2.smithi016.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00143179 s, 2.9 GB/s 2023-08-25T04:45:31.788 INFO:tasks.workunit.client.2.smithi016.stderr:+ expect_false write_file bytes/files/3 1000 2023-08-25T04:45:31.788 INFO:tasks.workunit.client.2.smithi016.stderr:+ set -x 2023-08-25T04:45:31.788 INFO:tasks.workunit.client.2.smithi016.stderr:+ write_file bytes/files/3 1000 2023-08-25T04:45:31.788 INFO:tasks.workunit.client.2.smithi016.stderr:+ set +x 2023-08-25T04:45:31.789 INFO:tasks.workunit.client.0.smithi016.stderr:4+0 records in 2023-08-25T04:45:31.789 INFO:tasks.workunit.client.0.smithi016.stderr:4+0 records out 2023-08-25T04:45:31.789 INFO:tasks.workunit.client.0.smithi016.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00152394 s, 2.8 GB/s 2023-08-25T04:45:31.789 INFO:tasks.workunit.client.0.smithi016.stderr:+ expect_false write_file bytes/files/3 1000 2023-08-25T04:45:31.790 INFO:tasks.workunit.client.0.smithi016.stderr:+ set -x 2023-08-25T04:45:31.790 INFO:tasks.workunit.client.0.smithi016.stderr:+ write_file bytes/files/3 1000 2023-08-25T04:45:31.790 INFO:tasks.workunit.client.0.smithi016.stderr:+ set +x 2023-08-25T04:45:32.022 INFO:tasks.workunit.client.3.smithi117.stdout:Try to write 26214400 2023-08-25T04:45:32.023 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 1 2023-08-25T04:45:32.023 INFO:tasks.workunit.client.3.smithi117.stderr:+ return 0 2023-08-25T04:45:32.023 INFO:tasks.workunit.client.3.smithi117.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-08-25T04:45:32.023 INFO:tasks.workunit.client.3.smithi117.stdout:ancestor/p1/p2/parent/p3/file1 25165824 2023-08-25T04:45:32.023 INFO:tasks.workunit.client.3.smithi117.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-08-25T04:45:32.024 INFO:tasks.workunit.client.3.smithi117.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-08-25T04:45:32.025 INFO:tasks.workunit.client.3.smithi117.stderr:setfattr: .: Invalid argument 2023-08-25T04:45:32.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:45:32.026 INFO:tasks.workunit:Stopping ['fs/quota'] on client.3... 2023-08-25T04:45:32.026 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.3 /home/ubuntu/cephtest/clone.client.3 2023-08-25T04:45:32.027 INFO:tasks.workunit.client.1.smithi117.stdout:Try to write 26214400 2023-08-25T04:45:32.027 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 1 2023-08-25T04:45:32.027 INFO:tasks.workunit.client.1.smithi117.stderr:+ return 0 2023-08-25T04:45:32.028 INFO:tasks.workunit.client.1.smithi117.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-08-25T04:45:32.028 INFO:tasks.workunit.client.1.smithi117.stdout:ancestor/p1/p2/parent/p3/file1 25165824 2023-08-25T04:45:32.028 INFO:tasks.workunit.client.1.smithi117.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-08-25T04:45:32.029 INFO:tasks.workunit.client.1.smithi117.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-08-25T04:45:32.029 INFO:tasks.workunit.client.1.smithi117.stderr:setfattr: .: Invalid argument 2023-08-25T04:45:32.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:45:32.030 INFO:tasks.workunit:Stopping ['fs/quota'] on client.1... 2023-08-25T04:45:32.031 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-08-25T04:45:32.281 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/quota/quota.sh) on smithi117 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ba6b39e4f4f77fb95c747099b53db0467d435f56 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh' 2023-08-25T04:45:32.345 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=e4ac280c680d4db6b9976dac468c2879 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/quota/quota.sh) on smithi117 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ba6b39e4f4f77fb95c747099b53db0467d435f56 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh' 2023-08-25T04:45:32.347 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-08-25T04:45:32.357 INFO:tasks.kclient:Unmounting kernel clients... 2023-08-25T04:45:32.357 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:45:32.357 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:45:32.380 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:45:32.380 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:45:32.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:32.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.609+0000 7f343bb30700 1 Processor -- start 2023-08-25T04:45:32.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.609+0000 7f343bb30700 1 -- start start 2023-08-25T04:45:32.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f343bb30700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34340cf230 0x7f3434161080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f343bb30700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f34340b36e0 0x7f34341615c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f343bb30700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34340d0e50 con 0x7f343415d3e0 2023-08-25T04:45:32.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f343bb30700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3434161b00 con 0x7f34340b36e0 2023-08-25T04:45:32.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f343bb30700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3434161d00 con 0x7f34340cf230 2023-08-25T04:45:32.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f343a0cd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f34340b36e0 0x7f34341615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f343a0cd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f34340b36e0 0x7f34341615c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49888/0 (socket says 172.21.15.16:49888) 2023-08-25T04:45:32.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f343a0cd700 1 -- 172.21.15.16:0/2626521471 learned_addr learned my addr 172.21.15.16:0/2626521471 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:32.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f34398cc700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f343415d3e0 0x7f34340ceb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40298/0 (socket says 172.21.15.16:40298) 2023-08-25T04:45:32.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f34390cb700 1 --2- 172.21.15.16:0/2626521471 >> v2:172.21.15.117:3300/0 conn(0x7f34340cf230 0x7f3434161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f343a0cd700 1 -- 172.21.15.16:0/2626521471 >> v2:172.21.15.117:3300/0 conn(0x7f34340cf230 msgr2=0x7f3434161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:32.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f343a0cd700 1 --2- 172.21.15.16:0/2626521471 >> v2:172.21.15.117:3300/0 conn(0x7f34340cf230 0x7f3434161080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f343a0cd700 1 -- 172.21.15.16:0/2626521471 >> v1:172.21.15.16:6789/0 conn(0x7f343415d3e0 legacy=0x7f34340ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f343a0cd700 1 -- 172.21.15.16:0/2626521471 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3434161fe0 con 0x7f34340b36e0 2023-08-25T04:45:32.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f34388ca700 1 -- 172.21.15.16:0/2626521471 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250330732 0 0) 0x7f34340d0e50 con 0x7f343415d3e0 2023-08-25T04:45:32.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.610+0000 7f343a0cd700 1 --2- 172.21.15.16:0/2626521471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34340b36e0 0x7f34341615c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f342c009e50 tx=0x7f342c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d806799bc4d356 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:32.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.611+0000 7f34388ca700 1 -- 172.21.15.16:0/2626521471 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c00e070 con 0x7f34340b36e0 2023-08-25T04:45:32.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.611+0000 7f34388ca700 1 -- 172.21.15.16:0/2626521471 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c00b8d0 con 0x7f34340b36e0 2023-08-25T04:45:32.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.611+0000 7f34388ca700 1 -- 172.21.15.16:0/2626521471 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c00bc80 con 0x7f34340b36e0 2023-08-25T04:45:32.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.611+0000 7f343bb30700 1 -- 172.21.15.16:0/2626521471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34340b36e0 msgr2=0x7f34341615c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.611+0000 7f343bb30700 1 --2- 172.21.15.16:0/2626521471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34340b36e0 0x7f34341615c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f342c009e50 tx=0x7f342c00b330 comp rx=0 tx=0).stop 2023-08-25T04:45:32.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.611+0000 7f343bb30700 1 -- 172.21.15.16:0/2626521471 shutdown_connections 2023-08-25T04:45:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.611+0000 7f343bb30700 1 --2- 172.21.15.16:0/2626521471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34340b36e0 0x7f34341615c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.611+0000 7f343bb30700 1 --2- 172.21.15.16:0/2626521471 >> v2:172.21.15.117:3300/0 conn(0x7f34340cf230 0x7f3434161080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.611+0000 7f343bb30700 1 -- 172.21.15.16:0/2626521471 >> 172.21.15.16:0/2626521471 conn(0x7f34340d0fe0 msgr2=0x7f34340d13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.611+0000 7f343bb30700 1 -- 172.21.15.16:0/2626521471 shutdown_connections 2023-08-25T04:45:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.611+0000 7f343bb30700 1 -- 172.21.15.16:0/2626521471 wait complete. 2023-08-25T04:45:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.613+0000 7f343bb30700 1 Processor -- start 2023-08-25T04:45:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.613+0000 7f343bb30700 1 -- start start 2023-08-25T04:45:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.613+0000 7f343bb30700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34340b36e0 0x7f34341535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.613+0000 7f343bb30700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34340cf230 0x7f3434151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.613+0000 7f343bb30700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343415d3e0 0x7f3434157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.613+0000 7f343bb30700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3434153ae0 con 0x7f34340b36e0 2023-08-25T04:45:32.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.613+0000 7f343bb30700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34341509f0 con 0x7f34340cf230 2023-08-25T04:45:32.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.613+0000 7f343bb30700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34340b7220 con 0x7f343415d3e0 2023-08-25T04:45:32.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.613+0000 7f34398cc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34340b36e0 0x7f34341535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.613+0000 7f34398cc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34340b36e0 0x7f34341535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49890/0 (socket says 172.21.15.16:49890) 2023-08-25T04:45:32.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.613+0000 7f34398cc700 1 -- 172.21.15.16:0/2271802262 learned_addr learned my addr 172.21.15.16:0/2271802262 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:32.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.614+0000 7f34390cb700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34340cf230 0x7f3434151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.614+0000 7f343a0cd700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343415d3e0 0x7f3434157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.614+0000 7f34398cc700 1 -- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343415d3e0 msgr2=0x7f3434157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.614+0000 7f34398cc700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343415d3e0 0x7f3434157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.614+0000 7f34398cc700 1 -- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34340cf230 msgr2=0x7f3434151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.614+0000 7f34398cc700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34340cf230 0x7f3434151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.614+0000 7f34398cc700 1 -- 172.21.15.16:0/2271802262 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c009b30 con 0x7f34340b36e0 2023-08-25T04:45:32.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.614+0000 7f34390cb700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34340cf230 0x7f3434151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:32.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.614+0000 7f34398cc700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34340b36e0 0x7f34341535a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f34300011e0 tx=0x7f343000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:32.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.614+0000 7f342a7fc700 1 -- 172.21.15.16:0/2271802262 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430004c80 con 0x7f34340b36e0 2023-08-25T04:45:32.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.614+0000 7f342a7fc700 1 -- 172.21.15.16:0/2271802262 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3430004e00 con 0x7f34340b36e0 2023-08-25T04:45:32.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.614+0000 7f343bb30700 1 -- 172.21.15.16:0/2271802262 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3434150c90 con 0x7f34340b36e0 2023-08-25T04:45:32.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.614+0000 7f342a7fc700 1 -- 172.21.15.16:0/2271802262 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430007310 con 0x7f34340b36e0 2023-08-25T04:45:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.614+0000 7f343bb30700 1 -- 172.21.15.16:0/2271802262 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3434150f70 con 0x7f34340b36e0 2023-08-25T04:45:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.615+0000 7f343bb30700 1 -- 172.21.15.16:0/2271802262 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343404ee70 con 0x7f34340b36e0 2023-08-25T04:45:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.615+0000 7f342a7fc700 1 -- 172.21.15.16:0/2271802262 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3430007470 con 0x7f34340b36e0 2023-08-25T04:45:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.616+0000 7f342a7fc700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f341806a0e0 0x7f341806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.616+0000 7f342a7fc700 1 -- 172.21.15.16:0/2271802262 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f34300881d0 con 0x7f34340b36e0 2023-08-25T04:45:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.616+0000 7f34390cb700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f341806a0e0 0x7f341806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.617+0000 7f34390cb700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f341806a0e0 0x7f341806c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f34341f5d30 tx=0x7f3424009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.620+0000 7f342a7fc700 1 -- 172.21.15.16:0/2271802262 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3430053880 con 0x7f34340b36e0 2023-08-25T04:45:32.825 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.824+0000 7f343bb30700 1 -- 172.21.15.16:0/2271802262 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f343406cf60 con 0x7f34340b36e0 2023-08-25T04:45:32.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.826+0000 7f342a7fc700 1 -- 172.21.15.16:0/2271802262 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18329 (secure 0 0 0) 0x7f3430056ea0 con 0x7f34340b36e0 2023-08-25T04:45:32.827 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:45:32.828 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:44:30.464568+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:43:40.197381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:43:41.268759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:32.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.828+0000 7f343bb30700 1 -- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f341806a0e0 msgr2=0x7f341806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.828+0000 7f343bb30700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f341806a0e0 0x7f341806c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f34341f5d30 tx=0x7f3424009210 comp rx=0 tx=0).stop 2023-08-25T04:45:32.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.828+0000 7f343bb30700 1 -- 172.21.15.16:0/2271802262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34340b36e0 msgr2=0x7f34341535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.828+0000 7f343bb30700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34340b36e0 0x7f34341535a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f34300011e0 tx=0x7f343000ca30 comp rx=0 tx=0).stop 2023-08-25T04:45:32.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.828+0000 7f343bb30700 1 -- 172.21.15.16:0/2271802262 shutdown_connections 2023-08-25T04:45:32.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.828+0000 7f343bb30700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f341806a0e0 0x7f341806c5a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.831 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.828+0000 7f343bb30700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343415d3e0 0x7f3434157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.831 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.828+0000 7f343bb30700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34340b36e0 0x7f34341535a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.831 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.828+0000 7f343bb30700 1 --2- 172.21.15.16:0/2271802262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34340cf230 0x7f3434151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.831 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.828+0000 7f343bb30700 1 -- 172.21.15.16:0/2271802262 >> 172.21.15.16:0/2271802262 conn(0x7f34340d0fe0 msgr2=0x7f34340c78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:32.831 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.828+0000 7f343bb30700 1 -- 172.21.15.16:0/2271802262 shutdown_connections 2023-08-25T04:45:32.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.828+0000 7f343bb30700 1 -- 172.21.15.16:0/2271802262 wait complete. 2023-08-25T04:45:32.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:43:34.951742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:43:35.360236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:43:40.197381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:43:41.268759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:45:32.843 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:45:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.970+0000 7f0cfbb75700 1 Processor -- start 2023-08-25T04:45:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.970+0000 7f0cfbb75700 1 -- start start 2023-08-25T04:45:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.971+0000 7f0cfbb75700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0cf4146560 0x7f0cf40d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.971+0000 7f0cfbb75700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf4146aa0 0x7f0cf406a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.971+0000 7f0cfbb75700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf4161810 con 0x7f0cf406a880 2023-08-25T04:45:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.971+0000 7f0cfbb75700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf4146940 con 0x7f0cf4146560 2023-08-25T04:45:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.971+0000 7f0cfbb75700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf406ad00 con 0x7f0cf4146aa0 2023-08-25T04:45:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.971+0000 7f0cf9911700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0cf4146560 0x7f0cf40d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.971+0000 7f0cf9911700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0cf4146560 0x7f0cf40d0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49898/0 (socket says 172.21.15.16:49898) 2023-08-25T04:45:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.971+0000 7f0cf9911700 1 -- 172.21.15.16:0/2065454201 learned_addr learned my addr 172.21.15.16:0/2065454201 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.972+0000 7f0cf9110700 1 --2- 172.21.15.16:0/2065454201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf4146aa0 0x7f0cf406a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.972+0000 7f0cf9911700 1 -- 172.21.15.16:0/2065454201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf4146aa0 msgr2=0x7f0cf406a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.972+0000 7f0cf9911700 1 --2- 172.21.15.16:0/2065454201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf4146aa0 0x7f0cf406a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.972+0000 7f0cf9911700 1 -- 172.21.15.16:0/2065454201 >> v1:172.21.15.117:6789/0 conn(0x7f0cf406a880 legacy=0x7f0cf4070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.972+0000 7f0cf9911700 1 -- 172.21.15.16:0/2065454201 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf406e210 con 0x7f0cf4146560 2023-08-25T04:45:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.972+0000 7f0cf9911700 1 --2- 172.21.15.16:0/2065454201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf4146560 0x7f0cf40d0920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0098f0 tx=0x7f0cec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a89d9ced66a43d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.972+0000 7f0cf890f700 1 -- 172.21.15.16:0/2065454201 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00b8a0 con 0x7f0cf4146560 2023-08-25T04:45:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.972+0000 7f0cf890f700 1 -- 172.21.15.16:0/2065454201 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00ba00 con 0x7f0cf4146560 2023-08-25T04:45:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.972+0000 7f0cf890f700 1 -- 172.21.15.16:0/2065454201 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00bd90 con 0x7f0cf4146560 2023-08-25T04:45:32.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.973+0000 7f0cfbb75700 1 -- 172.21.15.16:0/2065454201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf4146560 msgr2=0x7f0cf40d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.973+0000 7f0cfbb75700 1 --2- 172.21.15.16:0/2065454201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf4146560 0x7f0cf40d0920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0098f0 tx=0x7f0cec009c00 comp rx=0 tx=0).stop 2023-08-25T04:45:32.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.973+0000 7f0cfbb75700 1 -- 172.21.15.16:0/2065454201 shutdown_connections 2023-08-25T04:45:32.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.973+0000 7f0cfbb75700 1 --2- 172.21.15.16:0/2065454201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf4146560 0x7f0cf40d0920 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.973+0000 7f0cfbb75700 1 --2- 172.21.15.16:0/2065454201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf4146aa0 0x7f0cf406a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.973+0000 7f0cfbb75700 1 -- 172.21.15.16:0/2065454201 >> 172.21.15.16:0/2065454201 conn(0x7f0cf40cfe00 msgr2=0x7f0cf40d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:32.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.973+0000 7f0cfbb75700 1 -- 172.21.15.16:0/2065454201 shutdown_connections 2023-08-25T04:45:32.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.973+0000 7f0cfbb75700 1 -- 172.21.15.16:0/2065454201 wait complete. 2023-08-25T04:45:32.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.974+0000 7f0cfbb75700 1 Processor -- start 2023-08-25T04:45:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.974+0000 7f0cfbb75700 1 -- start start 2023-08-25T04:45:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfbb75700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf406a880 0x7f0cf40cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfbb75700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf4146560 0x7f0cf40cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfbb75700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf4146aa0 0x7f0cf415d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfbb75700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf41f29d0 con 0x7f0cf4146aa0 2023-08-25T04:45:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfbb75700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf41f6ff0 con 0x7f0cf4146560 2023-08-25T04:45:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfbb75700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf41f6090 con 0x7f0cf406a880 2023-08-25T04:45:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfa112700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf4146aa0 0x7f0cf415d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfa112700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf4146aa0 0x7f0cf415d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49906/0 (socket says 172.21.15.16:49906) 2023-08-25T04:45:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfa112700 1 -- 172.21.15.16:0/3107871434 learned_addr learned my addr 172.21.15.16:0/3107871434 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cf9110700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf4146560 0x7f0cf40cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cf9911700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf406a880 0x7f0cf40cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfa112700 1 -- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf406a880 msgr2=0x7f0cf40cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfa112700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf406a880 0x7f0cf40cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfa112700 1 -- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf4146560 msgr2=0x7f0cf40cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfa112700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf4146560 0x7f0cf40cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfa112700 1 -- 172.21.15.16:0/3107871434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec009550 con 0x7f0cf4146aa0 2023-08-25T04:45:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cf9911700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf406a880 0x7f0cf40cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.975+0000 7f0cfa112700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf4146aa0 0x7f0cf415d8d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400cb80 tx=0x7f0ce400ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.976+0000 7f0cf27fc700 1 -- 172.21.15.16:0/3107871434 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4003c00 con 0x7f0cf4146aa0 2023-08-25T04:45:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.976+0000 7f0cf27fc700 1 -- 172.21.15.16:0/3107871434 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce4003d60 con 0x7f0cf4146aa0 2023-08-25T04:45:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.976+0000 7f0cfbb75700 1 -- 172.21.15.16:0/3107871434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf41f6370 con 0x7f0cf4146aa0 2023-08-25T04:45:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.976+0000 7f0cf27fc700 1 -- 172.21.15.16:0/3107871434 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce400ab00 con 0x7f0cf4146aa0 2023-08-25T04:45:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.976+0000 7f0cfbb75700 1 -- 172.21.15.16:0/3107871434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf41f6930 con 0x7f0cf4146aa0 2023-08-25T04:45:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.977+0000 7f0cfbb75700 1 -- 172.21.15.16:0/3107871434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf406edf0 con 0x7f0cf4146aa0 2023-08-25T04:45:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.977+0000 7f0cf27fc700 1 -- 172.21.15.16:0/3107871434 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ce400ac60 con 0x7f0cf4146aa0 2023-08-25T04:45:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.977+0000 7f0cf27fc700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0ce006a0e0 0x7f0ce006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.978+0000 7f0cf27fc700 1 -- 172.21.15.16:0/3107871434 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0ce40884d0 con 0x7f0cf4146aa0 2023-08-25T04:45:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.978+0000 7f0cf9911700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0ce006a0e0 0x7f0ce006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.979+0000 7f0cf9911700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0ce006a0e0 0x7f0ce006c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0cec014040 tx=0x7f0cec008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:32.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:32.982+0000 7f0cf27fc700 1 -- 172.21.15.16:0/3107871434 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0ce4053c10 con 0x7f0cf4146aa0 2023-08-25T04:45:33.048 INFO:tasks.workunit.client.2.smithi016.stdout:Try to write 26214400 2023-08-25T04:45:33.048 INFO:tasks.workunit.client.0.smithi016.stdout:Try to write 26214400 2023-08-25T04:45:33.049 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 1 2023-08-25T04:45:33.049 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 0 2023-08-25T04:45:33.050 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 1 2023-08-25T04:45:33.050 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 0 2023-08-25T04:45:33.050 INFO:tasks.workunit.client.2.smithi016.stderr:+ expect_false write_file bytes/files/4 1000 2023-08-25T04:45:33.051 INFO:tasks.workunit.client.2.smithi016.stderr:+ set -x 2023-08-25T04:45:33.051 INFO:tasks.workunit.client.2.smithi016.stderr:+ write_file bytes/files/4 1000 2023-08-25T04:45:33.051 INFO:tasks.workunit.client.2.smithi016.stderr:+ set +x 2023-08-25T04:45:33.052 INFO:tasks.workunit.client.0.smithi016.stderr:+ expect_false write_file bytes/files/4 1000 2023-08-25T04:45:33.052 INFO:tasks.workunit.client.0.smithi016.stderr:+ set -x 2023-08-25T04:45:33.052 INFO:tasks.workunit.client.0.smithi016.stderr:+ write_file bytes/files/4 1000 2023-08-25T04:45:33.052 INFO:tasks.workunit.client.0.smithi016.stderr:+ set +x 2023-08-25T04:45:33.053 INFO:tasks.workunit.client.0.smithi016.stdout:Try to write 1048576 2023-08-25T04:45:33.053 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 1 2023-08-25T04:45:33.054 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 0 2023-08-25T04:45:33.054 INFO:tasks.workunit.client.0.smithi016.stderr:+ expect_false write_file bytes/files/5 1000 2023-08-25T04:45:33.054 INFO:tasks.workunit.client.0.smithi016.stderr:+ set -x 2023-08-25T04:45:33.054 INFO:tasks.workunit.client.0.smithi016.stderr:+ write_file bytes/files/5 1000 2023-08-25T04:45:33.054 INFO:tasks.workunit.client.0.smithi016.stderr:+ set +x 2023-08-25T04:45:33.055 INFO:tasks.workunit.client.2.smithi016.stdout:Try to write 1048576 2023-08-25T04:45:33.056 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 1 2023-08-25T04:45:33.056 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 0 2023-08-25T04:45:33.056 INFO:tasks.workunit.client.2.smithi016.stderr:+ expect_false write_file bytes/files/5 1000 2023-08-25T04:45:33.056 INFO:tasks.workunit.client.2.smithi016.stderr:+ set -x 2023-08-25T04:45:33.057 INFO:tasks.workunit.client.2.smithi016.stderr:+ write_file bytes/files/5 1000 2023-08-25T04:45:33.057 INFO:tasks.workunit.client.2.smithi016.stderr:+ set +x 2023-08-25T04:45:33.058 INFO:tasks.workunit.client.0.smithi016.stdout:Try to write 1048576 2023-08-25T04:45:33.058 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 1 2023-08-25T04:45:33.059 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 0 2023-08-25T04:45:33.059 INFO:tasks.workunit.client.0.smithi016.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-08-25T04:45:33.060 INFO:tasks.workunit.client.2.smithi016.stdout:Try to write 1048576 2023-08-25T04:45:33.061 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 1 2023-08-25T04:45:33.062 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 0 2023-08-25T04:45:33.062 INFO:tasks.workunit.client.2.smithi016.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-08-25T04:45:33.062 INFO:tasks.workunit.client.0.smithi016.stdout:bytes/files/1 4194304 2023-08-25T04:45:33.063 INFO:tasks.workunit.client.0.smithi016.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-08-25T04:45:33.063 INFO:tasks.workunit.client.2.smithi016.stdout:bytes/files/1 4194304 2023-08-25T04:45:33.064 INFO:tasks.workunit.client.2.smithi016.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-08-25T04:45:33.064 INFO:tasks.workunit.client.0.smithi016.stdout:bytes/files/2 4194304 2023-08-25T04:45:33.064 INFO:tasks.workunit.client.0.smithi016.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-08-25T04:45:33.065 INFO:tasks.workunit.client.2.smithi016.stdout:bytes/files/2 4194304 2023-08-25T04:45:33.065 INFO:tasks.workunit.client.2.smithi016.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-08-25T04:45:33.066 INFO:tasks.workunit.client.0.smithi016.stdout:bytes/files/3 25165824 2023-08-25T04:45:33.066 INFO:tasks.workunit.client.0.smithi016.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-08-25T04:45:33.066 INFO:tasks.workunit.client.2.smithi016.stdout:bytes/files/3 25165824 2023-08-25T04:45:33.067 INFO:tasks.workunit.client.2.smithi016.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-08-25T04:45:33.067 INFO:tasks.workunit.client.0.smithi016.stdout:bytes/files/4 0 2023-08-25T04:45:33.068 INFO:tasks.workunit.client.0.smithi016.stderr:+ expect_false stat bytes/files/5 2023-08-25T04:45:33.068 INFO:tasks.workunit.client.0.smithi016.stderr:+ set -x 2023-08-25T04:45:33.068 INFO:tasks.workunit.client.0.smithi016.stderr:+ stat bytes/files/5 2023-08-25T04:45:33.069 INFO:tasks.workunit.client.2.smithi016.stdout:bytes/files/4 0 2023-08-25T04:45:33.069 INFO:tasks.workunit.client.2.smithi016.stderr:+ expect_false stat bytes/files/5 2023-08-25T04:45:33.070 INFO:tasks.workunit.client.2.smithi016.stderr:+ set -x 2023-08-25T04:45:33.070 INFO:tasks.workunit.client.2.smithi016.stderr:+ stat bytes/files/5 2023-08-25T04:45:33.071 INFO:tasks.workunit.client.0.smithi016.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-08-25T04:45:33.071 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 0 2023-08-25T04:45:33.072 INFO:tasks.workunit.client.2.smithi016.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-08-25T04:45:33.072 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 0 2023-08-25T04:45:33.073 INFO:tasks.workunit.client.0.smithi016.stderr:+ rm -rf bytes 2023-08-25T04:45:33.073 INFO:tasks.workunit.client.2.smithi016.stderr:+ rm -rf bytes 2023-08-25T04:45:33.087 INFO:tasks.workunit.client.0.smithi016.stderr:+ mkdir files limit 2023-08-25T04:45:33.090 INFO:tasks.workunit.client.0.smithi016.stderr:+ truncate files/file -s 10G 2023-08-25T04:45:33.091 INFO:tasks.workunit.client.2.smithi016.stderr:+ mkdir files limit 2023-08-25T04:45:33.094 INFO:tasks.workunit.client.2.smithi016.stderr:+ truncate files/file -s 10G 2023-08-25T04:45:33.101 INFO:tasks.workunit.client.2.smithi016.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-08-25T04:45:33.101 INFO:tasks.workunit.client.0.smithi016.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-08-25T04:45:33.110 INFO:tasks.workunit.client.2.smithi016.stderr:+ expect_false mv files limit/ 2023-08-25T04:45:33.110 INFO:tasks.workunit.client.2.smithi016.stderr:+ set -x 2023-08-25T04:45:33.110 INFO:tasks.workunit.client.2.smithi016.stderr:+ mv files limit/ 2023-08-25T04:45:33.111 INFO:tasks.workunit.client.0.smithi016.stderr:+ expect_false mv files limit/ 2023-08-25T04:45:33.111 INFO:tasks.workunit.client.0.smithi016.stderr:+ set -x 2023-08-25T04:45:33.111 INFO:tasks.workunit.client.0.smithi016.stderr:+ mv files limit/ 2023-08-25T04:45:33.118 INFO:tasks.workunit.client.2.smithi016.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-08-25T04:45:33.119 INFO:tasks.workunit.client.0.smithi016.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-08-25T04:45:33.126 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 0 2023-08-25T04:45:33.127 INFO:tasks.workunit.client.2.smithi016.stderr:+ rm -rf files limit 2023-08-25T04:45:33.128 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 0 2023-08-25T04:45:33.130 INFO:tasks.workunit.client.0.smithi016.stderr:+ rm -rf files limit 2023-08-25T04:45:33.161 INFO:tasks.workunit.client.2.smithi016.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-08-25T04:45:33.164 INFO:tasks.workunit.client.0.smithi016.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-08-25T04:45:33.169 INFO:tasks.workunit.client.2.smithi016.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-08-25T04:45:33.172 INFO:tasks.workunit.client.0.smithi016.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-08-25T04:45:33.179 INFO:tasks.workunit.client.2.smithi016.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-08-25T04:45:33.181 INFO:tasks.workunit.client.0.smithi016.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-08-25T04:45:33.183 INFO:tasks.workunit.client.2.smithi016.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-25T04:45:33.183 INFO:tasks.workunit.client.2.smithi016.stderr:+ set -x 2023-08-25T04:45:33.183 INFO:tasks.workunit.client.2.smithi016.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-25T04:45:33.184 INFO:tasks.workunit.client.2.smithi016.stderr:+ set +x 2023-08-25T04:45:33.185 INFO:tasks.workunit.client.0.smithi016.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-25T04:45:33.185 INFO:tasks.workunit.client.0.smithi016.stderr:+ set -x 2023-08-25T04:45:33.186 INFO:tasks.workunit.client.0.smithi016.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-25T04:45:33.186 INFO:tasks.workunit.client.0.smithi016.stderr:+ set +x 2023-08-25T04:45:33.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.188+0000 7f0cfbb75700 1 -- 172.21.15.16:0/3107871434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0cf404ee70 con 0x7f0cf4146aa0 2023-08-25T04:45:33.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.188+0000 7f0cf27fc700 1 -- 172.21.15.16:0/3107871434 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0ce4057230 con 0x7f0cf4146aa0 2023-08-25T04:45:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-08-25T04:45:33.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.191+0000 7f0cfbb75700 1 -- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0ce006a0e0 msgr2=0x7f0ce006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.193 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.191+0000 7f0cfbb75700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0ce006a0e0 0x7f0ce006c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0cec014040 tx=0x7f0cec008030 comp rx=0 tx=0).stop 2023-08-25T04:45:33.193 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.191+0000 7f0cfbb75700 1 -- 172.21.15.16:0/3107871434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf4146aa0 msgr2=0x7f0cf415d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.193 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.191+0000 7f0cfbb75700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf4146aa0 0x7f0cf415d8d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400cb80 tx=0x7f0ce400ce90 comp rx=0 tx=0).stop 2023-08-25T04:45:33.194 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.191+0000 7f0cfbb75700 1 -- 172.21.15.16:0/3107871434 shutdown_connections 2023-08-25T04:45:33.194 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.191+0000 7f0cfbb75700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0ce006a0e0 0x7f0ce006c5a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.191+0000 7f0cfbb75700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf4146aa0 0x7f0cf415d8d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.191+0000 7f0cfbb75700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf406a880 0x7f0cf40cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.191+0000 7f0cfbb75700 1 --2- 172.21.15.16:0/3107871434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf4146560 0x7f0cf40cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.191+0000 7f0cfbb75700 1 -- 172.21.15.16:0/3107871434 >> 172.21.15.16:0/3107871434 conn(0x7f0cf40cfe00 msgr2=0x7f0cf40b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:33.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.191+0000 7f0cfbb75700 1 -- 172.21.15.16:0/3107871434 shutdown_connections 2023-08-25T04:45:33.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.191+0000 7f0cfbb75700 1 -- 172.21.15.16:0/3107871434 wait complete. 2023-08-25T04:45:33.204 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:45:33.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.331+0000 7f0dedd2b700 1 Processor -- start 2023-08-25T04:45:33.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.331+0000 7f0dedd2b700 1 -- start start 2023-08-25T04:45:33.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.332+0000 7f0dedd2b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0de806aa50 0x7f0de80d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.332+0000 7f0dedd2b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de8146aa0 0x7f0de806d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.332+0000 7f0dedd2b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de8161810 con 0x7f0de8146560 2023-08-25T04:45:33.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.332+0000 7f0dedd2b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de8146940 con 0x7f0de806aa50 2023-08-25T04:45:33.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.332+0000 7f0dedd2b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80c5400 con 0x7f0de8146aa0 2023-08-25T04:45:33.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.332+0000 7f0de7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de8146aa0 0x7f0de806d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.332+0000 7f0de6ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0de806aa50 0x7f0de80d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.332+0000 7f0de77fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f0de8146560 0x7f0de806a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.16:48422/0 (socket says 172.21.15.16:48422) 2023-08-25T04:45:33.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.332+0000 7f0de7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de8146aa0 0x7f0de806d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:50456/0 (socket says 172.21.15.16:50456) 2023-08-25T04:45:33.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.332+0000 7f0de77fe700 1 -- 172.21.15.16:0/1056104387 learned_addr learned my addr 172.21.15.16:0/1056104387 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:33.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.332+0000 7f0de7fff700 1 -- 172.21.15.16:0/1056104387 >> v2:172.21.15.117:3300/0 conn(0x7f0de806aa50 msgr2=0x7f0de80d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:33.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.332+0000 7f0de7fff700 1 --2- 172.21.15.16:0/1056104387 >> v2:172.21.15.117:3300/0 conn(0x7f0de806aa50 0x7f0de80d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0de7fff700 1 -- 172.21.15.16:0/1056104387 >> v1:172.21.15.117:6789/0 conn(0x7f0de8146560 legacy=0x7f0de806a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0de7fff700 1 -- 172.21.15.16:0/1056104387 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de8161d40 con 0x7f0de8146aa0 2023-08-25T04:45:33.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0de6ffd700 1 --2- 172.21.15.16:0/1056104387 >> v2:172.21.15.117:3300/0 conn(0x7f0de806aa50 0x7f0de80d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:33.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0de67fc700 1 -- 172.21.15.16:0/1056104387 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689988815 0 0) 0x7f0de8161810 con 0x7f0de8146560 2023-08-25T04:45:33.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0de7fff700 1 --2- 172.21.15.16:0/1056104387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de8146aa0 0x7f0de806d200 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009d90 tx=0x7f0de000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fed4c59f0aa59623 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:33.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0de67fc700 1 -- 172.21.15.16:0/1056104387 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de000e070 con 0x7f0de8146aa0 2023-08-25T04:45:33.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0de67fc700 1 -- 172.21.15.16:0/1056104387 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de000bb20 con 0x7f0de8146aa0 2023-08-25T04:45:33.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0de67fc700 1 -- 172.21.15.16:0/1056104387 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0012430 con 0x7f0de8146aa0 2023-08-25T04:45:33.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0dedd2b700 1 -- 172.21.15.16:0/1056104387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de8146aa0 msgr2=0x7f0de806d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0dedd2b700 1 --2- 172.21.15.16:0/1056104387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de8146aa0 0x7f0de806d200 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009d90 tx=0x7f0de000b330 comp rx=0 tx=0).stop 2023-08-25T04:45:33.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0dedd2b700 1 -- 172.21.15.16:0/1056104387 shutdown_connections 2023-08-25T04:45:33.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0dedd2b700 1 --2- 172.21.15.16:0/1056104387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de8146aa0 0x7f0de806d200 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0dedd2b700 1 --2- 172.21.15.16:0/1056104387 >> v2:172.21.15.117:3300/0 conn(0x7f0de806aa50 0x7f0de80d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0dedd2b700 1 -- 172.21.15.16:0/1056104387 >> 172.21.15.16:0/1056104387 conn(0x7f0de80cfe00 msgr2=0x7f0de80d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:33.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.333+0000 7f0dedd2b700 1 -- 172.21.15.16:0/1056104387 shutdown_connections 2023-08-25T04:45:33.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.334+0000 7f0dedd2b700 1 -- 172.21.15.16:0/1056104387 wait complete. 2023-08-25T04:45:33.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.335+0000 7f0dedd2b700 1 Processor -- start 2023-08-25T04:45:33.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.335+0000 7f0dedd2b700 1 -- start start 2023-08-25T04:45:33.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0dedd2b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de806aa50 0x7f0de8140c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0dedd2b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de8146560 0x7f0de80b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0dedd2b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de8146aa0 0x7f0de80b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0dedd2b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de815e390 con 0x7f0de806aa50 2023-08-25T04:45:33.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0dedd2b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de815e670 con 0x7f0de8146560 2023-08-25T04:45:33.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0dedd2b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de815e950 con 0x7f0de8146aa0 2023-08-25T04:45:33.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0de77fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de806aa50 0x7f0de8140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0de77fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de806aa50 0x7f0de8140c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49918/0 (socket says 172.21.15.16:49918) 2023-08-25T04:45:33.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0de77fe700 1 -- 172.21.15.16:0/642236162 learned_addr learned my addr 172.21.15.16:0/642236162 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:33.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0de7fff700 1 --2- 172.21.15.16:0/642236162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de8146aa0 0x7f0de80b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0de6ffd700 1 --2- 172.21.15.16:0/642236162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de8146560 0x7f0de80b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0de77fe700 1 -- 172.21.15.16:0/642236162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de8146aa0 msgr2=0x7f0de80b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0de77fe700 1 --2- 172.21.15.16:0/642236162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de8146aa0 0x7f0de80b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0de77fe700 1 -- 172.21.15.16:0/642236162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de8146560 msgr2=0x7f0de80b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0de77fe700 1 --2- 172.21.15.16:0/642236162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de8146560 0x7f0de80b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0de77fe700 1 -- 172.21.15.16:0/642236162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd80094a0 con 0x7f0de806aa50 2023-08-25T04:45:33.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0de77fe700 1 --2- 172.21.15.16:0/642236162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de806aa50 0x7f0de8140c50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00c550 tx=0x7f0ddc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:33.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0dcffff700 1 -- 172.21.15.16:0/642236162 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc004c80 con 0x7f0de806aa50 2023-08-25T04:45:33.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0dcffff700 1 -- 172.21.15.16:0/642236162 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc004e00 con 0x7f0de806aa50 2023-08-25T04:45:33.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0dedd2b700 1 -- 172.21.15.16:0/642236162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de0009a70 con 0x7f0de806aa50 2023-08-25T04:45:33.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.336+0000 7f0dcffff700 1 -- 172.21.15.16:0/642236162 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc007310 con 0x7f0de806aa50 2023-08-25T04:45:33.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.337+0000 7f0dedd2b700 1 -- 172.21.15.16:0/642236162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de8141190 con 0x7f0de806aa50 2023-08-25T04:45:33.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.337+0000 7f0dedd2b700 1 -- 172.21.15.16:0/642236162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de806edf0 con 0x7f0de806aa50 2023-08-25T04:45:33.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.338+0000 7f0dcffff700 1 -- 172.21.15.16:0/642236162 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ddc007470 con 0x7f0de806aa50 2023-08-25T04:45:33.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.338+0000 7f0dcffff700 1 --2- 172.21.15.16:0/642236162 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0dd406a0e0 0x7f0dd406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.338+0000 7f0dcffff700 1 -- 172.21.15.16:0/642236162 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0ddc088340 con 0x7f0de806aa50 2023-08-25T04:45:33.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.339+0000 7f0de6ffd700 1 --2- 172.21.15.16:0/642236162 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0dd406a0e0 0x7f0dd406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.339+0000 7f0de6ffd700 1 --2- 172.21.15.16:0/642236162 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0dd406a0e0 0x7f0dd406c5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0de8160780 tx=0x7f0dd8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:33.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.343+0000 7f0dcffff700 1 -- 172.21.15.16:0/642236162 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0ddc053970 con 0x7f0de806aa50 2023-08-25T04:45:33.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.545+0000 7f0dedd2b700 1 -- 172.21.15.16:0/642236162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0de80c4d80 con 0x7f0de806aa50 2023-08-25T04:45:33.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.545+0000 7f0dcffff700 1 -- 172.21.15.16:0/642236162 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ddc056f90 con 0x7f0de806aa50 2023-08-25T04:45:33.547 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-08-25T04:45:33.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.547+0000 7f0dedd2b700 1 -- 172.21.15.16:0/642236162 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0dd406a0e0 msgr2=0x7f0dd406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.547+0000 7f0dedd2b700 1 --2- 172.21.15.16:0/642236162 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0dd406a0e0 0x7f0dd406c5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0de8160780 tx=0x7f0dd8008040 comp rx=0 tx=0).stop 2023-08-25T04:45:33.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.547+0000 7f0dedd2b700 1 -- 172.21.15.16:0/642236162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de806aa50 msgr2=0x7f0de8140c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.547+0000 7f0dedd2b700 1 --2- 172.21.15.16:0/642236162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de806aa50 0x7f0de8140c50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00c550 tx=0x7f0ddc00c910 comp rx=0 tx=0).stop 2023-08-25T04:45:33.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.547+0000 7f0dedd2b700 1 -- 172.21.15.16:0/642236162 shutdown_connections 2023-08-25T04:45:33.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.547+0000 7f0dedd2b700 1 --2- 172.21.15.16:0/642236162 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f0dd406a0e0 0x7f0dd406c5a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.547+0000 7f0dedd2b700 1 --2- 172.21.15.16:0/642236162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de8146aa0 0x7f0de80b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.547+0000 7f0dedd2b700 1 --2- 172.21.15.16:0/642236162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de806aa50 0x7f0de8140c50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.547+0000 7f0dedd2b700 1 --2- 172.21.15.16:0/642236162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de8146560 0x7f0de80b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.548+0000 7f0dedd2b700 1 -- 172.21.15.16:0/642236162 >> 172.21.15.16:0/642236162 conn(0x7f0de80cfe00 msgr2=0x7f0de80ca330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:33.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.548+0000 7f0dedd2b700 1 -- 172.21.15.16:0/642236162 shutdown_connections 2023-08-25T04:45:33.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.548+0000 7f0dedd2b700 1 -- 172.21.15.16:0/642236162 wait complete. 2023-08-25T04:45:33.561 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:45:33.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.689+0000 7fa6edb99700 1 Processor -- start 2023-08-25T04:45:33.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.690+0000 7fa6edb99700 1 -- start start 2023-08-25T04:45:33.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.690+0000 7fa6edb99700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa6e815d370 0x7fa6e80d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.690+0000 7fa6edb99700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa6e80b0030 0x7fa6e80cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.690+0000 7fa6edb99700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e80ce050 con 0x7fa6e80cdc40 2023-08-25T04:45:33.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.690+0000 7fa6edb99700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e80d0620 con 0x7fa6e80b0030 2023-08-25T04:45:33.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.690+0000 7fa6edb99700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e80d0060 con 0x7fa6e815d370 2023-08-25T04:45:33.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.691+0000 7fa6e6ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa6e80b0030 0x7fa6e80cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.691+0000 7fa6e6ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa6e80b0030 0x7fa6e80cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49926/0 (socket says 172.21.15.16:49926) 2023-08-25T04:45:33.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.691+0000 7fa6e7fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa6e80cdc40 0x7fa6e806b780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40340/0 (socket says 172.21.15.16:40340) 2023-08-25T04:45:33.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.691+0000 7fa6e6ffd700 1 -- 172.21.15.16:0/2153854676 learned_addr learned my addr 172.21.15.16:0/2153854676 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:33.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.691+0000 7fa6e77fe700 1 --2- 172.21.15.16:0/2153854676 >> v2:172.21.15.117:3300/0 conn(0x7fa6e815d370 0x7fa6e80d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.691+0000 7fa6e6ffd700 1 -- 172.21.15.16:0/2153854676 >> v2:172.21.15.117:3300/0 conn(0x7fa6e815d370 msgr2=0x7fa6e80d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:33.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.691+0000 7fa6e6ffd700 1 --2- 172.21.15.16:0/2153854676 >> v2:172.21.15.117:3300/0 conn(0x7fa6e815d370 0x7fa6e80d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.691+0000 7fa6e6ffd700 1 -- 172.21.15.16:0/2153854676 >> v1:172.21.15.16:6789/0 conn(0x7fa6e80cdc40 legacy=0x7fa6e806b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.691+0000 7fa6e67fc700 1 -- 172.21.15.16:0/2153854676 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737427539 0 0) 0x7fa6e80ce050 con 0x7fa6e80cdc40 2023-08-25T04:45:33.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.691+0000 7fa6e6ffd700 1 -- 172.21.15.16:0/2153854676 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e80d0340 con 0x7fa6e80b0030 2023-08-25T04:45:33.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.691+0000 7fa6e6ffd700 1 --2- 172.21.15.16:0/2153854676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e80b0030 0x7fa6e80cd700 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa6e809ed80 tx=0x7fa6d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eea9ea55f01e3e3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:33.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.691+0000 7fa6e67fc700 1 -- 172.21.15.16:0/2153854676 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0011830 con 0x7fa6e80b0030 2023-08-25T04:45:33.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.691+0000 7fa6e67fc700 1 -- 172.21.15.16:0/2153854676 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d0011990 con 0x7fa6e80b0030 2023-08-25T04:45:33.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.691+0000 7fa6e67fc700 1 -- 172.21.15.16:0/2153854676 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0011d20 con 0x7fa6e80b0030 2023-08-25T04:45:33.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.692+0000 7fa6edb99700 1 -- 172.21.15.16:0/2153854676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e80b0030 msgr2=0x7fa6e80cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.692+0000 7fa6edb99700 1 --2- 172.21.15.16:0/2153854676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e80b0030 0x7fa6e80cd700 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa6e809ed80 tx=0x7fa6d0009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.692+0000 7fa6edb99700 1 -- 172.21.15.16:0/2153854676 shutdown_connections 2023-08-25T04:45:33.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.692+0000 7fa6edb99700 1 --2- 172.21.15.16:0/2153854676 >> v2:172.21.15.117:3300/0 conn(0x7fa6e815d370 0x7fa6e80d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.692+0000 7fa6edb99700 1 --2- 172.21.15.16:0/2153854676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e80b0030 0x7fa6e80cd700 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.692+0000 7fa6edb99700 1 -- 172.21.15.16:0/2153854676 >> 172.21.15.16:0/2153854676 conn(0x7fa6e80d0e80 msgr2=0x7fa6e80d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:33.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.692+0000 7fa6edb99700 1 -- 172.21.15.16:0/2153854676 shutdown_connections 2023-08-25T04:45:33.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.692+0000 7fa6edb99700 1 -- 172.21.15.16:0/2153854676 wait complete. 2023-08-25T04:45:33.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.693+0000 7fa6edb99700 1 Processor -- start 2023-08-25T04:45:33.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.694+0000 7fa6edb99700 1 -- start start 2023-08-25T04:45:33.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6edb99700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e80b0030 0x7fa6e80b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6edb99700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6e80cdc40 0x7fa6e80c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6edb99700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6e815d370 0x7fa6e80c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6edb99700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e80b2770 con 0x7fa6e80b0030 2023-08-25T04:45:33.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6edb99700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e815ad30 con 0x7fa6e80cdc40 2023-08-25T04:45:33.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6edb99700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e815a120 con 0x7fa6e815d370 2023-08-25T04:45:33.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6e77fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e80b0030 0x7fa6e80b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6e77fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e80b0030 0x7fa6e80b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49930/0 (socket says 172.21.15.16:49930) 2023-08-25T04:45:33.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6e77fe700 1 -- 172.21.15.16:0/4003351213 learned_addr learned my addr 172.21.15.16:0/4003351213 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:33.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6e6ffd700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6e80cdc40 0x7fa6e80c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6e7fff700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6e815d370 0x7fa6e80c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6e77fe700 1 -- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6e815d370 msgr2=0x7fa6e80c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6e77fe700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6e815d370 0x7fa6e80c4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6e77fe700 1 -- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6e80cdc40 msgr2=0x7fa6e80c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6e77fe700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6e80cdc40 0x7fa6e80c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6e77fe700 1 -- 172.21.15.16:0/4003351213 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d0009550 con 0x7fa6e80b0030 2023-08-25T04:45:33.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6e6ffd700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6e80cdc40 0x7fa6e80c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:33.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6e77fe700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e80b0030 0x7fa6e80b2230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800e9c0 tx=0x7fa6d800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:33.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6dffff700 1 -- 172.21.15.16:0/4003351213 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d80096f0 con 0x7fa6e80b0030 2023-08-25T04:45:33.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6dffff700 1 -- 172.21.15.16:0/4003351213 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d800c850 con 0x7fa6e80b0030 2023-08-25T04:45:33.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6edb99700 1 -- 172.21.15.16:0/4003351213 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e815a400 con 0x7fa6e80b0030 2023-08-25T04:45:33.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6dffff700 1 -- 172.21.15.16:0/4003351213 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d800cbc0 con 0x7fa6e80b0030 2023-08-25T04:45:33.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.695+0000 7fa6edb99700 1 -- 172.21.15.16:0/4003351213 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e815a9c0 con 0x7fa6e80b0030 2023-08-25T04:45:33.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.696+0000 7fa6edb99700 1 -- 172.21.15.16:0/4003351213 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e815ab80 con 0x7fa6e80b0030 2023-08-25T04:45:33.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.697+0000 7fa6dffff700 1 -- 172.21.15.16:0/4003351213 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa6d800cd20 con 0x7fa6e80b0030 2023-08-25T04:45:33.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.697+0000 7fa6dffff700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa6c806a0e0 0x7fa6c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.697+0000 7fa6dffff700 1 -- 172.21.15.16:0/4003351213 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa6d8088b40 con 0x7fa6e80b0030 2023-08-25T04:45:33.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.698+0000 7fa6e6ffd700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa6c806a0e0 0x7fa6c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.698+0000 7fa6e6ffd700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa6c806a0e0 0x7fa6c806c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa6e815aff0 tx=0x7fa6d0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:33.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.702+0000 7fa6dffff700 1 -- 172.21.15.16:0/4003351213 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa6d8057c00 con 0x7fa6e80b0030 2023-08-25T04:45:33.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.906+0000 7fa6edb99700 1 -- 172.21.15.16:0/4003351213 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6e804ee70 con 0x7fa6e80b0030 2023-08-25T04:45:33.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.906+0000 7fa6dffff700 1 -- 172.21.15.16:0/4003351213 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6d8057790 con 0x7fa6e80b0030 2023-08-25T04:45:33.908 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-08-25T04:45:33.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.908+0000 7fa6edb99700 1 -- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa6c806a0e0 msgr2=0x7fa6c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.908+0000 7fa6edb99700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa6c806a0e0 0x7fa6c806c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa6e815aff0 tx=0x7fa6d0008030 comp rx=0 tx=0).stop 2023-08-25T04:45:33.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.908+0000 7fa6edb99700 1 -- 172.21.15.16:0/4003351213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e80b0030 msgr2=0x7fa6e80b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.908+0000 7fa6edb99700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e80b0030 0x7fa6e80b2230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800e9c0 tx=0x7fa6d800ed80 comp rx=0 tx=0).stop 2023-08-25T04:45:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.908+0000 7fa6edb99700 1 -- 172.21.15.16:0/4003351213 shutdown_connections 2023-08-25T04:45:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.908+0000 7fa6edb99700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa6c806a0e0 0x7fa6c806c5a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.908+0000 7fa6edb99700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6e815d370 0x7fa6e80c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.908+0000 7fa6edb99700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e80b0030 0x7fa6e80b2230 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.908+0000 7fa6edb99700 1 --2- 172.21.15.16:0/4003351213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6e80cdc40 0x7fa6e80c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.908+0000 7fa6edb99700 1 -- 172.21.15.16:0/4003351213 >> 172.21.15.16:0/4003351213 conn(0x7fa6e80d0e80 msgr2=0x7fa6e80cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:33.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.908+0000 7fa6edb99700 1 -- 172.21.15.16:0/4003351213 shutdown_connections 2023-08-25T04:45:33.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:33.908+0000 7fa6edb99700 1 -- 172.21.15.16:0/4003351213 wait complete. 2023-08-25T04:45:33.923 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:45:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.050+0000 7f77b9397700 1 Processor -- start 2023-08-25T04:45:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.050+0000 7f77b9397700 1 -- start start 2023-08-25T04:45:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.051+0000 7f77b9397700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f77b406e070 0x7f77b41617c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.051+0000 7f77b9397700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f77b406d110 0x7f77b415c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.051+0000 7f77b9397700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b4161d00 con 0x7f77b40aefa0 2023-08-25T04:45:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.051+0000 7f77b9397700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b40cd820 con 0x7f77b406d110 2023-08-25T04:45:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.051+0000 7f77b9397700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b40cdb00 con 0x7f77b406e070 2023-08-25T04:45:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.051+0000 7f77b37fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f77b406d110 0x7f77b415c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.052+0000 7f77b37fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f77b406d110 0x7f77b415c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49942/0 (socket says 172.21.15.16:49942) 2023-08-25T04:45:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.052+0000 7f77b37fe700 1 -- 172.21.15.16:0/1824546367 learned_addr learned my addr 172.21.15.16:0/1824546367 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.052+0000 7f77b27fc700 1 --2- 172.21.15.16:0/1824546367 >> v2:172.21.15.117:3300/0 conn(0x7f77b406e070 0x7f77b41617c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.052+0000 7f77b37fe700 1 -- 172.21.15.16:0/1824546367 >> v2:172.21.15.117:3300/0 conn(0x7f77b406e070 msgr2=0x7f77b41617c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.052+0000 7f77b37fe700 1 --2- 172.21.15.16:0/1824546367 >> v2:172.21.15.117:3300/0 conn(0x7f77b406e070 0x7f77b41617c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.052+0000 7f77b37fe700 1 -- 172.21.15.16:0/1824546367 >> v1:172.21.15.117:6789/0 conn(0x7f77b40aefa0 legacy=0x7f77b406ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.052+0000 7f77b37fe700 1 -- 172.21.15.16:0/1824546367 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b406ea70 con 0x7f77b406d110 2023-08-25T04:45:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.052+0000 7f77b37fe700 1 --2- 172.21.15.16:0/1824546367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b406d110 0x7f77b415c960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f77b4074290 tx=0x7f77a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfa3c7097456732 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.052+0000 7f77b1ffb700 1 -- 172.21.15.16:0/1824546367 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a400e070 con 0x7f77b406d110 2023-08-25T04:45:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.052+0000 7f77b1ffb700 1 -- 172.21.15.16:0/1824546367 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a400b910 con 0x7f77b406d110 2023-08-25T04:45:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.052+0000 7f77b1ffb700 1 -- 172.21.15.16:0/1824546367 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a400bcc0 con 0x7f77b406d110 2023-08-25T04:45:34.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.053+0000 7f77b9397700 1 -- 172.21.15.16:0/1824546367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b406d110 msgr2=0x7f77b415c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.053+0000 7f77b9397700 1 --2- 172.21.15.16:0/1824546367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b406d110 0x7f77b415c960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f77b4074290 tx=0x7f77a400b330 comp rx=0 tx=0).stop 2023-08-25T04:45:34.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.053+0000 7f77b9397700 1 -- 172.21.15.16:0/1824546367 shutdown_connections 2023-08-25T04:45:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.053+0000 7f77b9397700 1 --2- 172.21.15.16:0/1824546367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b406d110 0x7f77b415c960 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.053+0000 7f77b9397700 1 --2- 172.21.15.16:0/1824546367 >> v2:172.21.15.117:3300/0 conn(0x7f77b406e070 0x7f77b41617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.053+0000 7f77b9397700 1 -- 172.21.15.16:0/1824546367 >> 172.21.15.16:0/1824546367 conn(0x7f77b406b450 msgr2=0x7f77b406b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.053+0000 7f77b9397700 1 -- 172.21.15.16:0/1824546367 shutdown_connections 2023-08-25T04:45:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.053+0000 7f77b9397700 1 -- 172.21.15.16:0/1824546367 wait complete. 2023-08-25T04:45:34.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.054+0000 7f77b9397700 1 Processor -- start 2023-08-25T04:45:34.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.055+0000 7f77b9397700 1 -- start start 2023-08-25T04:45:34.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b9397700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b406d110 0x7f77b415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b9397700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77b40aefa0 0x7f77b41548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b9397700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77b415bee0 0x7f77b4158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b9397700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b40b3ba0 con 0x7f77b406d110 2023-08-25T04:45:34.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b9397700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4159100 con 0x7f77b415bee0 2023-08-25T04:45:34.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b9397700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b415dfd0 con 0x7f77b40aefa0 2023-08-25T04:45:34.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b406d110 0x7f77b415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b406d110 0x7f77b415d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49944/0 (socket says 172.21.15.16:49944) 2023-08-25T04:45:34.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b2ffd700 1 -- 172.21.15.16:0/1042584574 learned_addr learned my addr 172.21.15.16:0/1042584574 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:34.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b27fc700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77b40aefa0 0x7f77b41548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b37fe700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77b415bee0 0x7f77b4158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b2ffd700 1 -- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77b40aefa0 msgr2=0x7f77b41548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b2ffd700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77b40aefa0 0x7f77b41548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b2ffd700 1 -- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77b415bee0 msgr2=0x7f77b4158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.056+0000 7f77b2ffd700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77b415bee0 0x7f77b4158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.057+0000 7f77b2ffd700 1 -- 172.21.15.16:0/1042584574 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a4009b30 con 0x7f77b406d110 2023-08-25T04:45:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.057+0000 7f77b37fe700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77b415bee0 0x7f77b4158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.057+0000 7f77b2ffd700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b406d110 0x7f77b415d6d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00c490 tx=0x7f77ac00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.057+0000 7f77ab7fe700 1 -- 172.21.15.16:0/1042584574 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac0052d0 con 0x7f77b406d110 2023-08-25T04:45:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.057+0000 7f77ab7fe700 1 -- 172.21.15.16:0/1042584574 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac005450 con 0x7f77b406d110 2023-08-25T04:45:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.057+0000 7f77b9397700 1 -- 172.21.15.16:0/1042584574 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b40b3da0 con 0x7f77b406d110 2023-08-25T04:45:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.057+0000 7f77ab7fe700 1 -- 172.21.15.16:0/1042584574 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac006aa0 con 0x7f77b406d110 2023-08-25T04:45:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.057+0000 7f77b9397700 1 -- 172.21.15.16:0/1042584574 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b40b4360 con 0x7f77b406d110 2023-08-25T04:45:34.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.059+0000 7f77b9397700 1 -- 172.21.15.16:0/1042584574 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b404ee70 con 0x7f77b406d110 2023-08-25T04:45:34.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.059+0000 7f77ab7fe700 1 -- 172.21.15.16:0/1042584574 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f77ac003680 con 0x7f77b406d110 2023-08-25T04:45:34.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.060+0000 7f77ab7fe700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f779406a0e0 0x7f779406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.060+0000 7f77ab7fe700 1 -- 172.21.15.16:0/1042584574 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f77ac0876e0 con 0x7f77b406d110 2023-08-25T04:45:34.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.060+0000 7f77b27fc700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f779406a0e0 0x7f779406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.061+0000 7f77b27fc700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f779406a0e0 0x7f779406c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f77b40ac820 tx=0x7f779c009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.066+0000 7f77ab7fe700 1 -- 172.21.15.16:0/1042584574 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f77ac052d10 con 0x7f77b406d110 2023-08-25T04:45:34.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.369+0000 7f77b9397700 1 -- 172.21.15.16:0/1042584574 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77b4161d00 con 0x7f77b406d110 2023-08-25T04:45:34.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.370+0000 7f77ab7fe700 1 -- 172.21.15.16:0/1042584574 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77b4161d00 con 0x7f77b406d110 2023-08-25T04:45:34.371 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-08-25T04:45:34.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.373+0000 7f77b9397700 1 -- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f779406a0e0 msgr2=0x7f779406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.373+0000 7f77b9397700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f779406a0e0 0x7f779406c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f77b40ac820 tx=0x7f779c009210 comp rx=0 tx=0).stop 2023-08-25T04:45:34.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.373+0000 7f77b9397700 1 -- 172.21.15.16:0/1042584574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b406d110 msgr2=0x7f77b415d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.373+0000 7f77b9397700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b406d110 0x7f77b415d6d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00c490 tx=0x7f77ac00c7a0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.373+0000 7f77b9397700 1 -- 172.21.15.16:0/1042584574 shutdown_connections 2023-08-25T04:45:34.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.373+0000 7f77b9397700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f779406a0e0 0x7f779406c5a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.373+0000 7f77b9397700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77b415bee0 0x7f77b4158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.373+0000 7f77b9397700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b406d110 0x7f77b415d6d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.373+0000 7f77b9397700 1 --2- 172.21.15.16:0/1042584574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77b40aefa0 0x7f77b41548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.373+0000 7f77b9397700 1 -- 172.21.15.16:0/1042584574 >> 172.21.15.16:0/1042584574 conn(0x7f77b406b450 msgr2=0x7f77b40b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:34.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.374+0000 7f77b9397700 1 -- 172.21.15.16:0/1042584574 shutdown_connections 2023-08-25T04:45:34.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.374+0000 7f77b9397700 1 -- 172.21.15.16:0/1042584574 wait complete. 2023-08-25T04:45:34.392 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:45:34.445 INFO:tasks.workunit.client.0.smithi016.stdout:Try to write 26214400 2023-08-25T04:45:34.446 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 1 2023-08-25T04:45:34.446 INFO:tasks.workunit.client.0.smithi016.stderr:+ return 0 2023-08-25T04:45:34.446 INFO:tasks.workunit.client.0.smithi016.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-08-25T04:45:34.447 INFO:tasks.workunit.client.2.smithi016.stdout:Try to write 26214400 2023-08-25T04:45:34.447 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 1 2023-08-25T04:45:34.447 INFO:tasks.workunit.client.2.smithi016.stderr:+ return 0 2023-08-25T04:45:34.448 INFO:tasks.workunit.client.2.smithi016.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-08-25T04:45:34.448 INFO:tasks.workunit.client.0.smithi016.stdout:ancestor/p1/p2/parent/p3/file1 25165824 2023-08-25T04:45:34.449 INFO:tasks.workunit.client.0.smithi016.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-08-25T04:45:34.449 INFO:tasks.workunit.client.2.smithi016.stdout:ancestor/p1/p2/parent/p3/file1 25165824 2023-08-25T04:45:34.449 INFO:tasks.workunit.client.2.smithi016.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-08-25T04:45:34.450 INFO:tasks.workunit.client.0.smithi016.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-08-25T04:45:34.450 INFO:tasks.workunit.client.2.smithi016.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-08-25T04:45:34.451 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:45:34.452 INFO:tasks.workunit.client.0.smithi016.stderr:setfattr: .: Invalid argument 2023-08-25T04:45:34.452 INFO:tasks.workunit:Stopping ['fs/quota'] on client.0... 2023-08-25T04:45:34.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-08-25T04:45:34.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:45:34.454 INFO:tasks.workunit.client.2.smithi016.stderr:setfattr: .: Invalid argument 2023-08-25T04:45:34.454 INFO:tasks.workunit:Stopping ['fs/quota'] on client.2... 2023-08-25T04:45:34.455 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.2 /home/ubuntu/cephtest/clone.client.2 2023-08-25T04:45:34.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.577+0000 7ff94cb29700 1 Processor -- start 2023-08-25T04:45:34.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.577+0000 7ff94cb29700 1 -- start start 2023-08-25T04:45:34.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.578+0000 7ff94cb29700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff94806a340 0x7ff94806a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.578+0000 7ff94cb29700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9480713e0 con 0x7ff94815e670 2023-08-25T04:45:34.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.578+0000 7ff94cb29700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94815ea50 con 0x7ff9480b2d10 2023-08-25T04:45:34.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.578+0000 7ff94cb29700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94806ad00 con 0x7ff94806a340 2023-08-25T04:45:34.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.579+0000 7ff945d9b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff94806a340 0x7ff94806a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.579+0000 7ff945d9b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff94806a340 0x7ff94806a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:50494/0 (socket says 172.21.15.16:50494) 2023-08-25T04:45:34.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.579+0000 7ff945d9b700 1 -- 172.21.15.16:0/2706068705 learned_addr learned my addr 172.21.15.16:0/2706068705 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:34.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.579+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315446288 0 0) 0x7ff94815ea50 con 0x7ff9480b2d10 2023-08-25T04:45:34.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.579+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9300035b0 con 0x7ff9480b2d10 2023-08-25T04:45:34.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.579+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459250815 0 0) 0x7ff9480713e0 con 0x7ff94815e670 2023-08-25T04:45:34.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.579+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff94815ea50 con 0x7ff94815e670 2023-08-25T04:45:34.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.579+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2907500950 0 0) 0x7ff9300035b0 con 0x7ff9480b2d10 2023-08-25T04:45:34.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.579+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff94806a340 msgr2=0x7ff94806a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:34.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.579+0000 7ff94559a700 1 --2- 172.21.15.16:0/2706068705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff94806a340 0x7ff94806a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.579+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 >> v1:172.21.15.16:6789/0 conn(0x7ff94815e670 legacy=0x7ff9480ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff948072030 con 0x7ff9480b2d10 2023-08-25T04:45:34.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7ff9400019f0 con 0x7ff9480b2d10 2023-08-25T04:45:34.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 >> v1:172.21.15.117:6789/0 conn(0x7ff9480b2d10 legacy=0x7ff9480b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94559a700 1 --2- 172.21.15.16:0/2706068705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff930003c00 0x7ff930004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94559a700 1 --2- 172.21.15.16:0/2706068705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff930004850 0x7ff930004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94559a700 1 --2- 172.21.15.16:0/2706068705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff930005210 0x7ff93000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94806ad00 con 0x7ff930005210 2023-08-25T04:45:34.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93000c0b0 con 0x7ff930003c00 2023-08-25T04:45:34.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93000c270 con 0x7ff930004850 2023-08-25T04:45:34.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94659c700 1 --2- 172.21.15.16:0/2706068705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff930003c00 0x7ff930004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff946d9d700 1 --2- 172.21.15.16:0/2706068705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff930005210 0x7ff93000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94659c700 1 -- 172.21.15.16:0/2706068705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff930004850 msgr2=0x7ff930004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:45:34.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94659c700 1 --2- 172.21.15.16:0/2706068705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff930004850 0x7ff930004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.588 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94659c700 1 -- 172.21.15.16:0/2706068705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff930005210 msgr2=0x7ff93000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:34.588 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94659c700 1 --2- 172.21.15.16:0/2706068705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff930005210 0x7ff93000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.588 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94659c700 1 -- 172.21.15.16:0/2706068705 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff948072030 con 0x7ff930003c00 2023-08-25T04:45:34.588 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff946d9d700 1 --2- 172.21.15.16:0/2706068705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff930005210 0x7ff93000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:34.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.580+0000 7ff94659c700 1 --2- 172.21.15.16:0/2706068705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff930003c00 0x7ff930004000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff938001980 tx=0x7ff930005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b1a1599ce9980f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:34.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.581+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938001440 con 0x7ff930003c00 2023-08-25T04:45:34.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.581+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9380052d0 con 0x7ff930003c00 2023-08-25T04:45:34.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.581+0000 7ff94559a700 1 -- 172.21.15.16:0/2706068705 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938006860 con 0x7ff930003c00 2023-08-25T04:45:34.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.582+0000 7ff94cb29700 1 -- 172.21.15.16:0/2706068705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff930003c00 msgr2=0x7ff930004000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.582+0000 7ff94cb29700 1 --2- 172.21.15.16:0/2706068705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff930003c00 0x7ff930004000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff938001980 tx=0x7ff930005880 comp rx=0 tx=0).stop 2023-08-25T04:45:34.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.582+0000 7ff946d9d700 1 -- 172.21.15.16:0/2706068705 reap_dead start 2023-08-25T04:45:34.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.582+0000 7ff94cb29700 1 -- 172.21.15.16:0/2706068705 shutdown_connections 2023-08-25T04:45:34.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.582+0000 7ff94cb29700 1 -- 172.21.15.16:0/2706068705 >> 172.21.15.16:0/2706068705 conn(0x7ff9480b1a10 msgr2=0x7ff9480b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:34.592 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.582+0000 7ff94cb29700 1 -- 172.21.15.16:0/2706068705 shutdown_connections 2023-08-25T04:45:34.592 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.582+0000 7ff94cb29700 1 -- 172.21.15.16:0/2706068705 wait complete. 2023-08-25T04:45:34.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.584+0000 7ff94cb29700 1 Processor -- start 2023-08-25T04:45:34.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.584+0000 7ff94cb29700 1 -- start start 2023-08-25T04:45:34.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.585+0000 7ff94cb29700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff930003c00 0x7ff948158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.585+0000 7ff94cb29700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff948148eb0 0x7ff948149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.585+0000 7ff94cb29700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff948155590 0x7ff9481559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.585+0000 7ff94cb29700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480c72d0 con 0x7ff930003c00 2023-08-25T04:45:34.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.585+0000 7ff94cb29700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff948156300 con 0x7ff948148eb0 2023-08-25T04:45:34.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.585+0000 7ff94cb29700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9481565e0 con 0x7ff948155590 2023-08-25T04:45:34.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.585+0000 7ff94659c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff930003c00 0x7ff948158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.585+0000 7ff945d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff948148eb0 0x7ff948149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.585+0000 7ff945d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff948148eb0 0x7ff948149330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:37294/0 (socket says 172.21.15.16:37294) 2023-08-25T04:45:34.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.585+0000 7ff94659c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff930003c00 0x7ff948158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49962/0 (socket says 172.21.15.16:49962) 2023-08-25T04:45:34.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.585+0000 7ff945d9b700 1 -- 172.21.15.16:0/2506903909 learned_addr learned my addr 172.21.15.16:0/2506903909 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:34.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.585+0000 7ff946d9d700 1 --2- 172.21.15.16:0/2506903909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff948155590 0x7ff9481559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.586+0000 7ff945d9b700 1 -- 172.21.15.16:0/2506903909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff948155590 msgr2=0x7ff9481559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.586+0000 7ff945d9b700 1 --2- 172.21.15.16:0/2506903909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff948155590 0x7ff9481559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.586+0000 7ff945d9b700 1 -- 172.21.15.16:0/2506903909 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff930003c00 msgr2=0x7ff948158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.586+0000 7ff945d9b700 1 --2- 172.21.15.16:0/2506903909 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff930003c00 0x7ff948158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.597 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.586+0000 7ff945d9b700 1 -- 172.21.15.16:0/2506903909 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9481568c0 con 0x7ff948148eb0 2023-08-25T04:45:34.597 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.586+0000 7ff945d9b700 1 --2- 172.21.15.16:0/2506903909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff948148eb0 0x7ff948149330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00ba10 tx=0x7ff93c00bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:34.597 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.586+0000 7ff936ffd700 1 -- 172.21.15.16:0/2506903909 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0119d0 con 0x7ff948148eb0 2023-08-25T04:45:34.597 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.586+0000 7ff936ffd700 1 -- 172.21.15.16:0/2506903909 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c013040 con 0x7ff948148eb0 2023-08-25T04:45:34.597 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.586+0000 7ff94cb29700 1 -- 172.21.15.16:0/2506903909 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff948156ba0 con 0x7ff948148eb0 2023-08-25T04:45:34.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.586+0000 7ff936ffd700 1 -- 172.21.15.16:0/2506903909 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c011d90 con 0x7ff948148eb0 2023-08-25T04:45:34.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.586+0000 7ff94cb29700 1 -- 172.21.15.16:0/2506903909 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff948155f30 con 0x7ff948148eb0 2023-08-25T04:45:34.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.588+0000 7ff94cb29700 1 -- 172.21.15.16:0/2506903909 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9480c74a0 con 0x7ff948148eb0 2023-08-25T04:45:34.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.588+0000 7ff936ffd700 1 -- 172.21.15.16:0/2506903909 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff93c019400 con 0x7ff948148eb0 2023-08-25T04:45:34.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.589+0000 7ff936ffd700 1 --2- 172.21.15.16:0/2506903909 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7ff92806a0e0 0x7ff92806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.589+0000 7ff936ffd700 1 -- 172.21.15.16:0/2506903909 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff93c08c170 con 0x7ff948148eb0 2023-08-25T04:45:34.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.589+0000 7ff94659c700 1 --2- 172.21.15.16:0/2506903909 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7ff92806a0e0 0x7ff92806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.590+0000 7ff94659c700 1 --2- 172.21.15.16:0/2506903909 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7ff92806a0e0 0x7ff92806c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff938005040 tx=0x7ff938011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:34.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.595+0000 7ff936ffd700 1 -- 172.21.15.16:0/2506903909 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff9480c74a0 con 0x7ff948148eb0 2023-08-25T04:45:34.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.960+0000 7ff94cb29700 1 -- 172.21.15.16:0/2506903909 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff9481560c0 con 0x7ff948148eb0 2023-08-25T04:45:34.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.961+0000 7ff936ffd700 1 -- 172.21.15.16:0/2506903909 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff9481560c0 con 0x7ff948148eb0 2023-08-25T04:45:34.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.964+0000 7ff94cb29700 1 -- 172.21.15.16:0/2506903909 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7ff92806a0e0 msgr2=0x7ff92806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.964+0000 7ff94cb29700 1 --2- 172.21.15.16:0/2506903909 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7ff92806a0e0 0x7ff92806c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff938005040 tx=0x7ff938011000 comp rx=0 tx=0).stop 2023-08-25T04:45:34.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.964+0000 7ff94cb29700 1 -- 172.21.15.16:0/2506903909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff948148eb0 msgr2=0x7ff948149330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.964+0000 7ff94cb29700 1 --2- 172.21.15.16:0/2506903909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff948148eb0 0x7ff948149330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00ba10 tx=0x7ff93c00bd20 comp rx=0 tx=0).stop 2023-08-25T04:45:34.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.964+0000 7ff94cb29700 1 -- 172.21.15.16:0/2506903909 shutdown_connections 2023-08-25T04:45:34.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.964+0000 7ff94cb29700 1 --2- 172.21.15.16:0/2506903909 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7ff92806a0e0 0x7ff92806c5a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.964+0000 7ff94cb29700 1 --2- 172.21.15.16:0/2506903909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff948155590 0x7ff9481559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.964+0000 7ff94cb29700 1 --2- 172.21.15.16:0/2506903909 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff930003c00 0x7ff948158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.964+0000 7ff94cb29700 1 --2- 172.21.15.16:0/2506903909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff948148eb0 0x7ff948149330 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.964+0000 7ff94cb29700 1 -- 172.21.15.16:0/2506903909 >> 172.21.15.16:0/2506903909 conn(0x7ff9480b1a10 msgr2=0x7ff9480cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:34.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.964+0000 7ff94cb29700 1 -- 172.21.15.16:0/2506903909 shutdown_connections 2023-08-25T04:45:34.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:34.964+0000 7ff94cb29700 1 -- 172.21.15.16:0/2506903909 wait complete. 2023-08-25T04:45:34.968 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2023-08-25T04:45:34.981 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T04:45:34.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:34.982 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-25T04:45:35.242 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2023-08-25T04:45:35.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:35.243 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T04:45:35.290 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:45:35.290 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:45:35.312 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-08-25T04:45:35.312 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:45:35.374 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:35.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.595+0000 7f43d71d4700 1 Processor -- start 2023-08-25T04:45:35.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.595+0000 7f43d71d4700 1 -- start start 2023-08-25T04:45:35.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.596+0000 7f43d71d4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f43d015e670 0x7f43d00ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:35.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.596+0000 7f43d71d4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43d006a7f0 0x7f43d00ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:35.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.596+0000 7f43d71d4700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d00713e0 con 0x7f43d006a340 2023-08-25T04:45:35.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.596+0000 7f43d71d4700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d00b3d20 con 0x7f43d015e670 2023-08-25T04:45:35.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.596+0000 7f43d71d4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d015ea50 con 0x7f43d006a7f0 2023-08-25T04:45:35.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.597+0000 7f43cffff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f43d006a340 0x7f43d00cc820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40386/0 (socket says 172.21.15.16:40386) 2023-08-25T04:45:35.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.597+0000 7f43cffff700 1 -- 172.21.15.16:0/977353854 learned_addr learned my addr 172.21.15.16:0/977353854 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:35.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.597+0000 7f43d5771700 1 --2- 172.21.15.16:0/977353854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43d006a7f0 0x7f43d00ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:35.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.597+0000 7f43d4f70700 1 --2- 172.21.15.16:0/977353854 >> v2:172.21.15.117:3300/0 conn(0x7f43d015e670 0x7f43d00ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:35.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.597+0000 7f43cf7fe700 1 -- 172.21.15.16:0/977353854 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937397015 0 0) 0x7f43d00713e0 con 0x7f43d006a340 2023-08-25T04:45:35.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.597+0000 7f43d5771700 1 -- 172.21.15.16:0/977353854 >> v2:172.21.15.117:3300/0 conn(0x7f43d015e670 msgr2=0x7f43d00ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:35.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.597+0000 7f43d5771700 1 --2- 172.21.15.16:0/977353854 >> v2:172.21.15.117:3300/0 conn(0x7f43d015e670 0x7f43d00ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:35.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.597+0000 7f43d5771700 1 -- 172.21.15.16:0/977353854 >> v1:172.21.15.16:6789/0 conn(0x7f43d006a340 legacy=0x7f43d00cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:35.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.597+0000 7f43d5771700 1 -- 172.21.15.16:0/977353854 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d00ca9d0 con 0x7f43d006a7f0 2023-08-25T04:45:35.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.597+0000 7f43d4f70700 1 --2- 172.21.15.16:0/977353854 >> v2:172.21.15.117:3300/0 conn(0x7f43d015e670 0x7f43d00ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:35.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.597+0000 7f43d5771700 1 --2- 172.21.15.16:0/977353854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43d006a7f0 0x7f43d00ccf30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009d90 tx=0x7f43c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3e617a8dea169a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:35.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.598+0000 7f43cf7fe700 1 -- 172.21.15.16:0/977353854 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c800e070 con 0x7f43d006a7f0 2023-08-25T04:45:35.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.598+0000 7f43cf7fe700 1 -- 172.21.15.16:0/977353854 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c800bb20 con 0x7f43d006a7f0 2023-08-25T04:45:35.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.598+0000 7f43cf7fe700 1 -- 172.21.15.16:0/977353854 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8012430 con 0x7f43d006a7f0 2023-08-25T04:45:35.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.598+0000 7f43d71d4700 1 -- 172.21.15.16:0/977353854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43d006a7f0 msgr2=0x7f43d00ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:35.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.598+0000 7f43d71d4700 1 --2- 172.21.15.16:0/977353854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43d006a7f0 0x7f43d00ccf30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009d90 tx=0x7f43c800b330 comp rx=0 tx=0).stop 2023-08-25T04:45:35.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.599+0000 7f43d71d4700 1 -- 172.21.15.16:0/977353854 shutdown_connections 2023-08-25T04:45:35.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.599+0000 7f43d71d4700 1 --2- 172.21.15.16:0/977353854 >> v2:172.21.15.117:3300/0 conn(0x7f43d015e670 0x7f43d00ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:35.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.599+0000 7f43d71d4700 1 --2- 172.21.15.16:0/977353854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43d006a7f0 0x7f43d00ccf30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:35.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.599+0000 7f43d71d4700 1 -- 172.21.15.16:0/977353854 >> 172.21.15.16:0/977353854 conn(0x7f43d00b1a10 msgr2=0x7f43d00b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:35.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.599+0000 7f43d71d4700 1 -- 172.21.15.16:0/977353854 shutdown_connections 2023-08-25T04:45:35.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.599+0000 7f43d71d4700 1 -- 172.21.15.16:0/977353854 wait complete. 2023-08-25T04:45:35.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.601+0000 7f43d71d4700 1 Processor -- start 2023-08-25T04:45:35.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.601+0000 7f43d71d4700 1 -- start start 2023-08-25T04:45:35.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.602+0000 7f43d71d4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43d006a340 0x7f43d015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:35.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.602+0000 7f43d71d4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43d006a7f0 0x7f43d0151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:35.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.602+0000 7f43d71d4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d015e670 0x7f43d00cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:35.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.602+0000 7f43d71d4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d01593b0 con 0x7f43d015e670 2023-08-25T04:45:35.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.602+0000 7f43d71d4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d0159690 con 0x7f43d006a7f0 2023-08-25T04:45:35.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.602+0000 7f43d71d4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d0159970 con 0x7f43d006a340 2023-08-25T04:45:35.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.603+0000 7f43d5771700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d015e670 0x7f43d00cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:35.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.603+0000 7f43cffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43d006a7f0 0x7f43d0151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:35.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.603+0000 7f43d5771700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d015e670 0x7f43d00cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49982/0 (socket says 172.21.15.16:49982) 2023-08-25T04:45:35.608 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.603+0000 7f43d5771700 1 -- 172.21.15.16:0/2564469664 learned_addr learned my addr 172.21.15.16:0/2564469664 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:35.608 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.603+0000 7f43d4f70700 1 --2- 172.21.15.16:0/2564469664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43d006a340 0x7f43d015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:35.608 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.603+0000 7f43d5771700 1 -- 172.21.15.16:0/2564469664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43d006a340 msgr2=0x7f43d015a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:35.608 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.603+0000 7f43d5771700 1 --2- 172.21.15.16:0/2564469664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43d006a340 0x7f43d015a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:35.608 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.603+0000 7f43d5771700 1 -- 172.21.15.16:0/2564469664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43d006a7f0 msgr2=0x7f43d0151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:35.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.603+0000 7f43d5771700 1 --2- 172.21.15.16:0/2564469664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43d006a7f0 0x7f43d0151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:35.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.603+0000 7f43d5771700 1 -- 172.21.15.16:0/2564469664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c40094a0 con 0x7f43d015e670 2023-08-25T04:45:35.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.603+0000 7f43d5771700 1 --2- 172.21.15.16:0/2564469664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d015e670 0x7f43d00cea60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f43d0071c20 tx=0x7f43c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:35.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.604+0000 7f43cd7fa700 1 -- 172.21.15.16:0/2564469664 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8012430 con 0x7f43d015e670 2023-08-25T04:45:35.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.604+0000 7f43cd7fa700 1 -- 172.21.15.16:0/2564469664 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c8020070 con 0x7f43d015e670 2023-08-25T04:45:35.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.604+0000 7f43cd7fa700 1 -- 172.21.15.16:0/2564469664 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8004280 con 0x7f43d015e670 2023-08-25T04:45:35.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.604+0000 7f43d71d4700 1 -- 172.21.15.16:0/2564469664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c8009a70 con 0x7f43d015e670 2023-08-25T04:45:35.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.604+0000 7f43d71d4700 1 -- 172.21.15.16:0/2564469664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d0159f30 con 0x7f43d015e670 2023-08-25T04:45:35.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.606+0000 7f43cd7fa700 1 -- 172.21.15.16:0/2564469664 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f43c80043e0 con 0x7f43d015e670 2023-08-25T04:45:35.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.606+0000 7f43d71d4700 1 -- 172.21.15.16:0/2564469664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b00052f0 con 0x7f43d015e670 2023-08-25T04:45:35.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.607+0000 7f43cd7fa700 1 --2- 172.21.15.16:0/2564469664 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f43b406a1b0 0x7f43b406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:35.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.607+0000 7f43cd7fa700 1 -- 172.21.15.16:0/2564469664 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f43c8022070 con 0x7f43d015e670 2023-08-25T04:45:35.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.607+0000 7f43d4f70700 1 --2- 172.21.15.16:0/2564469664 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f43b406a1b0 0x7f43b406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:35.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.608+0000 7f43d4f70700 1 --2- 172.21.15.16:0/2564469664 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f43b406a1b0 0x7f43b406c670 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009cd0 tx=0x7f43c4009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:35.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.614+0000 7f43cd7fa700 1 -- 172.21.15.16:0/2564469664 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f43c8055d40 con 0x7f43d015e670 2023-08-25T04:45:35.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.982+0000 7f43d71d4700 1 -- 172.21.15.16:0/2564469664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43b00055a0 con 0x7f43d015e670 2023-08-25T04:45:35.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.984+0000 7f43cd7fa700 1 -- 172.21.15.16:0/2564469664 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18329 (secure 0 0 0) 0x7f43c8059360 con 0x7f43d015e670 2023-08-25T04:45:35.985 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:45:35.986 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:44:30.464568+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:43:40.197381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:43:41.268759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:35.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.987+0000 7f43d71d4700 1 -- 172.21.15.16:0/2564469664 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f43b406a1b0 msgr2=0x7f43b406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.987+0000 7f43d71d4700 1 --2- 172.21.15.16:0/2564469664 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f43b406a1b0 0x7f43b406c670 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009cd0 tx=0x7f43c4009210 comp rx=0 tx=0).stop 2023-08-25T04:45:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.987+0000 7f43d71d4700 1 -- 172.21.15.16:0/2564469664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d015e670 msgr2=0x7f43d00cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.987+0000 7f43d71d4700 1 --2- 172.21.15.16:0/2564469664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d015e670 0x7f43d00cea60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f43d0071c20 tx=0x7f43c8004ad0 comp rx=0 tx=0).stop 2023-08-25T04:45:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.987+0000 7f43d71d4700 1 -- 172.21.15.16:0/2564469664 shutdown_connections 2023-08-25T04:45:35.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.987+0000 7f43d71d4700 1 --2- 172.21.15.16:0/2564469664 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f43b406a1b0 0x7f43b406c670 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:35.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.987+0000 7f43d71d4700 1 --2- 172.21.15.16:0/2564469664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d015e670 0x7f43d00cea60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:35.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.988+0000 7f43d71d4700 1 --2- 172.21.15.16:0/2564469664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43d006a340 0x7f43d015a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:35.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.988+0000 7f43d71d4700 1 --2- 172.21.15.16:0/2564469664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43d006a7f0 0x7f43d0151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:35.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.988+0000 7f43d71d4700 1 -- 172.21.15.16:0/2564469664 >> 172.21.15.16:0/2564469664 conn(0x7f43d00b1a10 msgr2=0x7f43d006ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:35.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.988+0000 7f43d71d4700 1 -- 172.21.15.16:0/2564469664 shutdown_connections 2023-08-25T04:45:35.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:35.988+0000 7f43d71d4700 1 -- 172.21.15.16:0/2564469664 wait complete. 2023-08-25T04:45:36.009 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:43:34.951742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:43:35.360236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:43:40.197381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:43:41.268759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:45:36.010 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:45:36.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.213+0000 7f31acb22700 1 Processor -- start 2023-08-25T04:45:36.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.213+0000 7f31acb22700 1 -- start start 2023-08-25T04:45:36.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.214+0000 7f31acb22700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f31a8070eb0 0x7f31a8071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.214+0000 7f31acb22700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a815b0b0 con 0x7f31a8143420 2023-08-25T04:45:36.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.214+0000 7f31acb22700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a815a4c0 con 0x7f31a80ce510 2023-08-25T04:45:36.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.214+0000 7f31acb22700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a815a780 con 0x7f31a8070eb0 2023-08-25T04:45:36.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.214+0000 7f31a659c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f31a8070eb0 0x7f31a8071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.214+0000 7f31a659c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f31a8070eb0 0x7f31a8071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49986/0 (socket says 172.21.15.16:49986) 2023-08-25T04:45:36.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.214+0000 7f31a659c700 1 -- 172.21.15.16:0/3166028984 learned_addr learned my addr 172.21.15.16:0/3166028984 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:36.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.214+0000 7f31a6d9d700 1 --1- 172.21.15.16:0/3166028984 >> v1:172.21.15.117:6789/0 conn(0x7f31a80ce510 0x7f31a80ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.16:48500/0 (socket says 172.21.15.16:48500) 2023-08-25T04:45:36.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.215+0000 7f31a659c700 1 -- 172.21.15.16:0/3166028984 >> v1:172.21.15.117:6789/0 conn(0x7f31a80ce510 legacy=0x7f31a80ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:36.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.215+0000 7f31a659c700 1 -- 172.21.15.16:0/3166028984 >> v1:172.21.15.16:6789/0 conn(0x7f31a8143420 legacy=0x7f31a8071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.215+0000 7f31a659c700 1 -- 172.21.15.16:0/3166028984 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a815aa60 con 0x7f31a8070eb0 2023-08-25T04:45:36.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.216+0000 7f31a659c700 1 --2- 172.21.15.16:0/3166028984 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31a8070eb0 0x7f31a8071c00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009e50 tx=0x7f31a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c7a09834e2dae9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:36.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.216+0000 7f31a559a700 1 -- 172.21.15.16:0/3166028984 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a000e070 con 0x7f31a8070eb0 2023-08-25T04:45:36.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.216+0000 7f31a559a700 1 -- 172.21.15.16:0/3166028984 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a0003a20 con 0x7f31a8070eb0 2023-08-25T04:45:36.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.216+0000 7f31a559a700 1 -- 172.21.15.16:0/3166028984 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0003db0 con 0x7f31a8070eb0 2023-08-25T04:45:36.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.217+0000 7f31acb22700 1 -- 172.21.15.16:0/3166028984 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31a8070eb0 msgr2=0x7f31a8071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.217+0000 7f31acb22700 1 --2- 172.21.15.16:0/3166028984 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31a8070eb0 0x7f31a8071c00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009e50 tx=0x7f31a000b330 comp rx=0 tx=0).stop 2023-08-25T04:45:36.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.218+0000 7f31acb22700 1 -- 172.21.15.16:0/3166028984 shutdown_connections 2023-08-25T04:45:36.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.218+0000 7f31acb22700 1 --2- 172.21.15.16:0/3166028984 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31a8070eb0 0x7f31a8071c00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.218+0000 7f31acb22700 1 -- 172.21.15.16:0/3166028984 >> 172.21.15.16:0/3166028984 conn(0x7f31a80cfe00 msgr2=0x7f31a80d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:36.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.219+0000 7f31acb22700 1 -- 172.21.15.16:0/3166028984 shutdown_connections 2023-08-25T04:45:36.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.219+0000 7f31acb22700 1 -- 172.21.15.16:0/3166028984 wait complete. 2023-08-25T04:45:36.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.221+0000 7f31acb22700 1 Processor -- start 2023-08-25T04:45:36.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.221+0000 7f31acb22700 1 -- start start 2023-08-25T04:45:36.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.222+0000 7f31acb22700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31a8070eb0 0x7f31a8159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.222+0000 7f31acb22700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31a80ce510 0x7f31a80b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.222+0000 7f31acb22700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a8143420 0x7f31a81e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.223+0000 7f31acb22700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a81e5d20 con 0x7f31a80ce510 2023-08-25T04:45:36.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.223+0000 7f31acb22700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80b5480 con 0x7f31a8070eb0 2023-08-25T04:45:36.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.223+0000 7f31acb22700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80b5760 con 0x7f31a8143420 2023-08-25T04:45:36.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.223+0000 7f31a659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31a8070eb0 0x7f31a8159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.223+0000 7f31a659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31a8070eb0 0x7f31a8159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:37322/0 (socket says 172.21.15.16:37322) 2023-08-25T04:45:36.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.223+0000 7f31a659c700 1 -- 172.21.15.16:0/1098894038 learned_addr learned my addr 172.21.15.16:0/1098894038 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:36.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.223+0000 7f31a5d9b700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31a80ce510 0x7f31a80b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.223+0000 7f31a6d9d700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a8143420 0x7f31a81e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.223+0000 7f31a659c700 1 -- 172.21.15.16:0/1098894038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a8143420 msgr2=0x7f31a81e4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.223+0000 7f31a659c700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a8143420 0x7f31a81e4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.223+0000 7f31a659c700 1 -- 172.21.15.16:0/1098894038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31a80ce510 msgr2=0x7f31a80b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.223+0000 7f31a659c700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31a80ce510 0x7f31a80b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.223+0000 7f31a659c700 1 -- 172.21.15.16:0/1098894038 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a0009b30 con 0x7f31a8070eb0 2023-08-25T04:45:36.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.223+0000 7f31a5d9b700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31a80ce510 0x7f31a80b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:36.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.224+0000 7f31a659c700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31a8070eb0 0x7f31a8159830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f31a80741c0 tx=0x7f31a0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:36.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.225+0000 7f3196ffd700 1 -- 172.21.15.16:0/1098894038 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0004440 con 0x7f31a8070eb0 2023-08-25T04:45:36.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.225+0000 7f3196ffd700 1 -- 172.21.15.16:0/1098894038 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a00045a0 con 0x7f31a8070eb0 2023-08-25T04:45:36.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.225+0000 7f31acb22700 1 -- 172.21.15.16:0/1098894038 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a80b5a40 con 0x7f31a8070eb0 2023-08-25T04:45:36.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.225+0000 7f3196ffd700 1 -- 172.21.15.16:0/1098894038 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0004950 con 0x7f31a8070eb0 2023-08-25T04:45:36.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.225+0000 7f31acb22700 1 -- 172.21.15.16:0/1098894038 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a81e49e0 con 0x7f31a8070eb0 2023-08-25T04:45:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.226+0000 7f31acb22700 1 -- 172.21.15.16:0/1098894038 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a80b58a0 con 0x7f31a8070eb0 2023-08-25T04:45:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.227+0000 7f3196ffd700 1 -- 172.21.15.16:0/1098894038 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f31a001c440 con 0x7f31a8070eb0 2023-08-25T04:45:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.228+0000 7f3196ffd700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f318806a130 0x7f318806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.228+0000 7f3196ffd700 1 -- 172.21.15.16:0/1098894038 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f31a0089740 con 0x7f31a8070eb0 2023-08-25T04:45:36.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.231+0000 7f31a5d9b700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f318806a130 0x7f318806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.232+0000 7f31a5d9b700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f318806a130 0x7f318806c5f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3198001bf0 tx=0x7f3198009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.235+0000 7f3196ffd700 1 -- 172.21.15.16:0/1098894038 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f31a80b58a0 con 0x7f31a8070eb0 2023-08-25T04:45:36.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.625+0000 7f31acb22700 1 -- 172.21.15.16:0/1098894038 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f31a80b58a0 con 0x7f31a8070eb0 2023-08-25T04:45:36.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.625+0000 7f3196ffd700 1 -- 172.21.15.16:0/1098894038 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f31a80b58a0 con 0x7f31a8070eb0 2023-08-25T04:45:36.627 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-08-25T04:45:36.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.629+0000 7f31acb22700 1 -- 172.21.15.16:0/1098894038 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f318806a130 msgr2=0x7f318806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.629+0000 7f31acb22700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f318806a130 0x7f318806c5f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3198001bf0 tx=0x7f3198009040 comp rx=0 tx=0).stop 2023-08-25T04:45:36.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.629+0000 7f31acb22700 1 -- 172.21.15.16:0/1098894038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31a8070eb0 msgr2=0x7f31a8159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.629+0000 7f31acb22700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31a8070eb0 0x7f31a8159830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f31a80741c0 tx=0x7f31a0004ad0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.629+0000 7f31acb22700 1 -- 172.21.15.16:0/1098894038 shutdown_connections 2023-08-25T04:45:36.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.629+0000 7f31acb22700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f318806a130 0x7f318806c5f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.629+0000 7f31acb22700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31a8143420 0x7f31a81e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.629+0000 7f31acb22700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31a8070eb0 0x7f31a8159830 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.629+0000 7f31acb22700 1 --2- 172.21.15.16:0/1098894038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31a80ce510 0x7f31a80b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.629+0000 7f31acb22700 1 -- 172.21.15.16:0/1098894038 >> 172.21.15.16:0/1098894038 conn(0x7f31a80cfe00 msgr2=0x7f31a806d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:36.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.629+0000 7f31acb22700 1 -- 172.21.15.16:0/1098894038 shutdown_connections 2023-08-25T04:45:36.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.629+0000 7f31acb22700 1 -- 172.21.15.16:0/1098894038 wait complete. 2023-08-25T04:45:36.650 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:45:36.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.863+0000 7fa909b96700 1 Processor -- start 2023-08-25T04:45:36.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.863+0000 7fa909b96700 1 -- start start 2023-08-25T04:45:36.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.864+0000 7fa909b96700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9040672e0 0x7fa904159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.864+0000 7fa909b96700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa90406e6b0 0x7fa9040ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.864+0000 7fa909b96700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9040cd130 con 0x7fa9040ca150 2023-08-25T04:45:36.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.864+0000 7fa909b96700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9040cd410 con 0x7fa90406e6b0 2023-08-25T04:45:36.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.864+0000 7fa909b96700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040cd6f0 con 0x7fa9040672e0 2023-08-25T04:45:36.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.864+0000 7fa903fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa90406e6b0 0x7fa9040ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.864+0000 7fa902ffd700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa9040ca150 0x7fa904070290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.16:48510/0 (socket says 172.21.15.16:48510) 2023-08-25T04:45:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.864+0000 7fa902ffd700 1 -- 172.21.15.16:0/3456512193 learned_addr learned my addr 172.21.15.16:0/3456512193 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.865+0000 7fa903fff700 1 -- 172.21.15.16:0/3456512193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9040672e0 msgr2=0x7fa904159270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:45:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.865+0000 7fa903fff700 1 --2- 172.21.15.16:0/3456512193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9040672e0 0x7fa904159270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.865+0000 7fa903fff700 1 -- 172.21.15.16:0/3456512193 >> v1:172.21.15.117:6789/0 conn(0x7fa9040ca150 legacy=0x7fa904070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.865+0000 7fa903fff700 1 -- 172.21.15.16:0/3456512193 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9040cd9d0 con 0x7fa90406e6b0 2023-08-25T04:45:36.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.865+0000 7fa903fff700 1 --2- 172.21.15.16:0/3456512193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90406e6b0 0x7fa9040ce1d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4009840 tx=0x7fa8f4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac58a3972d81d7b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:36.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.865+0000 7fa9027fc700 1 -- 172.21.15.16:0/3456512193 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4011830 con 0x7fa90406e6b0 2023-08-25T04:45:36.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.866+0000 7fa9027fc700 1 -- 172.21.15.16:0/3456512193 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f4011990 con 0x7fa90406e6b0 2023-08-25T04:45:36.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.866+0000 7fa9027fc700 1 -- 172.21.15.16:0/3456512193 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4011d20 con 0x7fa90406e6b0 2023-08-25T04:45:36.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.867+0000 7fa909b96700 1 -- 172.21.15.16:0/3456512193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90406e6b0 msgr2=0x7fa9040ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.867+0000 7fa909b96700 1 --2- 172.21.15.16:0/3456512193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90406e6b0 0x7fa9040ce1d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4009840 tx=0x7fa8f4009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:36.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.867+0000 7fa909b96700 1 -- 172.21.15.16:0/3456512193 shutdown_connections 2023-08-25T04:45:36.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.867+0000 7fa909b96700 1 --2- 172.21.15.16:0/3456512193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90406e6b0 0x7fa9040ce1d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.867+0000 7fa909b96700 1 --2- 172.21.15.16:0/3456512193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9040672e0 0x7fa904159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.867+0000 7fa909b96700 1 -- 172.21.15.16:0/3456512193 >> 172.21.15.16:0/3456512193 conn(0x7fa9040cbb70 msgr2=0x7fa9040cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:36.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.868+0000 7fa909b96700 1 -- 172.21.15.16:0/3456512193 shutdown_connections 2023-08-25T04:45:36.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.868+0000 7fa909b96700 1 -- 172.21.15.16:0/3456512193 wait complete. 2023-08-25T04:45:36.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.870+0000 7fa909b96700 1 Processor -- start 2023-08-25T04:45:36.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.871+0000 7fa909b96700 1 -- start start 2023-08-25T04:45:36.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.872+0000 7fa909b96700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9040672e0 0x7fa904151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.872+0000 7fa909b96700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa90406e6b0 0x7fa904151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.872+0000 7fa909b96700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9040ca150 0x7fa90414fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.872+0000 7fa909b96700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90416b2d0 con 0x7fa9040672e0 2023-08-25T04:45:36.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.872+0000 7fa909b96700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90416a930 con 0x7fa90406e6b0 2023-08-25T04:45:36.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.872+0000 7fa909b96700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90416ac10 con 0x7fa9040ca150 2023-08-25T04:45:36.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.872+0000 7fa903fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9040ca150 0x7fa90414fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.872+0000 7fa902ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa90406e6b0 0x7fa904151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.872+0000 7fa903fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9040ca150 0x7fa90414fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:50546/0 (socket says 172.21.15.16:50546) 2023-08-25T04:45:36.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.872+0000 7fa902ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa90406e6b0 0x7fa904151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:37334/0 (socket says 172.21.15.16:37334) 2023-08-25T04:45:36.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.872+0000 7fa903fff700 1 -- 172.21.15.16:0/2042616293 learned_addr learned my addr 172.21.15.16:0/2042616293 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:36.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.872+0000 7fa9037fe700 1 --2- 172.21.15.16:0/2042616293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9040672e0 0x7fa904151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.873+0000 7fa903fff700 1 -- 172.21.15.16:0/2042616293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa90406e6b0 msgr2=0x7fa904151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.873+0000 7fa903fff700 1 --2- 172.21.15.16:0/2042616293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa90406e6b0 0x7fa904151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.873+0000 7fa903fff700 1 -- 172.21.15.16:0/2042616293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9040672e0 msgr2=0x7fa904151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.873+0000 7fa903fff700 1 --2- 172.21.15.16:0/2042616293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9040672e0 0x7fa904151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.873+0000 7fa903fff700 1 -- 172.21.15.16:0/2042616293 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f40094a0 con 0x7fa9040ca150 2023-08-25T04:45:36.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.873+0000 7fa903fff700 1 --2- 172.21.15.16:0/2042616293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9040ca150 0x7fa90414fd90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40090b0 tx=0x7fa8f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:36.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.873+0000 7fa8ebfff700 1 -- 172.21.15.16:0/2042616293 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f40036a0 con 0x7fa9040ca150 2023-08-25T04:45:36.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.874+0000 7fa8ebfff700 1 -- 172.21.15.16:0/2042616293 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f401f070 con 0x7fa9040ca150 2023-08-25T04:45:36.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.874+0000 7fa909b96700 1 -- 172.21.15.16:0/2042616293 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa904070b20 con 0x7fa9040ca150 2023-08-25T04:45:36.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.874+0000 7fa8ebfff700 1 -- 172.21.15.16:0/2042616293 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4003a00 con 0x7fa9040ca150 2023-08-25T04:45:36.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.874+0000 7fa909b96700 1 -- 172.21.15.16:0/2042616293 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9040c8da0 con 0x7fa9040ca150 2023-08-25T04:45:36.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.875+0000 7fa909b96700 1 -- 172.21.15.16:0/2042616293 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90416b410 con 0x7fa9040ca150 2023-08-25T04:45:36.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.876+0000 7fa8ebfff700 1 -- 172.21.15.16:0/2042616293 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa8f4003b60 con 0x7fa9040ca150 2023-08-25T04:45:36.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.876+0000 7fa8ebfff700 1 --2- 172.21.15.16:0/2042616293 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa8f006a0e0 0x7fa8f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.876+0000 7fa8ebfff700 1 -- 172.21.15.16:0/2042616293 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa8f4021070 con 0x7fa9040ca150 2023-08-25T04:45:36.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.877+0000 7fa9037fe700 1 --2- 172.21.15.16:0/2042616293 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa8f006a0e0 0x7fa8f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.878+0000 7fa9037fe700 1 --2- 172.21.15.16:0/2042616293 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa8f006a0e0 0x7fa8f006c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa9040c5700 tx=0x7fa8fc00d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:36.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:36.883+0000 7fa8ebfff700 1 -- 172.21.15.16:0/2042616293 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa90416b410 con 0x7fa9040ca150 2023-08-25T04:45:37.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.274+0000 7fa909b96700 1 -- 172.21.15.16:0/2042616293 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa90416b410 con 0x7fa9040ca150 2023-08-25T04:45:37.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.275+0000 7fa8ebfff700 1 -- 172.21.15.16:0/2042616293 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa90416b410 con 0x7fa9040ca150 2023-08-25T04:45:37.276 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-08-25T04:45:37.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.278+0000 7fa909b96700 1 -- 172.21.15.16:0/2042616293 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa8f006a0e0 msgr2=0x7fa8f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.278+0000 7fa909b96700 1 --2- 172.21.15.16:0/2042616293 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa8f006a0e0 0x7fa8f006c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa9040c5700 tx=0x7fa8fc00d040 comp rx=0 tx=0).stop 2023-08-25T04:45:37.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.278+0000 7fa909b96700 1 -- 172.21.15.16:0/2042616293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9040ca150 msgr2=0x7fa90414fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.278+0000 7fa909b96700 1 --2- 172.21.15.16:0/2042616293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9040ca150 0x7fa90414fd90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40090b0 tx=0x7fa8f4004750 comp rx=0 tx=0).stop 2023-08-25T04:45:37.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.279+0000 7fa909b96700 1 -- 172.21.15.16:0/2042616293 shutdown_connections 2023-08-25T04:45:37.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.279+0000 7fa909b96700 1 --2- 172.21.15.16:0/2042616293 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa8f006a0e0 0x7fa8f006c5a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.279+0000 7fa909b96700 1 --2- 172.21.15.16:0/2042616293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9040ca150 0x7fa90414fd90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.279+0000 7fa909b96700 1 --2- 172.21.15.16:0/2042616293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9040672e0 0x7fa904151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.279+0000 7fa909b96700 1 --2- 172.21.15.16:0/2042616293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa90406e6b0 0x7fa904151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.279+0000 7fa909b96700 1 -- 172.21.15.16:0/2042616293 >> 172.21.15.16:0/2042616293 conn(0x7fa9040cbb70 msgr2=0x7fa9040b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:37.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.280+0000 7fa909b96700 1 -- 172.21.15.16:0/2042616293 shutdown_connections 2023-08-25T04:45:37.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.280+0000 7fa909b96700 1 -- 172.21.15.16:0/2042616293 wait complete. 2023-08-25T04:45:37.301 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:45:37.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.518+0000 7f1eb903d700 1 Processor -- start 2023-08-25T04:45:37.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.518+0000 7f1eb903d700 1 -- start start 2023-08-25T04:45:37.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.519+0000 7f1eb903d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1eb40b4b40 0x7f1eb40cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.519+0000 7f1eb903d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1eb406b790 0x7f1eb415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.519+0000 7f1eb903d700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb40cd940 con 0x7f1eb4066130 2023-08-25T04:45:37.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.519+0000 7f1eb903d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb40729e0 con 0x7f1eb40b4b40 2023-08-25T04:45:37.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.519+0000 7f1eb903d700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb4070e10 con 0x7f1eb406b790 2023-08-25T04:45:37.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.519+0000 7f1eb259c700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1eb4066130 0x7f1eb406b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.16:48522/0 (socket says 172.21.15.16:48522) 2023-08-25T04:45:37.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.519+0000 7f1eb259c700 1 -- 172.21.15.16:0/3005998180 learned_addr learned my addr 172.21.15.16:0/3005998180 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:37.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.520+0000 7f1eb2d9d700 1 --2- 172.21.15.16:0/3005998180 >> v2:172.21.15.16:3300/0 conn(0x7f1eb40b4b40 0x7f1eb40cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.520+0000 7f1eb359e700 1 --2- 172.21.15.16:0/3005998180 >> v2:172.21.15.117:3300/0 conn(0x7f1eb406b790 0x7f1eb415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.520+0000 7f1eb2d9d700 1 -- 172.21.15.16:0/3005998180 >> v2:172.21.15.117:3300/0 conn(0x7f1eb406b790 msgr2=0x7f1eb415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:37.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.520+0000 7f1eb2d9d700 1 --2- 172.21.15.16:0/3005998180 >> v2:172.21.15.117:3300/0 conn(0x7f1eb406b790 0x7f1eb415ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.520+0000 7f1eb2d9d700 1 -- 172.21.15.16:0/3005998180 >> v1:172.21.15.117:6789/0 conn(0x7f1eb4066130 legacy=0x7f1eb406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.520+0000 7f1eb2d9d700 1 -- 172.21.15.16:0/3005998180 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb4072700 con 0x7f1eb40b4b40 2023-08-25T04:45:37.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.520+0000 7f1eb2d9d700 1 --2- 172.21.15.16:0/3005998180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb40b4b40 0x7f1eb40cd400 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4071dd0 tx=0x7f1ea8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f136f9fc5bd4420d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:37.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.521+0000 7f1eb1d9b700 1 -- 172.21.15.16:0/3005998180 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8011830 con 0x7f1eb40b4b40 2023-08-25T04:45:37.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.521+0000 7f1eb1d9b700 1 -- 172.21.15.16:0/3005998180 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea8011990 con 0x7f1eb40b4b40 2023-08-25T04:45:37.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.521+0000 7f1eb1d9b700 1 -- 172.21.15.16:0/3005998180 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8011d20 con 0x7f1eb40b4b40 2023-08-25T04:45:37.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.522+0000 7f1eb903d700 1 -- 172.21.15.16:0/3005998180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb40b4b40 msgr2=0x7f1eb40cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.522+0000 7f1eb903d700 1 --2- 172.21.15.16:0/3005998180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb40b4b40 0x7f1eb40cd400 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4071dd0 tx=0x7f1ea8009b20 comp rx=0 tx=0).stop 2023-08-25T04:45:37.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.522+0000 7f1eb903d700 1 -- 172.21.15.16:0/3005998180 shutdown_connections 2023-08-25T04:45:37.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.522+0000 7f1eb903d700 1 --2- 172.21.15.16:0/3005998180 >> v2:172.21.15.117:3300/0 conn(0x7f1eb406b790 0x7f1eb415ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.522+0000 7f1eb903d700 1 --2- 172.21.15.16:0/3005998180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb40b4b40 0x7f1eb40cd400 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.522+0000 7f1eb903d700 1 -- 172.21.15.16:0/3005998180 >> 172.21.15.16:0/3005998180 conn(0x7f1eb40cf500 msgr2=0x7f1eb40cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:37.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.523+0000 7f1eb903d700 1 -- 172.21.15.16:0/3005998180 shutdown_connections 2023-08-25T04:45:37.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.524+0000 7f1eb903d700 1 -- 172.21.15.16:0/3005998180 wait complete. 2023-08-25T04:45:37.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.526+0000 7f1eb903d700 1 Processor -- start 2023-08-25T04:45:37.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.526+0000 7f1eb903d700 1 -- start start 2023-08-25T04:45:37.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.527+0000 7f1eb903d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4066130 0x7f1eb41f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.527+0000 7f1eb903d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1eb406b790 0x7f1eb40c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.527+0000 7f1eb903d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1eb40b4b40 0x7f1eb40c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.527+0000 7f1eb903d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb41f2830 con 0x7f1eb4066130 2023-08-25T04:45:37.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.527+0000 7f1eb903d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb40c5ec0 con 0x7f1eb40b4b40 2023-08-25T04:45:37.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.527+0000 7f1eb903d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb4159c90 con 0x7f1eb406b790 2023-08-25T04:45:37.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.527+0000 7f1eb2d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4066130 0x7f1eb41f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.527+0000 7f1eb2d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4066130 0x7f1eb41f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50022/0 (socket says 172.21.15.16:50022) 2023-08-25T04:45:37.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.527+0000 7f1eb2d9d700 1 -- 172.21.15.16:0/2731042818 learned_addr learned my addr 172.21.15.16:0/2731042818 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:37.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.527+0000 7f1eb359e700 1 --2- 172.21.15.16:0/2731042818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1eb40b4b40 0x7f1eb40c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.528+0000 7f1eb259c700 1 --2- 172.21.15.16:0/2731042818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1eb406b790 0x7f1eb40c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.528+0000 7f1eb2d9d700 1 -- 172.21.15.16:0/2731042818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1eb406b790 msgr2=0x7f1eb40c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.528+0000 7f1eb2d9d700 1 --2- 172.21.15.16:0/2731042818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1eb406b790 0x7f1eb40c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.528+0000 7f1eb2d9d700 1 -- 172.21.15.16:0/2731042818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1eb40b4b40 msgr2=0x7f1eb40c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.528+0000 7f1eb2d9d700 1 --2- 172.21.15.16:0/2731042818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1eb40b4b40 0x7f1eb40c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.528+0000 7f1eb2d9d700 1 -- 172.21.15.16:0/2731042818 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea80094a0 con 0x7f1eb4066130 2023-08-25T04:45:37.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.528+0000 7f1eb2d9d700 1 --2- 172.21.15.16:0/2731042818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4066130 0x7f1eb41f22f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8000c00 tx=0x7f1ea8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:37.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.528+0000 7f1e9b7fe700 1 -- 172.21.15.16:0/2731042818 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea80036a0 con 0x7f1eb4066130 2023-08-25T04:45:37.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.528+0000 7f1e9b7fe700 1 -- 172.21.15.16:0/2731042818 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea801e070 con 0x7f1eb4066130 2023-08-25T04:45:37.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.529+0000 7f1eb903d700 1 -- 172.21.15.16:0/2731042818 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb40c5110 con 0x7f1eb4066130 2023-08-25T04:45:37.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.529+0000 7f1e9b7fe700 1 -- 172.21.15.16:0/2731042818 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8003a60 con 0x7f1eb4066130 2023-08-25T04:45:37.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.529+0000 7f1eb903d700 1 -- 172.21.15.16:0/2731042818 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb40c4350 con 0x7f1eb4066130 2023-08-25T04:45:37.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.530+0000 7f1eb903d700 1 -- 172.21.15.16:0/2731042818 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb40c4110 con 0x7f1eb4066130 2023-08-25T04:45:37.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.531+0000 7f1e9b7fe700 1 -- 172.21.15.16:0/2731042818 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1ea8003bc0 con 0x7f1eb4066130 2023-08-25T04:45:37.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.531+0000 7f1e9b7fe700 1 --2- 172.21.15.16:0/2731042818 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1ea006a0e0 0x7f1ea006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.532+0000 7f1e9b7fe700 1 -- 172.21.15.16:0/2731042818 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1ea8089470 con 0x7f1eb4066130 2023-08-25T04:45:37.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.532+0000 7f1eb259c700 1 --2- 172.21.15.16:0/2731042818 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1ea006a0e0 0x7f1ea006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.533+0000 7f1eb259c700 1 --2- 172.21.15.16:0/2731042818 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1ea006a0e0 0x7f1ea006c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40c2940 tx=0x7f1ea4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:37.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.539+0000 7f1e9b7fe700 1 -- 172.21.15.16:0/2731042818 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1eb40c4110 con 0x7f1eb4066130 2023-08-25T04:45:37.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.797+0000 7f1eb903d700 1 -- 172.21.15.16:0/2731042818 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1eb40c4110 con 0x7f1eb4066130 2023-08-25T04:45:37.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.797+0000 7f1e9b7fe700 1 -- 172.21.15.16:0/2731042818 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1eb40c4110 con 0x7f1eb4066130 2023-08-25T04:45:37.799 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-08-25T04:45:37.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.799+0000 7f1eb903d700 1 -- 172.21.15.16:0/2731042818 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1ea006a0e0 msgr2=0x7f1ea006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.799+0000 7f1eb903d700 1 --2- 172.21.15.16:0/2731042818 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1ea006a0e0 0x7f1ea006c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40c2940 tx=0x7f1ea4009040 comp rx=0 tx=0).stop 2023-08-25T04:45:37.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.799+0000 7f1eb903d700 1 -- 172.21.15.16:0/2731042818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4066130 msgr2=0x7f1eb41f22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.799+0000 7f1eb903d700 1 --2- 172.21.15.16:0/2731042818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4066130 0x7f1eb41f22f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8000c00 tx=0x7f1ea8004750 comp rx=0 tx=0).stop 2023-08-25T04:45:37.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.799+0000 7f1eb903d700 1 -- 172.21.15.16:0/2731042818 shutdown_connections 2023-08-25T04:45:37.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.799+0000 7f1eb903d700 1 --2- 172.21.15.16:0/2731042818 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1ea006a0e0 0x7f1ea006c5a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.799+0000 7f1eb903d700 1 --2- 172.21.15.16:0/2731042818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1eb40b4b40 0x7f1eb40c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.799+0000 7f1eb903d700 1 --2- 172.21.15.16:0/2731042818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4066130 0x7f1eb41f22f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.799+0000 7f1eb903d700 1 --2- 172.21.15.16:0/2731042818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1eb406b790 0x7f1eb40c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.799+0000 7f1eb903d700 1 -- 172.21.15.16:0/2731042818 >> 172.21.15.16:0/2731042818 conn(0x7f1eb40cf500 msgr2=0x7f1eb415d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:37.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.799+0000 7f1eb903d700 1 -- 172.21.15.16:0/2731042818 shutdown_connections 2023-08-25T04:45:37.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.799+0000 7f1eb903d700 1 -- 172.21.15.16:0/2731042818 wait complete. 2023-08-25T04:45:37.813 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:45:37.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.940+0000 7f901816b700 1 Processor -- start 2023-08-25T04:45:37.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.940+0000 7f901816b700 1 -- start start 2023-08-25T04:45:37.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.941+0000 7f901816b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9010146560 0x7f90100d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.941+0000 7f901816b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9010146aa0 0x7f901006a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.941+0000 7f901816b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9010161810 con 0x7f901006a880 2023-08-25T04:45:37.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.941+0000 7f901816b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9010146940 con 0x7f9010146aa0 2023-08-25T04:45:37.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.941+0000 7f901816b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f901006ad30 con 0x7f9010146560 2023-08-25T04:45:37.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.941+0000 7f9015706700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9010146aa0 0x7f901006a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.941+0000 7f9015706700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9010146aa0 0x7f901006a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50028/0 (socket says 172.21.15.16:50028) 2023-08-25T04:45:37.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.941+0000 7f9015706700 1 -- 172.21.15.16:0/2391742538 learned_addr learned my addr 172.21.15.16:0/2391742538 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:37.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.941+0000 7f9015f07700 1 --2- 172.21.15.16:0/2391742538 >> v2:172.21.15.117:3300/0 conn(0x7f9010146560 0x7f90100d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.941+0000 7f9015706700 1 -- 172.21.15.16:0/2391742538 >> v2:172.21.15.117:3300/0 conn(0x7f9010146560 msgr2=0x7f90100d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.941+0000 7f9015706700 1 --2- 172.21.15.16:0/2391742538 >> v2:172.21.15.117:3300/0 conn(0x7f9010146560 0x7f90100d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.942+0000 7f9015706700 1 -- 172.21.15.16:0/2391742538 >> v1:172.21.15.117:6789/0 conn(0x7f901006a880 legacy=0x7f9010070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.942+0000 7f9015706700 1 -- 172.21.15.16:0/2391742538 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901006e210 con 0x7f9010146aa0 2023-08-25T04:45:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.942+0000 7f9015706700 1 --2- 172.21.15.16:0/2391742538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9010146aa0 0x7f901006a340 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9010070e60 tx=0x7f900c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d39a0542fb55e9f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:37.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.942+0000 7f9014f05700 1 -- 172.21.15.16:0/2391742538 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c011830 con 0x7f9010146aa0 2023-08-25T04:45:37.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.942+0000 7f9014f05700 1 -- 172.21.15.16:0/2391742538 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c011990 con 0x7f9010146aa0 2023-08-25T04:45:37.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.942+0000 7f9014f05700 1 -- 172.21.15.16:0/2391742538 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c011d20 con 0x7f9010146aa0 2023-08-25T04:45:37.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.942+0000 7f901816b700 1 -- 172.21.15.16:0/2391742538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9010146aa0 msgr2=0x7f901006a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.942+0000 7f901816b700 1 --2- 172.21.15.16:0/2391742538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9010146aa0 0x7f901006a340 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9010070e60 tx=0x7f900c009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.942+0000 7f901816b700 1 -- 172.21.15.16:0/2391742538 shutdown_connections 2023-08-25T04:45:37.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.942+0000 7f901816b700 1 --2- 172.21.15.16:0/2391742538 >> v2:172.21.15.117:3300/0 conn(0x7f9010146560 0x7f90100d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.942+0000 7f901816b700 1 --2- 172.21.15.16:0/2391742538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9010146aa0 0x7f901006a340 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.942+0000 7f901816b700 1 -- 172.21.15.16:0/2391742538 >> 172.21.15.16:0/2391742538 conn(0x7f90100cfe00 msgr2=0x7f90100d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:37.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.943+0000 7f901816b700 1 -- 172.21.15.16:0/2391742538 shutdown_connections 2023-08-25T04:45:37.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.943+0000 7f901816b700 1 -- 172.21.15.16:0/2391742538 wait complete. 2023-08-25T04:45:37.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.944+0000 7f901816b700 1 Processor -- start 2023-08-25T04:45:37.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.944+0000 7f901816b700 1 -- start start 2023-08-25T04:45:37.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f901816b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f901006a880 0x7f901013efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f901816b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9010146560 0x7f901013d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f901816b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9010146aa0 0x7f90100b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f901816b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901013c5b0 con 0x7f9010146560 2023-08-25T04:45:37.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f901816b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901013c890 con 0x7f9010146aa0 2023-08-25T04:45:37.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f901816b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901013cb70 con 0x7f901006a880 2023-08-25T04:45:37.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f9015706700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9010146560 0x7f901013d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f9015706700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9010146560 0x7f901013d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50034/0 (socket says 172.21.15.16:50034) 2023-08-25T04:45:37.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f9015706700 1 -- 172.21.15.16:0/3648524617 learned_addr learned my addr 172.21.15.16:0/3648524617 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:37.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f9015f07700 1 --2- 172.21.15.16:0/3648524617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f901006a880 0x7f901013efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f9016708700 1 --2- 172.21.15.16:0/3648524617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9010146aa0 0x7f90100b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f9015706700 1 -- 172.21.15.16:0/3648524617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f901006a880 msgr2=0x7f901013efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f9015706700 1 --2- 172.21.15.16:0/3648524617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f901006a880 0x7f901013efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f9015706700 1 -- 172.21.15.16:0/3648524617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9010146aa0 msgr2=0x7f90100b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f9015706700 1 --2- 172.21.15.16:0/3648524617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9010146aa0 0x7f90100b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f9015706700 1 -- 172.21.15.16:0/3648524617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c009550 con 0x7f9010146560 2023-08-25T04:45:37.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f9015706700 1 --2- 172.21.15.16:0/3648524617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9010146560 0x7f901013d650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f900c009c10 tx=0x7f900c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:37.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f90067fc700 1 -- 172.21.15.16:0/3648524617 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c004510 con 0x7f9010146560 2023-08-25T04:45:37.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f90067fc700 1 -- 172.21.15.16:0/3648524617 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c01e070 con 0x7f9010146560 2023-08-25T04:45:37.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f901816b700 1 -- 172.21.15.16:0/3648524617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901013ce50 con 0x7f9010146560 2023-08-25T04:45:37.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.945+0000 7f90067fc700 1 -- 172.21.15.16:0/3648524617 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c0038e0 con 0x7f9010146560 2023-08-25T04:45:37.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.946+0000 7f901816b700 1 -- 172.21.15.16:0/3648524617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901013f520 con 0x7f9010146560 2023-08-25T04:45:37.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.947+0000 7f901816b700 1 -- 172.21.15.16:0/3648524617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901013f710 con 0x7f9010146560 2023-08-25T04:45:37.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.947+0000 7f90067fc700 1 -- 172.21.15.16:0/3648524617 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f900c003a40 con 0x7f9010146560 2023-08-25T04:45:37.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.947+0000 7f90067fc700 1 --2- 172.21.15.16:0/3648524617 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f8ff406a0e0 0x7f8ff406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.947+0000 7f90067fc700 1 -- 172.21.15.16:0/3648524617 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f900c089330 con 0x7f9010146560 2023-08-25T04:45:37.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.947+0000 7f9015f07700 1 --2- 172.21.15.16:0/3648524617 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f8ff406a0e0 0x7f8ff406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.948+0000 7f9015f07700 1 --2- 172.21.15.16:0/3648524617 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f8ff406a0e0 0x7f8ff406c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9000009b40 tx=0x7f9000009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:37.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:37.952+0000 7f90067fc700 1 -- 172.21.15.16:0/3648524617 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f900c0549f0 con 0x7f9010146560 2023-08-25T04:45:38.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.151+0000 7f901816b700 1 -- 172.21.15.16:0/3648524617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f901006edf0 con 0x7f9010146560 2023-08-25T04:45:38.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.151+0000 7f90067fc700 1 -- 172.21.15.16:0/3648524617 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f900c058010 con 0x7f9010146560 2023-08-25T04:45:38.153 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-08-25T04:45:38.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.153+0000 7f901816b700 1 -- 172.21.15.16:0/3648524617 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f8ff406a0e0 msgr2=0x7f8ff406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.153+0000 7f901816b700 1 --2- 172.21.15.16:0/3648524617 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f8ff406a0e0 0x7f8ff406c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9000009b40 tx=0x7f9000009210 comp rx=0 tx=0).stop 2023-08-25T04:45:38.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.153+0000 7f901816b700 1 -- 172.21.15.16:0/3648524617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9010146560 msgr2=0x7f901013d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.153+0000 7f901816b700 1 --2- 172.21.15.16:0/3648524617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9010146560 0x7f901013d650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f900c009c10 tx=0x7f900c004750 comp rx=0 tx=0).stop 2023-08-25T04:45:38.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.153+0000 7f901816b700 1 -- 172.21.15.16:0/3648524617 shutdown_connections 2023-08-25T04:45:38.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.153+0000 7f901816b700 1 --2- 172.21.15.16:0/3648524617 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f8ff406a0e0 0x7f8ff406c5a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.153+0000 7f901816b700 1 --2- 172.21.15.16:0/3648524617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9010146aa0 0x7f90100b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.153+0000 7f901816b700 1 --2- 172.21.15.16:0/3648524617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f901006a880 0x7f901013efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.153+0000 7f901816b700 1 --2- 172.21.15.16:0/3648524617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9010146560 0x7f901013d650 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.153+0000 7f901816b700 1 -- 172.21.15.16:0/3648524617 >> 172.21.15.16:0/3648524617 conn(0x7f90100cfe00 msgr2=0x7f90100cc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:38.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.153+0000 7f901816b700 1 -- 172.21.15.16:0/3648524617 shutdown_connections 2023-08-25T04:45:38.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.153+0000 7f901816b700 1 -- 172.21.15.16:0/3648524617 wait complete. 2023-08-25T04:45:38.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:45:38.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.291+0000 7fc60b138700 1 Processor -- start 2023-08-25T04:45:38.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.292+0000 7fc60b138700 1 -- start start 2023-08-25T04:45:38.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.292+0000 7fc60b138700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc60415e670 0x7fc6040ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:38.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.292+0000 7fc60b138700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc60406a340 0x7fc60406a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:38.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.292+0000 7fc60b138700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6040713e0 con 0x7fc6040cc820 2023-08-25T04:45:38.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.292+0000 7fc60b138700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60406ad00 con 0x7fc60406a340 2023-08-25T04:45:38.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.292+0000 7fc60b138700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040b3d20 con 0x7fc60415e670 2023-08-25T04:45:38.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.293+0000 7fc603fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc60406a340 0x7fc60406a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:38.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.293+0000 7fc608ed4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc60415e670 0x7fc6040ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:38.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.293+0000 7fc6096d5700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fc6040cc820 0x7fc6040ccc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.16:48550/0 (socket says 172.21.15.16:48550) 2023-08-25T04:45:38.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.293+0000 7fc6096d5700 1 -- 172.21.15.16:0/1054048422 learned_addr learned my addr 172.21.15.16:0/1054048422 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:38.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.293+0000 7fc608ed4700 1 -- 172.21.15.16:0/1054048422 >> v2:172.21.15.117:3300/0 conn(0x7fc60406a340 msgr2=0x7fc60406a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:38.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.293+0000 7fc608ed4700 1 --2- 172.21.15.16:0/1054048422 >> v2:172.21.15.117:3300/0 conn(0x7fc60406a340 0x7fc60406a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.293+0000 7fc6037fe700 1 -- 172.21.15.16:0/1054048422 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855306678 0 0) 0x7fc6040713e0 con 0x7fc6040cc820 2023-08-25T04:45:38.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.293+0000 7fc608ed4700 1 -- 172.21.15.16:0/1054048422 >> v1:172.21.15.117:6789/0 conn(0x7fc6040cc820 legacy=0x7fc6040ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.293+0000 7fc608ed4700 1 -- 172.21.15.16:0/1054048422 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60415ea50 con 0x7fc60415e670 2023-08-25T04:45:38.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.293+0000 7fc608ed4700 1 --2- 172.21.15.16:0/1054048422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc60415e670 0x7fc6040ca490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009840 tx=0x7fc5f8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8aabcf4800be1c99 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.294+0000 7fc6037fe700 1 -- 172.21.15.16:0/1054048422 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8011830 con 0x7fc60415e670 2023-08-25T04:45:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.294+0000 7fc6037fe700 1 -- 172.21.15.16:0/1054048422 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f8011990 con 0x7fc60415e670 2023-08-25T04:45:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.294+0000 7fc6037fe700 1 -- 172.21.15.16:0/1054048422 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8011d20 con 0x7fc60415e670 2023-08-25T04:45:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.294+0000 7fc60b138700 1 -- 172.21.15.16:0/1054048422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc60415e670 msgr2=0x7fc6040ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.294+0000 7fc60b138700 1 --2- 172.21.15.16:0/1054048422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc60415e670 0x7fc6040ca490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009840 tx=0x7fc5f8009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.294+0000 7fc60b138700 1 -- 172.21.15.16:0/1054048422 shutdown_connections 2023-08-25T04:45:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.294+0000 7fc60b138700 1 --2- 172.21.15.16:0/1054048422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc60415e670 0x7fc6040ca490 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.294+0000 7fc60b138700 1 --2- 172.21.15.16:0/1054048422 >> v2:172.21.15.117:3300/0 conn(0x7fc60406a340 0x7fc60406a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.294+0000 7fc60b138700 1 -- 172.21.15.16:0/1054048422 >> 172.21.15.16:0/1054048422 conn(0x7fc6040b1a10 msgr2=0x7fc6040b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.294+0000 7fc60b138700 1 -- 172.21.15.16:0/1054048422 shutdown_connections 2023-08-25T04:45:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.294+0000 7fc60b138700 1 -- 172.21.15.16:0/1054048422 wait complete. 2023-08-25T04:45:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.296+0000 7fc60b138700 1 Processor -- start 2023-08-25T04:45:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.296+0000 7fc60b138700 1 -- start start 2023-08-25T04:45:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc60b138700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc60406a340 0x7fc604151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc60b138700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6040cc820 0x7fc604157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc60b138700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc60415e670 0x7fc604152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:38.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc60b138700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60406d7e0 con 0x7fc6040cc820 2023-08-25T04:45:38.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc60b138700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6041f4070 con 0x7fc60406a340 2023-08-25T04:45:38.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc60b138700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6041f4350 con 0x7fc60415e670 2023-08-25T04:45:38.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc603fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6040cc820 0x7fc604157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:38.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc603fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6040cc820 0x7fc604157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50046/0 (socket says 172.21.15.16:50046) 2023-08-25T04:45:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc603fff700 1 -- 172.21.15.16:0/434236273 learned_addr learned my addr 172.21.15.16:0/434236273 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc608ed4700 1 --2- 172.21.15.16:0/434236273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc60406a340 0x7fc604151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc6096d5700 1 --2- 172.21.15.16:0/434236273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc60415e670 0x7fc604152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc603fff700 1 -- 172.21.15.16:0/434236273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc60415e670 msgr2=0x7fc604152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc603fff700 1 --2- 172.21.15.16:0/434236273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc60415e670 0x7fc604152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc603fff700 1 -- 172.21.15.16:0/434236273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc60406a340 msgr2=0x7fc604151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc603fff700 1 --2- 172.21.15.16:0/434236273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc60406a340 0x7fc604151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc603fff700 1 -- 172.21.15.16:0/434236273 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f80094a0 con 0x7fc6040cc820 2023-08-25T04:45:38.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.297+0000 7fc603fff700 1 --2- 172.21.15.16:0/434236273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6040cc820 0x7fc604157b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000e9b0 tx=0x7fc5f000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:38.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.298+0000 7fc6017fa700 1 -- 172.21.15.16:0/434236273 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0009710 con 0x7fc6040cc820 2023-08-25T04:45:38.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.298+0000 7fc6017fa700 1 -- 172.21.15.16:0/434236273 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f000c850 con 0x7fc6040cc820 2023-08-25T04:45:38.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.298+0000 7fc60b138700 1 -- 172.21.15.16:0/434236273 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6041f4630 con 0x7fc6040cc820 2023-08-25T04:45:38.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.298+0000 7fc6017fa700 1 -- 172.21.15.16:0/434236273 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000cbc0 con 0x7fc6040cc820 2023-08-25T04:45:38.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.298+0000 7fc60b138700 1 -- 172.21.15.16:0/434236273 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6041f4bf0 con 0x7fc6040cc820 2023-08-25T04:45:38.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.299+0000 7fc60b138700 1 -- 172.21.15.16:0/434236273 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc604156460 con 0x7fc6040cc820 2023-08-25T04:45:38.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.299+0000 7fc6017fa700 1 -- 172.21.15.16:0/434236273 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc5f000cd20 con 0x7fc6040cc820 2023-08-25T04:45:38.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.299+0000 7fc6017fa700 1 --2- 172.21.15.16:0/434236273 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc5e806a0e0 0x7fc5e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:38.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.300+0000 7fc6017fa700 1 -- 172.21.15.16:0/434236273 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc5f0088610 con 0x7fc6040cc820 2023-08-25T04:45:38.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.300+0000 7fc608ed4700 1 --2- 172.21.15.16:0/434236273 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc5e806a0e0 0x7fc5e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:38.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.300+0000 7fc608ed4700 1 --2- 172.21.15.16:0/434236273 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc5e806a0e0 0x7fc5e806c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80090b0 tx=0x7fc5f8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:38.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.304+0000 7fc6017fa700 1 -- 172.21.15.16:0/434236273 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc604156460 con 0x7fc6040cc820 2023-08-25T04:45:38.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.522+0000 7fc60b138700 1 -- 172.21.15.16:0/434236273 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc604156460 con 0x7fc6040cc820 2023-08-25T04:45:38.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.522+0000 7fc6017fa700 1 -- 172.21.15.16:0/434236273 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc604156460 con 0x7fc6040cc820 2023-08-25T04:45:38.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.524+0000 7fc60b138700 1 -- 172.21.15.16:0/434236273 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc5e806a0e0 msgr2=0x7fc5e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.524+0000 7fc60b138700 1 --2- 172.21.15.16:0/434236273 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc5e806a0e0 0x7fc5e806c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80090b0 tx=0x7fc5f8008030 comp rx=0 tx=0).stop 2023-08-25T04:45:38.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.524+0000 7fc60b138700 1 -- 172.21.15.16:0/434236273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6040cc820 msgr2=0x7fc604157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.524+0000 7fc60b138700 1 --2- 172.21.15.16:0/434236273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6040cc820 0x7fc604157b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000e9b0 tx=0x7fc5f000ecc0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.524+0000 7fc60b138700 1 -- 172.21.15.16:0/434236273 shutdown_connections 2023-08-25T04:45:38.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.524+0000 7fc60b138700 1 --2- 172.21.15.16:0/434236273 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc5e806a0e0 0x7fc5e806c5a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.524+0000 7fc60b138700 1 --2- 172.21.15.16:0/434236273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc60415e670 0x7fc604152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.524+0000 7fc60b138700 1 --2- 172.21.15.16:0/434236273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc60406a340 0x7fc604151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.524+0000 7fc60b138700 1 --2- 172.21.15.16:0/434236273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6040cc820 0x7fc604157b80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.524+0000 7fc60b138700 1 -- 172.21.15.16:0/434236273 >> 172.21.15.16:0/434236273 conn(0x7fc6040b1a10 msgr2=0x7fc6040b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:38.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.524+0000 7fc60b138700 1 -- 172.21.15.16:0/434236273 shutdown_connections 2023-08-25T04:45:38.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:38.524+0000 7fc60b138700 1 -- 172.21.15.16:0/434236273 wait complete. 2023-08-25T04:45:38.528 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2023-08-25T04:45:38.538 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-08-25T04:45:38.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:38.538 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.2 2023-08-25T04:45:38.816 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2023-08-25T04:45:38.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:38.817 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-25T04:45:38.847 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:45:38.847 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:45:38.864 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:45:38.864 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:45:38.921 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:39.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.046+0000 7f53e2283700 1 Processor -- start 2023-08-25T04:45:39.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.046+0000 7f53e2283700 1 -- start start 2023-08-25T04:45:39.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.047+0000 7f53e2283700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f53dc0caf10 0x7f53dc0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.047+0000 7f53e2283700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53dc070eb0 0x7f53dc0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.047+0000 7f53e2283700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53dc0cbfe0 con 0x7f53dc0cc830 2023-08-25T04:45:39.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.047+0000 7f53e2283700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53dc0cb3d0 con 0x7f53dc0caf10 2023-08-25T04:45:39.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.047+0000 7f53e2283700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc0cb6b0 con 0x7f53dc070eb0 2023-08-25T04:45:39.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.047+0000 7f53db7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f53dc0caf10 0x7f53dc0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.047+0000 7f53db7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f53dc0caf10 0x7f53dc0cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50056/0 (socket says 172.21.15.16:50056) 2023-08-25T04:45:39.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.047+0000 7f53db7fe700 1 -- 172.21.15.16:0/3169072689 learned_addr learned my addr 172.21.15.16:0/3169072689 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:39.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.047+0000 7f53e0820700 1 --2- 172.21.15.16:0/3169072689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53dc070eb0 0x7f53dc0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.047+0000 7f53db7fe700 1 -- 172.21.15.16:0/3169072689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53dc070eb0 msgr2=0x7f53dc0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:39.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.047+0000 7f53db7fe700 1 --2- 172.21.15.16:0/3169072689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53dc070eb0 0x7f53dc0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.047+0000 7f53db7fe700 1 -- 172.21.15.16:0/3169072689 >> v1:172.21.15.117:6789/0 conn(0x7f53dc0cc830 legacy=0x7f53dc0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.047+0000 7f53db7fe700 1 -- 172.21.15.16:0/3169072689 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc0cb990 con 0x7f53dc0caf10 2023-08-25T04:45:39.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.048+0000 7f53db7fe700 1 --2- 172.21.15.16:0/3169072689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53dc0caf10 0x7f53dc0cddb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00bb90 tx=0x7f53cc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc2ad6279035c67 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.048+0000 7f53daffd700 1 -- 172.21.15.16:0/3169072689 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc00dd50 con 0x7f53dc0caf10 2023-08-25T04:45:39.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.048+0000 7f53daffd700 1 -- 172.21.15.16:0/3169072689 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc010470 con 0x7f53dc0caf10 2023-08-25T04:45:39.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.048+0000 7f53daffd700 1 -- 172.21.15.16:0/3169072689 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc010800 con 0x7f53dc0caf10 2023-08-25T04:45:39.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.048+0000 7f53e2283700 1 -- 172.21.15.16:0/3169072689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53dc0caf10 msgr2=0x7f53dc0cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.048+0000 7f53e2283700 1 --2- 172.21.15.16:0/3169072689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53dc0caf10 0x7f53dc0cddb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00bb90 tx=0x7f53cc00bea0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.048+0000 7f53e2283700 1 -- 172.21.15.16:0/3169072689 shutdown_connections 2023-08-25T04:45:39.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.048+0000 7f53e2283700 1 --2- 172.21.15.16:0/3169072689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53dc070eb0 0x7f53dc0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.048+0000 7f53e2283700 1 --2- 172.21.15.16:0/3169072689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53dc0caf10 0x7f53dc0cddb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.048+0000 7f53e2283700 1 -- 172.21.15.16:0/3169072689 >> 172.21.15.16:0/3169072689 conn(0x7f53dc0b1a10 msgr2=0x7f53dc0b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:39.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.048+0000 7f53e2283700 1 -- 172.21.15.16:0/3169072689 shutdown_connections 2023-08-25T04:45:39.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.048+0000 7f53e2283700 1 -- 172.21.15.16:0/3169072689 wait complete. 2023-08-25T04:45:39.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.049+0000 7f53e2283700 1 Processor -- start 2023-08-25T04:45:39.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.050+0000 7f53e2283700 1 -- start start 2023-08-25T04:45:39.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.050+0000 7f53e2283700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53dc070eb0 0x7f53dc1ee090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.050+0000 7f53e2283700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53dc0caf10 0x7f53dc1506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.050+0000 7f53e2283700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53dc0cc830 0x7f53dc0c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.050+0000 7f53e2283700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc15b680 con 0x7f53dc0caf10 2023-08-25T04:45:39.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.050+0000 7f53e2283700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc150c20 con 0x7f53dc0cc830 2023-08-25T04:45:39.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.050+0000 7f53e2283700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc15a720 con 0x7f53dc070eb0 2023-08-25T04:45:39.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53db7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53dc0caf10 0x7f53dc1506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53db7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53dc0caf10 0x7f53dc1506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50062/0 (socket says 172.21.15.16:50062) 2023-08-25T04:45:39.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53db7fe700 1 -- 172.21.15.16:0/1926820038 learned_addr learned my addr 172.21.15.16:0/1926820038 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:39.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53dbfff700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53dc070eb0 0x7f53dc1ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53e0820700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53dc0cc830 0x7f53dc0c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53db7fe700 1 -- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53dc070eb0 msgr2=0x7f53dc1ee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53db7fe700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53dc070eb0 0x7f53dc1ee090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53db7fe700 1 -- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53dc0cc830 msgr2=0x7f53dc0c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53db7fe700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53dc0cc830 0x7f53dc0c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53db7fe700 1 -- 172.21.15.16:0/1926820038 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc00b7f0 con 0x7f53dc0caf10 2023-08-25T04:45:39.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53dbfff700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53dc070eb0 0x7f53dc1ee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:39.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53db7fe700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53dc0caf10 0x7f53dc1506e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00bee0 tx=0x7f53cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53d8ff9700 1 -- 172.21.15.16:0/1926820038 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc01f070 con 0x7f53dc0caf10 2023-08-25T04:45:39.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53d8ff9700 1 -- 172.21.15.16:0/1926820038 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc0038b0 con 0x7f53dc0caf10 2023-08-25T04:45:39.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53e2283700 1 -- 172.21.15.16:0/1926820038 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53dc15aa00 con 0x7f53dc0caf10 2023-08-25T04:45:39.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53d8ff9700 1 -- 172.21.15.16:0/1926820038 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc003c60 con 0x7f53dc0caf10 2023-08-25T04:45:39.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.051+0000 7f53e2283700 1 -- 172.21.15.16:0/1926820038 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53dc15afc0 con 0x7f53dc0caf10 2023-08-25T04:45:39.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.052+0000 7f53e2283700 1 -- 172.21.15.16:0/1926820038 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53dc15b7c0 con 0x7f53dc0caf10 2023-08-25T04:45:39.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.053+0000 7f53d8ff9700 1 -- 172.21.15.16:0/1926820038 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f53cc019400 con 0x7f53dc0caf10 2023-08-25T04:45:39.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.053+0000 7f53d8ff9700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f53bc06a0e0 0x7f53bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.053+0000 7f53d8ff9700 1 -- 172.21.15.16:0/1926820038 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f53cc08c090 con 0x7f53dc0caf10 2023-08-25T04:45:39.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.053+0000 7f53dbfff700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f53bc06a0e0 0x7f53bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.054+0000 7f53dbfff700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f53bc06a0e0 0x7f53bc06c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f53c4000f60 tx=0x7f53c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.058+0000 7f53d8ff9700 1 -- 172.21.15.16:0/1926820038 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f53dc15b7c0 con 0x7f53dc0caf10 2023-08-25T04:45:39.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.273+0000 7f53e2283700 1 -- 172.21.15.16:0/1926820038 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53dc15b7c0 con 0x7f53dc0caf10 2023-08-25T04:45:39.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.274+0000 7f53d8ff9700 1 -- 172.21.15.16:0/1926820038 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18329 (secure 0 0 0) 0x7f53dc15b7c0 con 0x7f53dc0caf10 2023-08-25T04:45:39.276 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:45:39.276 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:44:30.464568+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:43:40.197381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:43:41.268759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:39.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.276+0000 7f53e2283700 1 -- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f53bc06a0e0 msgr2=0x7f53bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.276+0000 7f53e2283700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f53bc06a0e0 0x7f53bc06c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f53c4000f60 tx=0x7f53c4009040 comp rx=0 tx=0).stop 2023-08-25T04:45:39.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.276+0000 7f53e2283700 1 -- 172.21.15.16:0/1926820038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53dc0caf10 msgr2=0x7f53dc1506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.276+0000 7f53e2283700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53dc0caf10 0x7f53dc1506e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00bee0 tx=0x7f53cc004750 comp rx=0 tx=0).stop 2023-08-25T04:45:39.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.276+0000 7f53e2283700 1 -- 172.21.15.16:0/1926820038 shutdown_connections 2023-08-25T04:45:39.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.276+0000 7f53e2283700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f53bc06a0e0 0x7f53bc06c5a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.277+0000 7f53e2283700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53dc0cc830 0x7f53dc0c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.277+0000 7f53e2283700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53dc070eb0 0x7f53dc1ee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.277+0000 7f53e2283700 1 --2- 172.21.15.16:0/1926820038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53dc0caf10 0x7f53dc1506e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.277+0000 7f53e2283700 1 -- 172.21.15.16:0/1926820038 >> 172.21.15.16:0/1926820038 conn(0x7f53dc0b1a10 msgr2=0x7f53dc0af980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:39.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.277+0000 7f53e2283700 1 -- 172.21.15.16:0/1926820038 shutdown_connections 2023-08-25T04:45:39.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.277+0000 7f53e2283700 1 -- 172.21.15.16:0/1926820038 wait complete. 2023-08-25T04:45:39.290 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:43:34.951742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:43:35.360236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:43:40.197381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:43:41.268759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:45:39.292 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:45:39.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.422+0000 7fdcae902700 1 Processor -- start 2023-08-25T04:45:39.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.422+0000 7fdcae902700 1 -- start start 2023-08-25T04:45:39.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.423+0000 7fdcae902700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdca80d0110 0x7fdca80d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.423+0000 7fdcae902700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdca80d3c50 0x7fdca80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.423+0000 7fdcae902700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca80b5f10 con 0x7fdca8160930 2023-08-25T04:45:39.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.423+0000 7fdcae902700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca80d1c80 con 0x7fdca80d3c50 2023-08-25T04:45:39.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.423+0000 7fdcae902700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca80d1f60 con 0x7fdca80d0110 2023-08-25T04:45:39.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.423+0000 7fdcace9f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdca80d3c50 0x7fdca80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.423+0000 7fdcace9f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdca80d3c50 0x7fdca80b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50072/0 (socket says 172.21.15.16:50072) 2023-08-25T04:45:39.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.423+0000 7fdcace9f700 1 -- 172.21.15.16:0/2488359379 learned_addr learned my addr 172.21.15.16:0/2488359379 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:39.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.423+0000 7fdca77fe700 1 --2- 172.21.15.16:0/2488359379 >> v2:172.21.15.117:3300/0 conn(0x7fdca80d0110 0x7fdca80d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.423+0000 7fdcace9f700 1 -- 172.21.15.16:0/2488359379 >> v2:172.21.15.117:3300/0 conn(0x7fdca80d0110 msgr2=0x7fdca80d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:39.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.423+0000 7fdcace9f700 1 --2- 172.21.15.16:0/2488359379 >> v2:172.21.15.117:3300/0 conn(0x7fdca80d0110 0x7fdca80d16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.423+0000 7fdcace9f700 1 -- 172.21.15.16:0/2488359379 >> v1:172.21.15.117:6789/0 conn(0x7fdca8160930 legacy=0x7fdca80cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.423+0000 7fdcace9f700 1 -- 172.21.15.16:0/2488359379 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca80b6160 con 0x7fdca80d3c50 2023-08-25T04:45:39.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.423+0000 7fdcace9f700 1 --2- 172.21.15.16:0/2488359379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca80d3c50 0x7fdca80b6960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdca80ca140 tx=0x7fdca000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3cf66f39bdc035 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.424+0000 7fdca6ffd700 1 -- 172.21.15.16:0/2488359379 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca000e070 con 0x7fdca80d3c50 2023-08-25T04:45:39.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.424+0000 7fdca6ffd700 1 -- 172.21.15.16:0/2488359379 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca000b910 con 0x7fdca80d3c50 2023-08-25T04:45:39.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.424+0000 7fdca6ffd700 1 -- 172.21.15.16:0/2488359379 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca000bcc0 con 0x7fdca80d3c50 2023-08-25T04:45:39.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.424+0000 7fdcae902700 1 -- 172.21.15.16:0/2488359379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca80d3c50 msgr2=0x7fdca80b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.424+0000 7fdcae902700 1 --2- 172.21.15.16:0/2488359379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca80d3c50 0x7fdca80b6960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdca80ca140 tx=0x7fdca000b330 comp rx=0 tx=0).stop 2023-08-25T04:45:39.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.424+0000 7fdcae902700 1 -- 172.21.15.16:0/2488359379 shutdown_connections 2023-08-25T04:45:39.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.424+0000 7fdcae902700 1 --2- 172.21.15.16:0/2488359379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca80d3c50 0x7fdca80b6960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.424+0000 7fdcae902700 1 --2- 172.21.15.16:0/2488359379 >> v2:172.21.15.117:3300/0 conn(0x7fdca80d0110 0x7fdca80d16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.424+0000 7fdcae902700 1 -- 172.21.15.16:0/2488359379 >> 172.21.15.16:0/2488359379 conn(0x7fdca80d30c0 msgr2=0x7fdca80d34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:39.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.424+0000 7fdcae902700 1 -- 172.21.15.16:0/2488359379 shutdown_connections 2023-08-25T04:45:39.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.424+0000 7fdcae902700 1 -- 172.21.15.16:0/2488359379 wait complete. 2023-08-25T04:45:39.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.425+0000 7fdcae902700 1 Processor -- start 2023-08-25T04:45:39.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.426+0000 7fdcae902700 1 -- start start 2023-08-25T04:45:39.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.426+0000 7fdcae902700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdca80d0110 0x7fdca8156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.426+0000 7fdcae902700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca80d3c50 0x7fdca81f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.426+0000 7fdcae902700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca8160930 0x7fdca815d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.426+0000 7fdcae902700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca81f3aa0 con 0x7fdca80d3c50 2023-08-25T04:45:39.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.426+0000 7fdcae902700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca81f34e0 con 0x7fdca8160930 2023-08-25T04:45:39.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.426+0000 7fdcae902700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca81f37c0 con 0x7fdca80d0110 2023-08-25T04:45:39.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.426+0000 7fdca77fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca80d3c50 0x7fdca81f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.426+0000 7fdca77fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca80d3c50 0x7fdca81f2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50076/0 (socket says 172.21.15.16:50076) 2023-08-25T04:45:39.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.426+0000 7fdca77fe700 1 -- 172.21.15.16:0/2136035963 learned_addr learned my addr 172.21.15.16:0/2136035963 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:39.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.426+0000 7fdca7fff700 1 --2- 172.21.15.16:0/2136035963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdca80d0110 0x7fdca8156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.427+0000 7fdcace9f700 1 --2- 172.21.15.16:0/2136035963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca8160930 0x7fdca815d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.427+0000 7fdca77fe700 1 -- 172.21.15.16:0/2136035963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdca80d0110 msgr2=0x7fdca8156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.427+0000 7fdca77fe700 1 --2- 172.21.15.16:0/2136035963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdca80d0110 0x7fdca8156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.427+0000 7fdca77fe700 1 -- 172.21.15.16:0/2136035963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca8160930 msgr2=0x7fdca815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.427+0000 7fdca77fe700 1 --2- 172.21.15.16:0/2136035963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca8160930 0x7fdca815d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.427+0000 7fdca77fe700 1 -- 172.21.15.16:0/2136035963 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0009b30 con 0x7fdca80d3c50 2023-08-25T04:45:39.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.427+0000 7fdca77fe700 1 --2- 172.21.15.16:0/2136035963 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca80d3c50 0x7fdca81f2af0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00e9b0 tx=0x7fdc9c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.427+0000 7fdca4ff9700 1 -- 172.21.15.16:0/2136035963 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c009710 con 0x7fdca80d3c50 2023-08-25T04:45:39.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.427+0000 7fdca4ff9700 1 -- 172.21.15.16:0/2136035963 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c00ee50 con 0x7fdca80d3c50 2023-08-25T04:45:39.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.427+0000 7fdcae902700 1 -- 172.21.15.16:0/2136035963 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca81572c0 con 0x7fdca80d3c50 2023-08-25T04:45:39.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.427+0000 7fdca4ff9700 1 -- 172.21.15.16:0/2136035963 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00ca50 con 0x7fdca80d3c50 2023-08-25T04:45:39.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.427+0000 7fdcae902700 1 -- 172.21.15.16:0/2136035963 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca81f3030 con 0x7fdca80d3c50 2023-08-25T04:45:39.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.428+0000 7fdcae902700 1 -- 172.21.15.16:0/2136035963 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca81f3250 con 0x7fdca80d3c50 2023-08-25T04:45:39.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.429+0000 7fdca4ff9700 1 -- 172.21.15.16:0/2136035963 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdc9c00cbb0 con 0x7fdca80d3c50 2023-08-25T04:45:39.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.429+0000 7fdca4ff9700 1 --2- 172.21.15.16:0/2136035963 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fdc9406a0e0 0x7fdc9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.429+0000 7fdca4ff9700 1 -- 172.21.15.16:0/2136035963 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fdc9c0884d0 con 0x7fdca80d3c50 2023-08-25T04:45:39.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.429+0000 7fdca7fff700 1 --2- 172.21.15.16:0/2136035963 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fdc9406a0e0 0x7fdc9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.430+0000 7fdca7fff700 1 --2- 172.21.15.16:0/2136035963 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fdc9406a0e0 0x7fdc9406c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc98000fb0 tx=0x7fdc98009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.433+0000 7fdca4ff9700 1 -- 172.21.15.16:0/2136035963 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdc9c0576a0 con 0x7fdca80d3c50 2023-08-25T04:45:39.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.635+0000 7fdcae902700 1 -- 172.21.15.16:0/2136035963 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdca804ee70 con 0x7fdca80d3c50 2023-08-25T04:45:39.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.635+0000 7fdca4ff9700 1 -- 172.21.15.16:0/2136035963 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdc9c00ce60 con 0x7fdca80d3c50 2023-08-25T04:45:39.638 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-08-25T04:45:39.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.637+0000 7fdcae902700 1 -- 172.21.15.16:0/2136035963 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fdc9406a0e0 msgr2=0x7fdc9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.637+0000 7fdcae902700 1 --2- 172.21.15.16:0/2136035963 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fdc9406a0e0 0x7fdc9406c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc98000fb0 tx=0x7fdc98009040 comp rx=0 tx=0).stop 2023-08-25T04:45:39.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.637+0000 7fdcae902700 1 -- 172.21.15.16:0/2136035963 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca80d3c50 msgr2=0x7fdca81f2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.637+0000 7fdcae902700 1 --2- 172.21.15.16:0/2136035963 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca80d3c50 0x7fdca81f2af0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00e9b0 tx=0x7fdc9c00ecc0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.637+0000 7fdcae902700 1 -- 172.21.15.16:0/2136035963 shutdown_connections 2023-08-25T04:45:39.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.637+0000 7fdcae902700 1 --2- 172.21.15.16:0/2136035963 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fdc9406a0e0 0x7fdc9406c5a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.637+0000 7fdcae902700 1 --2- 172.21.15.16:0/2136035963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdca8160930 0x7fdca815d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.637+0000 7fdcae902700 1 --2- 172.21.15.16:0/2136035963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdca80d0110 0x7fdca8156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.637+0000 7fdcae902700 1 --2- 172.21.15.16:0/2136035963 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca80d3c50 0x7fdca81f2af0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.637+0000 7fdcae902700 1 -- 172.21.15.16:0/2136035963 >> 172.21.15.16:0/2136035963 conn(0x7fdca80d30c0 msgr2=0x7fdca80b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:39.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.638+0000 7fdcae902700 1 -- 172.21.15.16:0/2136035963 shutdown_connections 2023-08-25T04:45:39.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.638+0000 7fdcae902700 1 -- 172.21.15.16:0/2136035963 wait complete. 2023-08-25T04:45:39.651 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:45:39.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.780+0000 7f611537d700 1 Processor -- start 2023-08-25T04:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.780+0000 7f611537d700 1 -- start start 2023-08-25T04:45:39.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.781+0000 7f611537d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f611015a190 0x7f611006bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.781+0000 7f611537d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611006c4c0 con 0x7f611006aa50 2023-08-25T04:45:39.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.781+0000 7f611537d700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61100aeb20 con 0x7f6110065fe0 2023-08-25T04:45:39.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.781+0000 7f611537d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6110066510 con 0x7f611015a190 2023-08-25T04:45:39.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.781+0000 7f610effd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f611015a190 0x7f611006bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.781+0000 7f610f7fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f611006aa50 0x7f61100cdad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40500/0 (socket says 172.21.15.16:40500) 2023-08-25T04:45:39.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.781+0000 7f610effd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f611015a190 0x7f611006bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50082/0 (socket says 172.21.15.16:50082) 2023-08-25T04:45:39.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.781+0000 7f610f7fe700 1 -- 172.21.15.16:0/1799624169 learned_addr learned my addr 172.21.15.16:0/1799624169 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:39.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.781+0000 7f610effd700 1 -- 172.21.15.16:0/1799624169 >> v1:172.21.15.117:6789/0 conn(0x7f6110065fe0 legacy=0x7f611006a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.781+0000 7f610effd700 1 -- 172.21.15.16:0/1799624169 >> v1:172.21.15.16:6789/0 conn(0x7f611006aa50 legacy=0x7f61100cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.781+0000 7f610effd700 1 -- 172.21.15.16:0/1799624169 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611006b560 con 0x7f611015a190 2023-08-25T04:45:39.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.781+0000 7f610dffb700 1 -- 172.21.15.16:0/1799624169 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3713444861 0 0) 0x7f6108001490 con 0x7f611006aa50 2023-08-25T04:45:39.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.782+0000 7f610effd700 1 --2- 172.21.15.16:0/1799624169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611015a190 0x7f611006bf80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6100009820 tx=0x7f6100009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20d2b69f5093297 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.782+0000 7f610dffb700 1 -- 172.21.15.16:0/1799624169 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100005e30 con 0x7f611015a190 2023-08-25T04:45:39.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.782+0000 7f610dffb700 1 -- 172.21.15.16:0/1799624169 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6100006030 con 0x7f611015a190 2023-08-25T04:45:39.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.782+0000 7f610dffb700 1 -- 172.21.15.16:0/1799624169 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61000063e0 con 0x7f611015a190 2023-08-25T04:45:39.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.782+0000 7f611537d700 1 -- 172.21.15.16:0/1799624169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611015a190 msgr2=0x7f611006bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.782+0000 7f611537d700 1 --2- 172.21.15.16:0/1799624169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611015a190 0x7f611006bf80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6100009820 tx=0x7f6100009b30 comp rx=0 tx=0).stop 2023-08-25T04:45:39.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.782+0000 7f611537d700 1 -- 172.21.15.16:0/1799624169 shutdown_connections 2023-08-25T04:45:39.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.782+0000 7f611537d700 1 --2- 172.21.15.16:0/1799624169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611015a190 0x7f611006bf80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.782+0000 7f611537d700 1 -- 172.21.15.16:0/1799624169 >> 172.21.15.16:0/1799624169 conn(0x7f61100b2440 msgr2=0x7f61100b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:39.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.782+0000 7f611537d700 1 -- 172.21.15.16:0/1799624169 shutdown_connections 2023-08-25T04:45:39.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.782+0000 7f611537d700 1 -- 172.21.15.16:0/1799624169 wait complete. 2023-08-25T04:45:39.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.784+0000 7f611537d700 1 Processor -- start 2023-08-25T04:45:39.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.784+0000 7f611537d700 1 -- start start 2023-08-25T04:45:39.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.784+0000 7f611537d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6110065fe0 0x7f61100ad730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.784+0000 7f611537d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611006aa50 0x7f6110157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.784+0000 7f611537d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f611015a190 0x7f61100b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.784+0000 7f611537d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61100c5860 con 0x7f611006aa50 2023-08-25T04:45:39.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.784+0000 7f611537d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61100c5de0 con 0x7f6110065fe0 2023-08-25T04:45:39.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.784+0000 7f611537d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61100cba40 con 0x7f611015a190 2023-08-25T04:45:39.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f610e7fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611006aa50 0x7f6110157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f610e7fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611006aa50 0x7f6110157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50090/0 (socket says 172.21.15.16:50090) 2023-08-25T04:45:39.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f610e7fc700 1 -- 172.21.15.16:0/3678927460 learned_addr learned my addr 172.21.15.16:0/3678927460 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:39.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f610effd700 1 --2- 172.21.15.16:0/3678927460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6110065fe0 0x7f61100ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f610f7fe700 1 --2- 172.21.15.16:0/3678927460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f611015a190 0x7f61100b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f610e7fc700 1 -- 172.21.15.16:0/3678927460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f611015a190 msgr2=0x7f61100b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f610e7fc700 1 --2- 172.21.15.16:0/3678927460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f611015a190 0x7f61100b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f610e7fc700 1 -- 172.21.15.16:0/3678927460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6110065fe0 msgr2=0x7f61100ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f610e7fc700 1 --2- 172.21.15.16:0/3678927460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6110065fe0 0x7f61100ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f610e7fc700 1 -- 172.21.15.16:0/3678927460 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6100009430 con 0x7f611006aa50 2023-08-25T04:45:39.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f610e7fc700 1 --2- 172.21.15.16:0/3678927460 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611006aa50 0x7f6110157720 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f60f800c540 tx=0x7f60f800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f61077fe700 1 -- 172.21.15.16:0/3678927460 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f80052d0 con 0x7f611006aa50 2023-08-25T04:45:39.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f61077fe700 1 -- 172.21.15.16:0/3678927460 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f8005430 con 0x7f611006aa50 2023-08-25T04:45:39.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f61077fe700 1 -- 172.21.15.16:0/3678927460 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f80038c0 con 0x7f611006aa50 2023-08-25T04:45:39.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f611537d700 1 -- 172.21.15.16:0/3678927460 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61100cb480 con 0x7f611006aa50 2023-08-25T04:45:39.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.785+0000 7f611537d700 1 -- 172.21.15.16:0/3678927460 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61100c5a70 con 0x7f611006aa50 2023-08-25T04:45:39.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.786+0000 7f611537d700 1 -- 172.21.15.16:0/3678927460 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611004ee70 con 0x7f611006aa50 2023-08-25T04:45:39.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.787+0000 7f61077fe700 1 -- 172.21.15.16:0/3678927460 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f60f8003a20 con 0x7f611006aa50 2023-08-25T04:45:39.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.787+0000 7f61077fe700 1 --2- 172.21.15.16:0/3678927460 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f60f006a0e0 0x7f60f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.787+0000 7f61077fe700 1 -- 172.21.15.16:0/3678927460 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f60f8087b00 con 0x7f611006aa50 2023-08-25T04:45:39.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.787+0000 7f610effd700 1 --2- 172.21.15.16:0/3678927460 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f60f006a0e0 0x7f60f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.788+0000 7f610effd700 1 --2- 172.21.15.16:0/3678927460 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f60f006a0e0 0x7f60f006c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6100013040 tx=0x7f6100008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.792+0000 7f61077fe700 1 -- 172.21.15.16:0/3678927460 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f60f8089e60 con 0x7f611006aa50 2023-08-25T04:45:39.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.992+0000 7f611537d700 1 -- 172.21.15.16:0/3678927460 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61100c5f20 con 0x7f611006aa50 2023-08-25T04:45:39.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.992+0000 7f61077fe700 1 -- 172.21.15.16:0/3678927460 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f60f8017020 con 0x7f611006aa50 2023-08-25T04:45:39.994 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-08-25T04:45:39.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.994+0000 7f611537d700 1 -- 172.21.15.16:0/3678927460 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f60f006a0e0 msgr2=0x7f60f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.994+0000 7f611537d700 1 --2- 172.21.15.16:0/3678927460 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f60f006a0e0 0x7f60f006c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6100013040 tx=0x7f6100008070 comp rx=0 tx=0).stop 2023-08-25T04:45:39.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.994+0000 7f611537d700 1 -- 172.21.15.16:0/3678927460 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611006aa50 msgr2=0x7f6110157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.994+0000 7f611537d700 1 --2- 172.21.15.16:0/3678927460 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611006aa50 0x7f6110157720 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f60f800c540 tx=0x7f60f800c900 comp rx=0 tx=0).stop 2023-08-25T04:45:39.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.994+0000 7f611537d700 1 -- 172.21.15.16:0/3678927460 shutdown_connections 2023-08-25T04:45:39.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.994+0000 7f611537d700 1 --2- 172.21.15.16:0/3678927460 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f60f006a0e0 0x7f60f006c5a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.994+0000 7f611537d700 1 --2- 172.21.15.16:0/3678927460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f611015a190 0x7f61100b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.994+0000 7f611537d700 1 --2- 172.21.15.16:0/3678927460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6110065fe0 0x7f61100ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.994+0000 7f611537d700 1 --2- 172.21.15.16:0/3678927460 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611006aa50 0x7f6110157720 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.994+0000 7f611537d700 1 -- 172.21.15.16:0/3678927460 >> 172.21.15.16:0/3678927460 conn(0x7f61100b2440 msgr2=0x7f61100af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:40.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.994+0000 7f611537d700 1 -- 172.21.15.16:0/3678927460 shutdown_connections 2023-08-25T04:45:40.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:39.994+0000 7f611537d700 1 -- 172.21.15.16:0/3678927460 wait complete. 2023-08-25T04:45:40.008 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:45:40.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.137+0000 7f90d0cab700 1 Processor -- start 2023-08-25T04:45:40.139 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.137+0000 7f90d0cab700 1 -- start start 2023-08-25T04:45:40.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.138+0000 7f90d0cab700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90cc143420 0x7f90cc071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.138+0000 7f90d0cab700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc0ce510 0x7f90cc0ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.138+0000 7f90d0cab700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90cc15b0b0 con 0x7f90cc070eb0 2023-08-25T04:45:40.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.138+0000 7f90d0cab700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90cc15a4c0 con 0x7f90cc143420 2023-08-25T04:45:40.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.138+0000 7f90d0cab700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc15a780 con 0x7f90cc0ce510 2023-08-25T04:45:40.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.139+0000 7f90cad9d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc0ce510 0x7f90cc0ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.139+0000 7f90cad9d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc0ce510 0x7f90cc0ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:50642/0 (socket says 172.21.15.16:50642) 2023-08-25T04:45:40.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.139+0000 7f90cad9d700 1 -- 172.21.15.16:0/3757544688 learned_addr learned my addr 172.21.15.16:0/3757544688 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:40.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.139+0000 7f90c9d9b700 1 --2- 172.21.15.16:0/3757544688 >> v2:172.21.15.117:3300/0 conn(0x7f90cc143420 0x7f90cc071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.139+0000 7f90cad9d700 1 -- 172.21.15.16:0/3757544688 >> v2:172.21.15.117:3300/0 conn(0x7f90cc143420 msgr2=0x7f90cc071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:40.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.139+0000 7f90cad9d700 1 --2- 172.21.15.16:0/3757544688 >> v2:172.21.15.117:3300/0 conn(0x7f90cc143420 0x7f90cc071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.139+0000 7f90cad9d700 1 -- 172.21.15.16:0/3757544688 >> v1:172.21.15.117:6789/0 conn(0x7f90cc070eb0 legacy=0x7f90cc071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.139+0000 7f90cad9d700 1 -- 172.21.15.16:0/3757544688 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc15aa60 con 0x7f90cc0ce510 2023-08-25T04:45:40.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.139+0000 7f90cad9d700 1 --2- 172.21.15.16:0/3757544688 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc0ce510 0x7f90cc0ce9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009e50 tx=0x7f90c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c30d47242d46f94 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.139+0000 7f90c959a700 1 -- 172.21.15.16:0/3757544688 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400e070 con 0x7f90cc0ce510 2023-08-25T04:45:40.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.140+0000 7f90c959a700 1 -- 172.21.15.16:0/3757544688 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c400b910 con 0x7f90cc0ce510 2023-08-25T04:45:40.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.140+0000 7f90c959a700 1 -- 172.21.15.16:0/3757544688 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400bcc0 con 0x7f90cc0ce510 2023-08-25T04:45:40.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.140+0000 7f90d0cab700 1 -- 172.21.15.16:0/3757544688 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc0ce510 msgr2=0x7f90cc0ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.140+0000 7f90d0cab700 1 --2- 172.21.15.16:0/3757544688 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc0ce510 0x7f90cc0ce9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009e50 tx=0x7f90c400b330 comp rx=0 tx=0).stop 2023-08-25T04:45:40.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.140+0000 7f90d0cab700 1 -- 172.21.15.16:0/3757544688 shutdown_connections 2023-08-25T04:45:40.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.140+0000 7f90d0cab700 1 --2- 172.21.15.16:0/3757544688 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc0ce510 0x7f90cc0ce9a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.140+0000 7f90d0cab700 1 --2- 172.21.15.16:0/3757544688 >> v2:172.21.15.117:3300/0 conn(0x7f90cc143420 0x7f90cc071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.140+0000 7f90d0cab700 1 -- 172.21.15.16:0/3757544688 >> 172.21.15.16:0/3757544688 conn(0x7f90cc0cfe00 msgr2=0x7f90cc0d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:40.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.140+0000 7f90d0cab700 1 -- 172.21.15.16:0/3757544688 shutdown_connections 2023-08-25T04:45:40.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.140+0000 7f90d0cab700 1 -- 172.21.15.16:0/3757544688 wait complete. 2023-08-25T04:45:40.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.141+0000 7f90d0cab700 1 Processor -- start 2023-08-25T04:45:40.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.142+0000 7f90d0cab700 1 -- start start 2023-08-25T04:45:40.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.142+0000 7f90d0cab700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc070eb0 0x7f90cc159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.142+0000 7f90d0cab700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc0ce510 0x7f90cc0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.142+0000 7f90d0cab700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90cc143420 0x7f90cc0c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.142+0000 7f90d0cab700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0b2c80 con 0x7f90cc143420 2023-08-25T04:45:40.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.142+0000 7f90d0cab700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0b2f60 con 0x7f90cc0ce510 2023-08-25T04:45:40.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.142+0000 7f90d0cab700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0b3240 con 0x7f90cc070eb0 2023-08-25T04:45:40.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.142+0000 7f90cad9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90cc143420 0x7f90cc0c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.142+0000 7f90cad9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90cc143420 0x7f90cc0c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50106/0 (socket says 172.21.15.16:50106) 2023-08-25T04:45:40.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.142+0000 7f90cad9d700 1 -- 172.21.15.16:0/653684944 learned_addr learned my addr 172.21.15.16:0/653684944 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:40.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.142+0000 7f90c9d9b700 1 --2- 172.21.15.16:0/653684944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc0ce510 0x7f90cc0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.142+0000 7f90ca59c700 1 --2- 172.21.15.16:0/653684944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc070eb0 0x7f90cc159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.143+0000 7f90cad9d700 1 -- 172.21.15.16:0/653684944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc070eb0 msgr2=0x7f90cc159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.143+0000 7f90cad9d700 1 --2- 172.21.15.16:0/653684944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc070eb0 0x7f90cc159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.143+0000 7f90cad9d700 1 -- 172.21.15.16:0/653684944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc0ce510 msgr2=0x7f90cc0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.143+0000 7f90cad9d700 1 --2- 172.21.15.16:0/653684944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc0ce510 0x7f90cc0b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.143+0000 7f90cad9d700 1 -- 172.21.15.16:0/653684944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c4009b30 con 0x7f90cc143420 2023-08-25T04:45:40.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.143+0000 7f90cad9d700 1 --2- 172.21.15.16:0/653684944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90cc143420 0x7f90cc0c8720 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f90cc15a8c0 tx=0x7f90c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.143+0000 7f90baffd700 1 -- 172.21.15.16:0/653684944 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4004840 con 0x7f90cc143420 2023-08-25T04:45:40.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.143+0000 7f90d0cab700 1 -- 172.21.15.16:0/653684944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90cc0b3520 con 0x7f90cc143420 2023-08-25T04:45:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.143+0000 7f90baffd700 1 -- 172.21.15.16:0/653684944 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c40099b0 con 0x7f90cc143420 2023-08-25T04:45:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.143+0000 7f90baffd700 1 -- 172.21.15.16:0/653684944 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c401c680 con 0x7f90cc143420 2023-08-25T04:45:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.143+0000 7f90d0cab700 1 -- 172.21.15.16:0/653684944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90cc13c2d0 con 0x7f90cc143420 2023-08-25T04:45:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.144+0000 7f90d0cab700 1 -- 172.21.15.16:0/653684944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90cc04ee70 con 0x7f90cc143420 2023-08-25T04:45:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.145+0000 7f90baffd700 1 -- 172.21.15.16:0/653684944 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f90c401c7e0 con 0x7f90cc143420 2023-08-25T04:45:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.145+0000 7f90baffd700 1 --2- 172.21.15.16:0/653684944 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f90ac06a0e0 0x7f90ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.145+0000 7f90baffd700 1 -- 172.21.15.16:0/653684944 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f90c408a200 con 0x7f90cc143420 2023-08-25T04:45:40.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.145+0000 7f90ca59c700 1 --2- 172.21.15.16:0/653684944 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f90ac06a0e0 0x7f90ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.146+0000 7f90ca59c700 1 --2- 172.21.15.16:0/653684944 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f90ac06a0e0 0x7f90ac06c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0cc170 tx=0x7f90c0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.149+0000 7f90baffd700 1 -- 172.21.15.16:0/653684944 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f90c40558c0 con 0x7f90cc143420 2023-08-25T04:45:40.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.349+0000 7f90d0cab700 1 -- 172.21.15.16:0/653684944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90cc0719e0 con 0x7f90cc143420 2023-08-25T04:45:40.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.350+0000 7f90baffd700 1 -- 172.21.15.16:0/653684944 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f90c4058ee0 con 0x7f90cc143420 2023-08-25T04:45:40.351 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-08-25T04:45:40.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.352+0000 7f90d0cab700 1 -- 172.21.15.16:0/653684944 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f90ac06a0e0 msgr2=0x7f90ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.352+0000 7f90d0cab700 1 --2- 172.21.15.16:0/653684944 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f90ac06a0e0 0x7f90ac06c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0cc170 tx=0x7f90c0009040 comp rx=0 tx=0).stop 2023-08-25T04:45:40.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.352+0000 7f90d0cab700 1 -- 172.21.15.16:0/653684944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90cc143420 msgr2=0x7f90cc0c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.352+0000 7f90d0cab700 1 --2- 172.21.15.16:0/653684944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90cc143420 0x7f90cc0c8720 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f90cc15a8c0 tx=0x7f90c4004ad0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.352+0000 7f90d0cab700 1 -- 172.21.15.16:0/653684944 shutdown_connections 2023-08-25T04:45:40.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.352+0000 7f90d0cab700 1 --2- 172.21.15.16:0/653684944 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f90ac06a0e0 0x7f90ac06c5a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.352+0000 7f90d0cab700 1 --2- 172.21.15.16:0/653684944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90cc143420 0x7f90cc0c8720 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.352+0000 7f90d0cab700 1 --2- 172.21.15.16:0/653684944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc070eb0 0x7f90cc159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.352+0000 7f90d0cab700 1 --2- 172.21.15.16:0/653684944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc0ce510 0x7f90cc0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.352+0000 7f90d0cab700 1 -- 172.21.15.16:0/653684944 >> 172.21.15.16:0/653684944 conn(0x7f90cc0cfe00 msgr2=0x7f90cc06a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:40.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.352+0000 7f90d0cab700 1 -- 172.21.15.16:0/653684944 shutdown_connections 2023-08-25T04:45:40.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.352+0000 7f90d0cab700 1 -- 172.21.15.16:0/653684944 wait complete. 2023-08-25T04:45:40.365 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:45:40.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.492+0000 7f3ba7874700 1 Processor -- start 2023-08-25T04:45:40.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.493+0000 7f3ba7874700 1 -- start start 2023-08-25T04:45:40.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.493+0000 7f3ba7874700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3ba0146630 0x7f3ba00c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3ba7874700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba006e9a0 con 0x7f3ba006aa50 2023-08-25T04:45:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3ba7874700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba006ebf0 con 0x7f3ba01437f0 2023-08-25T04:45:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3ba7874700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba00718e0 con 0x7f3ba0146630 2023-08-25T04:45:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3ba4e0f700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3ba006aa50 0x7f3ba006cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40524/0 (socket says 172.21.15.16:40524) 2023-08-25T04:45:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3ba4e0f700 1 -- 172.21.15.16:0/2197788479 learned_addr learned my addr 172.21.15.16:0/2197788479 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3ba5e11700 1 --2- 172.21.15.16:0/2197788479 >> v2:172.21.15.16:3300/0 conn(0x7f3ba0146630 0x7f3ba00c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3b97fff700 1 -- 172.21.15.16:0/2197788479 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383557342 0 0) 0x7f3ba006e9a0 con 0x7f3ba006aa50 2023-08-25T04:45:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3b97fff700 1 -- 172.21.15.16:0/2197788479 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b8c0035b0 con 0x7f3ba006aa50 2023-08-25T04:45:40.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3ba5e11700 1 -- 172.21.15.16:0/2197788479 >> v1:172.21.15.117:6789/0 conn(0x7f3ba01437f0 legacy=0x7f3ba006a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:40.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3ba5e11700 1 -- 172.21.15.16:0/2197788479 >> v1:172.21.15.16:6789/0 conn(0x7f3ba006aa50 legacy=0x7f3ba006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3ba5e11700 1 -- 172.21.15.16:0/2197788479 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba0071af0 con 0x7f3ba0146630 2023-08-25T04:45:40.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3ba5e11700 1 --2- 172.21.15.16:0/2197788479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ba0146630 0x7f3ba00c68f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009d90 tx=0x7f3b9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f511fab70a81eb6a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3b97fff700 1 -- 172.21.15.16:0/2197788479 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9800e070 con 0x7f3ba0146630 2023-08-25T04:45:40.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3b97fff700 1 -- 172.21.15.16:0/2197788479 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9800bae0 con 0x7f3ba0146630 2023-08-25T04:45:40.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.494+0000 7f3b97fff700 1 -- 172.21.15.16:0/2197788479 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9800be90 con 0x7f3ba0146630 2023-08-25T04:45:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.495+0000 7f3ba7874700 1 -- 172.21.15.16:0/2197788479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ba0146630 msgr2=0x7f3ba00c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.495+0000 7f3ba7874700 1 --2- 172.21.15.16:0/2197788479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ba0146630 0x7f3ba00c68f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009d90 tx=0x7f3b9800b330 comp rx=0 tx=0).stop 2023-08-25T04:45:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.495+0000 7f3ba7874700 1 -- 172.21.15.16:0/2197788479 shutdown_connections 2023-08-25T04:45:40.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.495+0000 7f3ba7874700 1 --2- 172.21.15.16:0/2197788479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ba0146630 0x7f3ba00c68f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.495+0000 7f3ba7874700 1 -- 172.21.15.16:0/2197788479 >> 172.21.15.16:0/2197788479 conn(0x7f3ba00cfe00 msgr2=0x7f3ba00d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:40.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.495+0000 7f3ba7874700 1 -- 172.21.15.16:0/2197788479 shutdown_connections 2023-08-25T04:45:40.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.495+0000 7f3ba7874700 1 -- 172.21.15.16:0/2197788479 wait complete. 2023-08-25T04:45:40.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.497+0000 7f3ba7874700 1 Processor -- start 2023-08-25T04:45:40.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.497+0000 7f3ba7874700 1 -- start start 2023-08-25T04:45:40.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba7874700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba006aa50 0x7f3ba0142250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba7874700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba01437f0 0x7f3ba00c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba7874700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ba0146630 0x7f3ba00b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba7874700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba0142790 con 0x7f3ba0146630 2023-08-25T04:45:40.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba7874700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba00c77d0 con 0x7f3ba006aa50 2023-08-25T04:45:40.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba7874700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba00c7ab0 con 0x7f3ba01437f0 2023-08-25T04:45:40.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba5e11700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ba0146630 0x7f3ba00b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba5e11700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ba0146630 0x7f3ba00b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50120/0 (socket says 172.21.15.16:50120) 2023-08-25T04:45:40.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba5e11700 1 -- 172.21.15.16:0/1758230247 learned_addr learned my addr 172.21.15.16:0/1758230247 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:40.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba5610700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba006aa50 0x7f3ba0142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba4e0f700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba01437f0 0x7f3ba00c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba5e11700 1 -- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba01437f0 msgr2=0x7f3ba00c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba5e11700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba01437f0 0x7f3ba00c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba5e11700 1 -- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba006aa50 msgr2=0x7f3ba0142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba5e11700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba006aa50 0x7f3ba0142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba5e11700 1 -- 172.21.15.16:0/1758230247 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b98009a70 con 0x7f3ba0146630 2023-08-25T04:45:40.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba4e0f700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba01437f0 0x7f3ba00c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:40.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba5e11700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ba0146630 0x7f3ba00b5390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00cd980 tx=0x7f3b98004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3b95ffb700 1 -- 172.21.15.16:0/1758230247 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98004720 con 0x7f3ba0146630 2023-08-25T04:45:40.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3b95ffb700 1 -- 172.21.15.16:0/1758230247 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b980048a0 con 0x7f3ba0146630 2023-08-25T04:45:40.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3ba7874700 1 -- 172.21.15.16:0/1758230247 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba00c7d90 con 0x7f3ba0146630 2023-08-25T04:45:40.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.498+0000 7f3b95ffb700 1 -- 172.21.15.16:0/1758230247 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98012670 con 0x7f3ba0146630 2023-08-25T04:45:40.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.499+0000 7f3ba7874700 1 -- 172.21.15.16:0/1758230247 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba00c8350 con 0x7f3ba0146630 2023-08-25T04:45:40.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.499+0000 7f3ba7874700 1 -- 172.21.15.16:0/1758230247 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba00c51e0 con 0x7f3ba0146630 2023-08-25T04:45:40.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.500+0000 7f3b95ffb700 1 -- 172.21.15.16:0/1758230247 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3b980127d0 con 0x7f3ba0146630 2023-08-25T04:45:40.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.500+0000 7f3b95ffb700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f3b8406a0e0 0x7f3b8406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.501+0000 7f3b95ffb700 1 -- 172.21.15.16:0/1758230247 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3b98089940 con 0x7f3ba0146630 2023-08-25T04:45:40.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.501+0000 7f3ba5610700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f3b8406a0e0 0x7f3b8406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.501+0000 7f3ba5610700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f3b8406a0e0 0x7f3b8406c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3b90004f30 tx=0x7f3b90009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.505+0000 7f3b95ffb700 1 -- 172.21.15.16:0/1758230247 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3ba00c51e0 con 0x7f3ba0146630 2023-08-25T04:45:40.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.705+0000 7f3ba7874700 1 -- 172.21.15.16:0/1758230247 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ba00c51e0 con 0x7f3ba0146630 2023-08-25T04:45:40.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.705+0000 7f3b95ffb700 1 -- 172.21.15.16:0/1758230247 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ba00c51e0 con 0x7f3ba0146630 2023-08-25T04:45:40.708 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-08-25T04:45:40.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.707+0000 7f3ba7874700 1 -- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f3b8406a0e0 msgr2=0x7f3b8406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.707+0000 7f3ba7874700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f3b8406a0e0 0x7f3b8406c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3b90004f30 tx=0x7f3b90009040 comp rx=0 tx=0).stop 2023-08-25T04:45:40.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.707+0000 7f3ba7874700 1 -- 172.21.15.16:0/1758230247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ba0146630 msgr2=0x7f3ba00b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.707+0000 7f3ba7874700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ba0146630 0x7f3ba00b5390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00cd980 tx=0x7f3b98004ad0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.707+0000 7f3ba7874700 1 -- 172.21.15.16:0/1758230247 shutdown_connections 2023-08-25T04:45:40.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.707+0000 7f3ba7874700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f3b8406a0e0 0x7f3b8406c5a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.707+0000 7f3ba7874700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ba0146630 0x7f3ba00b5390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.707+0000 7f3ba7874700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba006aa50 0x7f3ba0142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.707+0000 7f3ba7874700 1 --2- 172.21.15.16:0/1758230247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba01437f0 0x7f3ba00c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.707+0000 7f3ba7874700 1 -- 172.21.15.16:0/1758230247 >> 172.21.15.16:0/1758230247 conn(0x7f3ba00cfe00 msgr2=0x7f3ba0143f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:40.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.708+0000 7f3ba7874700 1 -- 172.21.15.16:0/1758230247 shutdown_connections 2023-08-25T04:45:40.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.708+0000 7f3ba7874700 1 -- 172.21.15.16:0/1758230247 wait complete. 2023-08-25T04:45:40.721 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:45:40.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.848+0000 7fa704353700 1 Processor -- start 2023-08-25T04:45:40.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.848+0000 7fa704353700 1 -- start start 2023-08-25T04:45:40.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.849+0000 7fa704353700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6fc15e920 0x7fa6fc065fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.849+0000 7fa704353700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa6fc06a550 0x7fa6fc06a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.849+0000 7fa704353700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6fc0b1990 con 0x7fa6fc0ae960 2023-08-25T04:45:40.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.849+0000 7fa704353700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6fc06af20 con 0x7fa6fc06a550 2023-08-25T04:45:40.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.849+0000 7fa704353700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc0cbe50 con 0x7fa6fc15e920 2023-08-25T04:45:40.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.849+0000 7fa7028f0700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa6fc06a550 0x7fa6fc06a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.849+0000 7fa7028f0700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa6fc06a550 0x7fa6fc06a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50128/0 (socket says 172.21.15.16:50128) 2023-08-25T04:45:40.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.849+0000 7fa7028f0700 1 -- 172.21.15.16:0/35195036 learned_addr learned my addr 172.21.15.16:0/35195036 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:40.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.849+0000 7fa7020ef700 1 --2- 172.21.15.16:0/35195036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6fc15e920 0x7fa6fc065fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.849+0000 7fa7028f0700 1 -- 172.21.15.16:0/35195036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6fc15e920 msgr2=0x7fa6fc065fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:40.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.849+0000 7fa7028f0700 1 --2- 172.21.15.16:0/35195036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6fc15e920 0x7fa6fc065fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.849+0000 7fa7028f0700 1 -- 172.21.15.16:0/35195036 >> v1:172.21.15.117:6789/0 conn(0x7fa6fc0ae960 legacy=0x7fa6fc0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.849+0000 7fa7028f0700 1 -- 172.21.15.16:0/35195036 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6fc0ccd20 con 0x7fa6fc06a550 2023-08-25T04:45:40.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.850+0000 7fa7028f0700 1 --2- 172.21.15.16:0/35195036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6fc06a550 0x7fa6fc06a9e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009e50 tx=0x7fa6f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd5e553c0321abd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.850+0000 7fa7010ed700 1 -- 172.21.15.16:0/35195036 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f400e070 con 0x7fa6fc06a550 2023-08-25T04:45:40.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.850+0000 7fa7010ed700 1 -- 172.21.15.16:0/35195036 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f400b9c0 con 0x7fa6fc06a550 2023-08-25T04:45:40.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.850+0000 7fa7010ed700 1 -- 172.21.15.16:0/35195036 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f400bd70 con 0x7fa6fc06a550 2023-08-25T04:45:40.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.850+0000 7fa704353700 1 -- 172.21.15.16:0/35195036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6fc06a550 msgr2=0x7fa6fc06a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.850+0000 7fa704353700 1 --2- 172.21.15.16:0/35195036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6fc06a550 0x7fa6fc06a9e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009e50 tx=0x7fa6f400b330 comp rx=0 tx=0).stop 2023-08-25T04:45:40.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.850+0000 7fa704353700 1 -- 172.21.15.16:0/35195036 shutdown_connections 2023-08-25T04:45:40.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.850+0000 7fa704353700 1 --2- 172.21.15.16:0/35195036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6fc06a550 0x7fa6fc06a9e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.850+0000 7fa704353700 1 --2- 172.21.15.16:0/35195036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6fc15e920 0x7fa6fc065fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.850+0000 7fa704353700 1 -- 172.21.15.16:0/35195036 >> 172.21.15.16:0/35195036 conn(0x7fa6fc0b2480 msgr2=0x7fa6fc0b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:40.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.850+0000 7fa704353700 1 -- 172.21.15.16:0/35195036 shutdown_connections 2023-08-25T04:45:40.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.850+0000 7fa704353700 1 -- 172.21.15.16:0/35195036 wait complete. 2023-08-25T04:45:40.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.852+0000 7fa704353700 1 Processor -- start 2023-08-25T04:45:40.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.852+0000 7fa704353700 1 -- start start 2023-08-25T04:45:40.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.852+0000 7fa704353700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6fc06a550 0x7fa6fc15ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.852+0000 7fa704353700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6fc0ae960 0x7fa6fc0c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.852+0000 7fa704353700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6fc15e920 0x7fa6fc0ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.852+0000 7fa704353700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc0c3a10 con 0x7fa6fc06a550 2023-08-25T04:45:40.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.852+0000 7fa704353700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc15b2d0 con 0x7fa6fc0ae960 2023-08-25T04:45:40.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa704353700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc1f35d0 con 0x7fa6fc15e920 2023-08-25T04:45:40.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa7020ef700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6fc06a550 0x7fa6fc15ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa7020ef700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6fc06a550 0x7fa6fc15ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50130/0 (socket says 172.21.15.16:50130) 2023-08-25T04:45:40.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa7020ef700 1 -- 172.21.15.16:0/4258060351 learned_addr learned my addr 172.21.15.16:0/4258060351 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:40.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa7018ee700 1 --2- 172.21.15.16:0/4258060351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6fc0ae960 0x7fa6fc0c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa7028f0700 1 --2- 172.21.15.16:0/4258060351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6fc15e920 0x7fa6fc0ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa7020ef700 1 -- 172.21.15.16:0/4258060351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6fc15e920 msgr2=0x7fa6fc0ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa7020ef700 1 --2- 172.21.15.16:0/4258060351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6fc15e920 0x7fa6fc0ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa7020ef700 1 -- 172.21.15.16:0/4258060351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6fc0ae960 msgr2=0x7fa6fc0c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa7020ef700 1 --2- 172.21.15.16:0/4258060351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6fc0ae960 0x7fa6fc0c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa7020ef700 1 -- 172.21.15.16:0/4258060351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f4009b30 con 0x7fa6fc06a550 2023-08-25T04:45:40.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa7020ef700 1 --2- 172.21.15.16:0/4258060351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6fc06a550 0x7fa6fc15ad90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00e730 tx=0x7fa6ec00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa6f2ffd700 1 -- 172.21.15.16:0/4258060351 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec013610 con 0x7fa6fc06a550 2023-08-25T04:45:40.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa6f2ffd700 1 -- 172.21.15.16:0/4258060351 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec013770 con 0x7fa6fc06a550 2023-08-25T04:45:40.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa704353700 1 -- 172.21.15.16:0/4258060351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6fc0c3070 con 0x7fa6fc06a550 2023-08-25T04:45:40.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa6f2ffd700 1 -- 172.21.15.16:0/4258060351 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec013b20 con 0x7fa6fc06a550 2023-08-25T04:45:40.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.853+0000 7fa704353700 1 -- 172.21.15.16:0/4258060351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6fc0c3630 con 0x7fa6fc06a550 2023-08-25T04:45:40.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.854+0000 7fa704353700 1 -- 172.21.15.16:0/4258060351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6fc04ee70 con 0x7fa6fc06a550 2023-08-25T04:45:40.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.855+0000 7fa6f2ffd700 1 -- 172.21.15.16:0/4258060351 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa6ec013c80 con 0x7fa6fc06a550 2023-08-25T04:45:40.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.855+0000 7fa6f2ffd700 1 --2- 172.21.15.16:0/4258060351 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa6e006a0e0 0x7fa6e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.855+0000 7fa6f2ffd700 1 -- 172.21.15.16:0/4258060351 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa6ec087ef0 con 0x7fa6fc06a550 2023-08-25T04:45:40.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.855+0000 7fa7018ee700 1 --2- 172.21.15.16:0/4258060351 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa6e006a0e0 0x7fa6e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.856+0000 7fa7018ee700 1 --2- 172.21.15.16:0/4258060351 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa6e006a0e0 0x7fa6e006c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc09a230 tx=0x7fa6f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:40.859+0000 7fa6f2ffd700 1 -- 172.21.15.16:0/4258060351 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa6ec057030 con 0x7fa6fc06a550 2023-08-25T04:45:41.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.074+0000 7fa704353700 1 -- 172.21.15.16:0/4258060351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa6fc066650 con 0x7fa6fc06a550 2023-08-25T04:45:41.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.075+0000 7fa6f2ffd700 1 -- 172.21.15.16:0/4258060351 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa6ec021080 con 0x7fa6fc06a550 2023-08-25T04:45:41.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.077+0000 7fa704353700 1 -- 172.21.15.16:0/4258060351 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa6e006a0e0 msgr2=0x7fa6e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.077+0000 7fa704353700 1 --2- 172.21.15.16:0/4258060351 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa6e006a0e0 0x7fa6e006c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc09a230 tx=0x7fa6f8009040 comp rx=0 tx=0).stop 2023-08-25T04:45:41.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.077+0000 7fa704353700 1 -- 172.21.15.16:0/4258060351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6fc06a550 msgr2=0x7fa6fc15ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.077+0000 7fa704353700 1 --2- 172.21.15.16:0/4258060351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6fc06a550 0x7fa6fc15ad90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00e730 tx=0x7fa6ec00eaf0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.077+0000 7fa704353700 1 -- 172.21.15.16:0/4258060351 shutdown_connections 2023-08-25T04:45:41.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.077+0000 7fa704353700 1 --2- 172.21.15.16:0/4258060351 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fa6e006a0e0 0x7fa6e006c5a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.077+0000 7fa704353700 1 --2- 172.21.15.16:0/4258060351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6fc15e920 0x7fa6fc0ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.077+0000 7fa704353700 1 --2- 172.21.15.16:0/4258060351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6fc06a550 0x7fa6fc15ad90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.077+0000 7fa704353700 1 --2- 172.21.15.16:0/4258060351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6fc0ae960 0x7fa6fc0c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.077+0000 7fa704353700 1 -- 172.21.15.16:0/4258060351 >> 172.21.15.16:0/4258060351 conn(0x7fa6fc0b2480 msgr2=0x7fa6fc0cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:41.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.077+0000 7fa704353700 1 -- 172.21.15.16:0/4258060351 shutdown_connections 2023-08-25T04:45:41.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.077+0000 7fa704353700 1 -- 172.21.15.16:0/4258060351 wait complete. 2023-08-25T04:45:41.081 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2023-08-25T04:45:41.090 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-25T04:45:41.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:41.091 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-25T04:45:41.333 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-08-25T04:45:41.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:41.334 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-25T04:45:41.381 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:45:41.382 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:45:41.438 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-08-25T04:45:41.439 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:45:41.496 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:41.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.622+0000 7f618145f700 1 Processor -- start 2023-08-25T04:45:41.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.622+0000 7f618145f700 1 -- start start 2023-08-25T04:45:41.629 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f618145f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f617c0b4080 0x7f617c167fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.629 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f618145f700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617c0b2be0 con 0x7f617c15d520 2023-08-25T04:45:41.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f618145f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617c0d1b00 con 0x7f617c0d3dc0 2023-08-25T04:45:41.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f618145f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617c0ce6f0 con 0x7f617c0b4080 2023-08-25T04:45:41.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f617affd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f617c15d520 0x7f617c0d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40552/0 (socket says 172.21.15.16:40552) 2023-08-25T04:45:41.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f617affd700 1 -- 172.21.15.16:0/3063756920 learned_addr learned my addr 172.21.15.16:0/3063756920 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:41.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f617b7fe700 1 --2- 172.21.15.16:0/3063756920 >> v2:172.21.15.117:3300/0 conn(0x7f617c0b4080 0x7f617c167fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f6179ffb700 1 -- 172.21.15.16:0/3063756920 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165063189 0 0) 0x7f617c0b2be0 con 0x7f617c15d520 2023-08-25T04:45:41.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f6179ffb700 1 -- 172.21.15.16:0/3063756920 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61640035b0 con 0x7f617c15d520 2023-08-25T04:45:41.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f6179ffb700 1 -- 172.21.15.16:0/3063756920 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1529651422 0 0) 0x7f61640035b0 con 0x7f617c15d520 2023-08-25T04:45:41.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f6179ffb700 1 -- 172.21.15.16:0/3063756920 >> v2:172.21.15.117:3300/0 conn(0x7f617c0b4080 msgr2=0x7f617c167fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:41.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f6179ffb700 1 --2- 172.21.15.16:0/3063756920 >> v2:172.21.15.117:3300/0 conn(0x7f617c0b4080 0x7f617c167fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f6179ffb700 1 -- 172.21.15.16:0/3063756920 >> v1:172.21.15.117:6789/0 conn(0x7f617c0d3dc0 legacy=0x7f617c0d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f6179ffb700 1 -- 172.21.15.16:0/3063756920 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c0d0a40 con 0x7f617c15d520 2023-08-25T04:45:41.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f6179ffb700 1 -- 172.21.15.16:0/3063756920 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f6170001670 con 0x7f617c15d520 2023-08-25T04:45:41.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.623+0000 7f6179ffb700 1 -- 172.21.15.16:0/3063756920 >> v1:172.21.15.16:6789/0 conn(0x7f617c15d520 legacy=0x7f617c0d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f6179ffb700 1 --2- 172.21.15.16:0/3063756920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6164003a70 0x7f6164003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f6179ffb700 1 --2- 172.21.15.16:0/3063756920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6164004850 0x7f6164004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f6179ffb700 1 --2- 172.21.15.16:0/3063756920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6164005210 0x7f616400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f6179ffb700 1 -- 172.21.15.16:0/3063756920 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0ce6f0 con 0x7f6164004850 2023-08-25T04:45:41.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f6179ffb700 1 -- 172.21.15.16:0/3063756920 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616400c090 con 0x7f6164005210 2023-08-25T04:45:41.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f6179ffb700 1 -- 172.21.15.16:0/3063756920 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616400c250 con 0x7f6164003a70 2023-08-25T04:45:41.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f617a7fc700 1 --2- 172.21.15.16:0/3063756920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6164004850 0x7f6164004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f617affd700 1 --2- 172.21.15.16:0/3063756920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6164003a70 0x7f6164003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f617b7fe700 1 --2- 172.21.15.16:0/3063756920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6164005210 0x7f616400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f617a7fc700 1 -- 172.21.15.16:0/3063756920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6164003a70 msgr2=0x7f6164003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:41.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f617a7fc700 1 --2- 172.21.15.16:0/3063756920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6164003a70 0x7f6164003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f617a7fc700 1 -- 172.21.15.16:0/3063756920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6164005210 msgr2=0x7f616400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:41.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f617a7fc700 1 --2- 172.21.15.16:0/3063756920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6164005210 0x7f616400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f617b7fe700 1 -- 172.21.15.16:0/3063756920 reap_dead start 2023-08-25T04:45:41.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f617a7fc700 1 -- 172.21.15.16:0/3063756920 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61640035b0 con 0x7f6164004850 2023-08-25T04:45:41.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f617a7fc700 1 --2- 172.21.15.16:0/3063756920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6164004850 0x7f6164004cd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f616c0018d0 tx=0x7f6164005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e99841846fb1666 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:41.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f6179ffb700 1 -- 172.21.15.16:0/3063756920 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c0052d0 con 0x7f6164004850 2023-08-25T04:45:41.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f6179ffb700 1 -- 172.21.15.16:0/3063756920 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c005430 con 0x7f6164004850 2023-08-25T04:45:41.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.624+0000 7f6179ffb700 1 -- 172.21.15.16:0/3063756920 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c0038a0 con 0x7f6164004850 2023-08-25T04:45:41.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.625+0000 7f618145f700 1 -- 172.21.15.16:0/3063756920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6164004850 msgr2=0x7f6164004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.625+0000 7f618145f700 1 --2- 172.21.15.16:0/3063756920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6164004850 0x7f6164004cd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f616c0018d0 tx=0x7f6164005880 comp rx=0 tx=0).stop 2023-08-25T04:45:41.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.625+0000 7f618145f700 1 -- 172.21.15.16:0/3063756920 shutdown_connections 2023-08-25T04:45:41.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.625+0000 7f618145f700 1 --2- 172.21.15.16:0/3063756920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6164004850 0x7f6164004cd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.625+0000 7f618145f700 1 -- 172.21.15.16:0/3063756920 >> 172.21.15.16:0/3063756920 conn(0x7f617c0d3110 msgr2=0x7f617c0d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:41.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.625+0000 7f618145f700 1 -- 172.21.15.16:0/3063756920 shutdown_connections 2023-08-25T04:45:41.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.625+0000 7f618145f700 1 -- 172.21.15.16:0/3063756920 wait complete. 2023-08-25T04:45:41.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.626+0000 7f618145f700 1 Processor -- start 2023-08-25T04:45:41.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.626+0000 7f618145f700 1 -- start start 2023-08-25T04:45:41.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f618145f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6164004850 0x7f617c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f618145f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f617c1543d0 0x7f617c152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f618145f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f617c159900 0x7f617c1e7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f618145f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c15a070 con 0x7f6164004850 2023-08-25T04:45:41.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f618145f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c154bf0 con 0x7f617c159900 2023-08-25T04:45:41.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f618145f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c159db0 con 0x7f617c1543d0 2023-08-25T04:45:41.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f617affd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6164004850 0x7f617c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f617affd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6164004850 0x7f617c153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50152/0 (socket says 172.21.15.16:50152) 2023-08-25T04:45:41.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f617affd700 1 -- 172.21.15.16:0/3000134887 learned_addr learned my addr 172.21.15.16:0/3000134887 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:41.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f617b7fe700 1 --2- 172.21.15.16:0/3000134887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f617c159900 0x7f617c1e7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f617a7fc700 1 --2- 172.21.15.16:0/3000134887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f617c1543d0 0x7f617c152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f617affd700 1 -- 172.21.15.16:0/3000134887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f617c1543d0 msgr2=0x7f617c152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f617affd700 1 --2- 172.21.15.16:0/3000134887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f617c1543d0 0x7f617c152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f617affd700 1 -- 172.21.15.16:0/3000134887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f617c159900 msgr2=0x7f617c1e7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f617affd700 1 --2- 172.21.15.16:0/3000134887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f617c159900 0x7f617c1e7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.627+0000 7f617affd700 1 -- 172.21.15.16:0/3000134887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c153010 con 0x7f6164004850 2023-08-25T04:45:41.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.628+0000 7f617affd700 1 --2- 172.21.15.16:0/3000134887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6164004850 0x7f617c153dd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f61700017a0 tx=0x7f6170007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:41.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.628+0000 7f61637fe700 1 -- 172.21.15.16:0/3000134887 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000f6c0 con 0x7f6164004850 2023-08-25T04:45:41.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.628+0000 7f61637fe700 1 -- 172.21.15.16:0/3000134887 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617000f860 con 0x7f6164004850 2023-08-25T04:45:41.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.628+0000 7f618145f700 1 -- 172.21.15.16:0/3000134887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c1532f0 con 0x7f6164004850 2023-08-25T04:45:41.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.628+0000 7f61637fe700 1 -- 172.21.15.16:0/3000134887 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000fc10 con 0x7f6164004850 2023-08-25T04:45:41.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.628+0000 7f618145f700 1 -- 172.21.15.16:0/3000134887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c1538b0 con 0x7f6164004850 2023-08-25T04:45:41.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.629+0000 7f618145f700 1 -- 172.21.15.16:0/3000134887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c04ee70 con 0x7f6164004850 2023-08-25T04:45:41.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.629+0000 7f61637fe700 1 -- 172.21.15.16:0/3000134887 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f617000fd70 con 0x7f6164004850 2023-08-25T04:45:41.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.630+0000 7f61637fe700 1 --2- 172.21.15.16:0/3000134887 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f616806a0e0 0x7f616806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.630+0000 7f61637fe700 1 -- 172.21.15.16:0/3000134887 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6170088500 con 0x7f6164004850 2023-08-25T04:45:41.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.630+0000 7f617a7fc700 1 --2- 172.21.15.16:0/3000134887 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f616806a0e0 0x7f616806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.630+0000 7f617a7fc700 1 --2- 172.21.15.16:0/3000134887 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f616806a0e0 0x7f616806c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f617c0d2170 tx=0x7f616c005000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:41.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.634+0000 7f61637fe700 1 -- 172.21.15.16:0/3000134887 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6170053db0 con 0x7f6164004850 2023-08-25T04:45:41.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.838+0000 7f618145f700 1 -- 172.21.15.16:0/3000134887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f617c0cf9c0 con 0x7f6164004850 2023-08-25T04:45:41.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.839+0000 7f61637fe700 1 -- 172.21.15.16:0/3000134887 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18329 (secure 0 0 0) 0x7f61700573d0 con 0x7f6164004850 2023-08-25T04:45:41.841 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:45:41.841 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:44:30.464568+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:43:40.197381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:43:41.268759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:41.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.841+0000 7f618145f700 1 -- 172.21.15.16:0/3000134887 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f616806a0e0 msgr2=0x7f616806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.841+0000 7f618145f700 1 --2- 172.21.15.16:0/3000134887 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f616806a0e0 0x7f616806c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f617c0d2170 tx=0x7f616c005000 comp rx=0 tx=0).stop 2023-08-25T04:45:41.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.841+0000 7f618145f700 1 -- 172.21.15.16:0/3000134887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6164004850 msgr2=0x7f617c153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.841+0000 7f618145f700 1 --2- 172.21.15.16:0/3000134887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6164004850 0x7f617c153dd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f61700017a0 tx=0x7f6170007620 comp rx=0 tx=0).stop 2023-08-25T04:45:41.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.841+0000 7f618145f700 1 -- 172.21.15.16:0/3000134887 shutdown_connections 2023-08-25T04:45:41.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.841+0000 7f618145f700 1 --2- 172.21.15.16:0/3000134887 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f616806a0e0 0x7f616806c5a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.841+0000 7f618145f700 1 --2- 172.21.15.16:0/3000134887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f617c159900 0x7f617c1e7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.841+0000 7f618145f700 1 --2- 172.21.15.16:0/3000134887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6164004850 0x7f617c153dd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.841+0000 7f618145f700 1 --2- 172.21.15.16:0/3000134887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f617c1543d0 0x7f617c152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.841+0000 7f618145f700 1 -- 172.21.15.16:0/3000134887 >> 172.21.15.16:0/3000134887 conn(0x7f617c0d3110 msgr2=0x7f617c0cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:41.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.841+0000 7f618145f700 1 -- 172.21.15.16:0/3000134887 shutdown_connections 2023-08-25T04:45:41.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.841+0000 7f618145f700 1 -- 172.21.15.16:0/3000134887 wait complete. 2023-08-25T04:45:41.856 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:43:34.951742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:43:35.360236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:43:40.197381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:43:41.268759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:45:41.857 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:45:41.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.986+0000 7f834da32700 1 Processor -- start 2023-08-25T04:45:41.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.986+0000 7f834da32700 1 -- start start 2023-08-25T04:45:41.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.987+0000 7f834da32700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f83480d1e00 0x7f83480cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.987+0000 7f834da32700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83480c8630 0x7f83480ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.987+0000 7f834da32700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83480d0fb0 con 0x7f834815d5e0 2023-08-25T04:45:41.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.987+0000 7f834da32700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83480d1570 con 0x7f83480d1e00 2023-08-25T04:45:41.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.987+0000 7f834da32700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83480d1290 con 0x7f83480c8630 2023-08-25T04:45:41.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.987+0000 7f83467fc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f83480d1e00 0x7f83480cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.987+0000 7f83467fc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f83480d1e00 0x7f83480cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50160/0 (socket says 172.21.15.16:50160) 2023-08-25T04:45:41.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.987+0000 7f83467fc700 1 -- 172.21.15.16:0/1816432017 learned_addr learned my addr 172.21.15.16:0/1816432017 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:41.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.987+0000 7f83477fe700 1 --2- 172.21.15.16:0/1816432017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83480c8630 0x7f83480ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.987+0000 7f83467fc700 1 -- 172.21.15.16:0/1816432017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83480c8630 msgr2=0x7f83480ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:41.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.987+0000 7f83467fc700 1 --2- 172.21.15.16:0/1816432017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83480c8630 0x7f83480ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.987+0000 7f83467fc700 1 -- 172.21.15.16:0/1816432017 >> v1:172.21.15.117:6789/0 conn(0x7f834815d5e0 legacy=0x7f83480d16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.987+0000 7f83467fc700 1 -- 172.21.15.16:0/1816432017 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83480c6e20 con 0x7f83480d1e00 2023-08-25T04:45:41.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.988+0000 7f83467fc700 1 --2- 172.21.15.16:0/1816432017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83480d1e00 0x7f83480cdd40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f83380098f0 tx=0x7f8338009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75331b8087da751b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:41.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.988+0000 7f8345ffb700 1 -- 172.21.15.16:0/1816432017 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338011830 con 0x7f83480d1e00 2023-08-25T04:45:41.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.988+0000 7f8345ffb700 1 -- 172.21.15.16:0/1816432017 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8338011990 con 0x7f83480d1e00 2023-08-25T04:45:41.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.988+0000 7f8345ffb700 1 -- 172.21.15.16:0/1816432017 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338011d20 con 0x7f83480d1e00 2023-08-25T04:45:41.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.988+0000 7f834da32700 1 -- 172.21.15.16:0/1816432017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83480d1e00 msgr2=0x7f83480cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.988+0000 7f834da32700 1 --2- 172.21.15.16:0/1816432017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83480d1e00 0x7f83480cdd40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f83380098f0 tx=0x7f8338009c00 comp rx=0 tx=0).stop 2023-08-25T04:45:41.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.988+0000 7f834da32700 1 -- 172.21.15.16:0/1816432017 shutdown_connections 2023-08-25T04:45:41.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.988+0000 7f834da32700 1 --2- 172.21.15.16:0/1816432017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83480c8630 0x7f83480ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.988+0000 7f834da32700 1 --2- 172.21.15.16:0/1816432017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83480d1e00 0x7f83480cdd40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.988+0000 7f834da32700 1 -- 172.21.15.16:0/1816432017 >> 172.21.15.16:0/1816432017 conn(0x7f83480d3130 msgr2=0x7f83480d3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:41.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.988+0000 7f834da32700 1 -- 172.21.15.16:0/1816432017 shutdown_connections 2023-08-25T04:45:41.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.988+0000 7f834da32700 1 -- 172.21.15.16:0/1816432017 wait complete. 2023-08-25T04:45:41.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.989+0000 7f834da32700 1 Processor -- start 2023-08-25T04:45:41.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.990+0000 7f834da32700 1 -- start start 2023-08-25T04:45:41.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.990+0000 7f834da32700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83480c8630 0x7f83481f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.990+0000 7f834da32700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83480d1e00 0x7f83480cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.990+0000 7f834da32700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f834815d5e0 0x7f83480ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.990+0000 7f834da32700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83481f6af0 con 0x7f83480c8630 2023-08-25T04:45:41.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.990+0000 7f834da32700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83481f6dd0 con 0x7f834815d5e0 2023-08-25T04:45:42.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.990+0000 7f834da32700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83481f70b0 con 0x7f83480d1e00 2023-08-25T04:45:42.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f8346ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83480c8630 0x7f83481f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f8346ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83480c8630 0x7f83481f61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50164/0 (socket says 172.21.15.16:50164) 2023-08-25T04:45:42.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f8346ffd700 1 -- 172.21.15.16:0/2494134366 learned_addr learned my addr 172.21.15.16:0/2494134366 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:42.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f83467fc700 1 --2- 172.21.15.16:0/2494134366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83480d1e00 0x7f83480cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f83477fe700 1 --2- 172.21.15.16:0/2494134366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f834815d5e0 0x7f83480ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f8346ffd700 1 -- 172.21.15.16:0/2494134366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83480d1e00 msgr2=0x7f83480cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f8346ffd700 1 --2- 172.21.15.16:0/2494134366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83480d1e00 0x7f83480cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f8346ffd700 1 -- 172.21.15.16:0/2494134366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f834815d5e0 msgr2=0x7f83480ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f8346ffd700 1 --2- 172.21.15.16:0/2494134366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f834815d5e0 0x7f83480ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f8346ffd700 1 -- 172.21.15.16:0/2494134366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8338009550 con 0x7f83480c8630 2023-08-25T04:45:42.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f8346ffd700 1 --2- 172.21.15.16:0/2494134366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83480c8630 0x7f83481f61f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f833c00c4e0 tx=0x7f833c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:42.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f832ffff700 1 -- 172.21.15.16:0/2494134366 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c0052d0 con 0x7f83480c8630 2023-08-25T04:45:42.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f832ffff700 1 -- 172.21.15.16:0/2494134366 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c005430 con 0x7f83480c8630 2023-08-25T04:45:42.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f834da32700 1 -- 172.21.15.16:0/2494134366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83480cbf10 con 0x7f83480c8630 2023-08-25T04:45:42.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f832ffff700 1 -- 172.21.15.16:0/2494134366 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c0038c0 con 0x7f83480c8630 2023-08-25T04:45:42.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.991+0000 7f834da32700 1 -- 172.21.15.16:0/2494134366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83481f6730 con 0x7f83480c8630 2023-08-25T04:45:42.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.992+0000 7f834da32700 1 -- 172.21.15.16:0/2494134366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834804ee70 con 0x7f83480c8630 2023-08-25T04:45:42.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.993+0000 7f832ffff700 1 -- 172.21.15.16:0/2494134366 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f833c003a20 con 0x7f83480c8630 2023-08-25T04:45:42.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.993+0000 7f832ffff700 1 --2- 172.21.15.16:0/2494134366 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f833406a0e0 0x7f833406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.993+0000 7f832ffff700 1 -- 172.21.15.16:0/2494134366 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f833c087950 con 0x7f83480c8630 2023-08-25T04:45:42.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.993+0000 7f83467fc700 1 --2- 172.21.15.16:0/2494134366 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f833406a0e0 0x7f833406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.994+0000 7f83467fc700 1 --2- 172.21.15.16:0/2494134366 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f833406a0e0 0x7f833406c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8338009c40 tx=0x7f8338008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:42.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:41.997+0000 7f832ffff700 1 -- 172.21.15.16:0/2494134366 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f833c053000 con 0x7f83480c8630 2023-08-25T04:45:42.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.215+0000 7f834da32700 1 -- 172.21.15.16:0/2494134366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f834815e640 con 0x7f83480c8630 2023-08-25T04:45:42.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.216+0000 7f832ffff700 1 -- 172.21.15.16:0/2494134366 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f833c017020 con 0x7f83480c8630 2023-08-25T04:45:42.218 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-08-25T04:45:42.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.218+0000 7f834da32700 1 -- 172.21.15.16:0/2494134366 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f833406a0e0 msgr2=0x7f833406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.218+0000 7f834da32700 1 --2- 172.21.15.16:0/2494134366 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f833406a0e0 0x7f833406c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8338009c40 tx=0x7f8338008030 comp rx=0 tx=0).stop 2023-08-25T04:45:42.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.218+0000 7f834da32700 1 -- 172.21.15.16:0/2494134366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83480c8630 msgr2=0x7f83481f61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.218+0000 7f834da32700 1 --2- 172.21.15.16:0/2494134366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83480c8630 0x7f83481f61f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f833c00c4e0 tx=0x7f833c00c7f0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.218+0000 7f834da32700 1 -- 172.21.15.16:0/2494134366 shutdown_connections 2023-08-25T04:45:42.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.218+0000 7f834da32700 1 --2- 172.21.15.16:0/2494134366 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f833406a0e0 0x7f833406c5a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.218+0000 7f834da32700 1 --2- 172.21.15.16:0/2494134366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f834815d5e0 0x7f83480ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.218+0000 7f834da32700 1 --2- 172.21.15.16:0/2494134366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83480c8630 0x7f83481f61f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.218+0000 7f834da32700 1 --2- 172.21.15.16:0/2494134366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83480d1e00 0x7f83480cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.218+0000 7f834da32700 1 -- 172.21.15.16:0/2494134366 >> 172.21.15.16:0/2494134366 conn(0x7f83480d3130 msgr2=0x7f83480cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:42.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.218+0000 7f834da32700 1 -- 172.21.15.16:0/2494134366 shutdown_connections 2023-08-25T04:45:42.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.218+0000 7f834da32700 1 -- 172.21.15.16:0/2494134366 wait complete. 2023-08-25T04:45:42.235 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:45:42.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.363+0000 7f53874e0700 1 Processor -- start 2023-08-25T04:45:42.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.363+0000 7f53874e0700 1 -- start start 2023-08-25T04:45:42.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f53874e0700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f53800cde10 0x7f53800d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f53874e0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53800b0030 0x7f53800cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f53874e0700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53800d0060 con 0x7f538015d370 2023-08-25T04:45:42.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f53874e0700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53800d0620 con 0x7f53800cde10 2023-08-25T04:45:42.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f53874e0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53800d0340 con 0x7f53800b0030 2023-08-25T04:45:42.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f538527c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f538015d370 0x7f53800cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40586/0 (socket says 172.21.15.16:40586) 2023-08-25T04:45:42.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f538527c700 1 -- 172.21.15.16:0/1192166741 learned_addr learned my addr 172.21.15.16:0/1192166741 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:42.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f5384a7b700 1 --2- 172.21.15.16:0/1192166741 >> v2:172.21.15.117:3300/0 conn(0x7f53800cde10 0x7f53800d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f5385a7d700 1 --2- 172.21.15.16:0/1192166741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53800b0030 0x7f53800cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f5377fff700 1 -- 172.21.15.16:0/1192166741 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691234458 0 0) 0x7f53800d0060 con 0x7f538015d370 2023-08-25T04:45:42.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f5377fff700 1 -- 172.21.15.16:0/1192166741 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f536c0035b0 con 0x7f538015d370 2023-08-25T04:45:42.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f5377fff700 1 -- 172.21.15.16:0/1192166741 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3832975258 0 0) 0x7f536c0035b0 con 0x7f538015d370 2023-08-25T04:45:42.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f5377fff700 1 -- 172.21.15.16:0/1192166741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53800b0030 msgr2=0x7f53800cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:42.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f5377fff700 1 --2- 172.21.15.16:0/1192166741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53800b0030 0x7f53800cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f5377fff700 1 -- 172.21.15.16:0/1192166741 >> v2:172.21.15.117:3300/0 conn(0x7f53800cde10 msgr2=0x7f53800d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:42.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.364+0000 7f5377fff700 1 --2- 172.21.15.16:0/1192166741 >> v2:172.21.15.117:3300/0 conn(0x7f53800cde10 0x7f53800d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5377fff700 1 -- 172.21.15.16:0/1192166741 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53800cb650 con 0x7f538015d370 2023-08-25T04:45:42.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5377fff700 1 -- 172.21.15.16:0/1192166741 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f53700017f0 con 0x7f538015d370 2023-08-25T04:45:42.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5377fff700 1 -- 172.21.15.16:0/1192166741 >> v1:172.21.15.16:6789/0 conn(0x7f538015d370 legacy=0x7f53800cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5377fff700 1 --2- 172.21.15.16:0/1192166741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f536c003a00 0x7f536c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5377fff700 1 --2- 172.21.15.16:0/1192166741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f536c004850 0x7f536c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5377fff700 1 --2- 172.21.15.16:0/1192166741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53800b0030 0x7f536c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5377fff700 1 -- 172.21.15.16:0/1192166741 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800d0620 con 0x7f536c004850 2023-08-25T04:45:42.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5377fff700 1 -- 172.21.15.16:0/1192166741 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800d0340 con 0x7f536c003a00 2023-08-25T04:45:42.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5377fff700 1 -- 172.21.15.16:0/1192166741 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536c00ba10 con 0x7f53800b0030 2023-08-25T04:45:42.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5384a7b700 1 --2- 172.21.15.16:0/1192166741 >> v2:172.21.15.117:3300/0 conn(0x7f53800cde10 0x7f53800d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:42.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f538527c700 1 --2- 172.21.15.16:0/1192166741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f536c003a00 0x7f536c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5384a7b700 1 --2- 172.21.15.16:0/1192166741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f536c004850 0x7f536c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5385a7d700 1 --2- 172.21.15.16:0/1192166741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53800b0030 0x7f536c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f538527c700 1 -- 172.21.15.16:0/1192166741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53800b0030 msgr2=0x7f536c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:42.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f538527c700 1 --2- 172.21.15.16:0/1192166741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53800b0030 0x7f536c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f538527c700 1 -- 172.21.15.16:0/1192166741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f536c004850 msgr2=0x7f536c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:42.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f538527c700 1 --2- 172.21.15.16:0/1192166741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f536c004850 0x7f536c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f538527c700 1 -- 172.21.15.16:0/1192166741 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c0035b0 con 0x7f536c003a00 2023-08-25T04:45:42.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5384a7b700 1 --2- 172.21.15.16:0/1192166741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f536c004850 0x7f536c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:42.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f538527c700 1 --2- 172.21.15.16:0/1192166741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f536c003a00 0x7f536c003e20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f537000c240 tx=0x7f536c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae6b346bc6d32b52 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:42.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5377fff700 1 -- 172.21.15.16:0/1192166741 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537000cde0 con 0x7f536c003a00 2023-08-25T04:45:42.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5377fff700 1 -- 172.21.15.16:0/1192166741 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5370007bf0 con 0x7f536c003a00 2023-08-25T04:45:42.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.365+0000 7f5377fff700 1 -- 172.21.15.16:0/1192166741 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5370007310 con 0x7f536c003a00 2023-08-25T04:45:42.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.366+0000 7f53874e0700 1 -- 172.21.15.16:0/1192166741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f536c003a00 msgr2=0x7f536c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.366+0000 7f53874e0700 1 --2- 172.21.15.16:0/1192166741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f536c003a00 0x7f536c003e20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f537000c240 tx=0x7f536c005880 comp rx=0 tx=0).stop 2023-08-25T04:45:42.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.366+0000 7f5385a7d700 1 -- 172.21.15.16:0/1192166741 reap_dead start 2023-08-25T04:45:42.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.366+0000 7f53874e0700 1 -- 172.21.15.16:0/1192166741 shutdown_connections 2023-08-25T04:45:42.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.366+0000 7f53874e0700 1 -- 172.21.15.16:0/1192166741 >> 172.21.15.16:0/1192166741 conn(0x7f53800d0e80 msgr2=0x7f53800d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:42.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.366+0000 7f53874e0700 1 -- 172.21.15.16:0/1192166741 shutdown_connections 2023-08-25T04:45:42.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.366+0000 7f53874e0700 1 -- 172.21.15.16:0/1192166741 wait complete. 2023-08-25T04:45:42.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.367+0000 7f53874e0700 1 Processor -- start 2023-08-25T04:45:42.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.367+0000 7f53874e0700 1 -- start start 2023-08-25T04:45:42.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.368+0000 7f53874e0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f536c003a00 0x7f5380150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.368+0000 7f53874e0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f538015a760 0x7f53800aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.368+0000 7f53874e0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53800aefc0 0x7f53800c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.368+0000 7f53874e0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538015a2d0 con 0x7f53800aefc0 2023-08-25T04:45:42.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.368+0000 7f53874e0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800af460 con 0x7f538015a760 2023-08-25T04:45:42.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.368+0000 7f53874e0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53801599a0 con 0x7f536c003a00 2023-08-25T04:45:42.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.368+0000 7f5385a7d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53800aefc0 0x7f53800c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.368+0000 7f5385a7d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53800aefc0 0x7f53800c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50186/0 (socket says 172.21.15.16:50186) 2023-08-25T04:45:42.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.368+0000 7f5385a7d700 1 -- 172.21.15.16:0/312953855 learned_addr learned my addr 172.21.15.16:0/312953855 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:42.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.368+0000 7f538527c700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f536c003a00 0x7f5380150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.368+0000 7f5384a7b700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f538015a760 0x7f53800aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.368+0000 7f5385a7d700 1 -- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f536c003a00 msgr2=0x7f5380150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.368+0000 7f5385a7d700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f536c003a00 0x7f5380150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.368+0000 7f5385a7d700 1 -- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f538015a760 msgr2=0x7f53800aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.369+0000 7f5385a7d700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f538015a760 0x7f53800aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.369+0000 7f5385a7d700 1 -- 172.21.15.16:0/312953855 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5380159c80 con 0x7f53800aefc0 2023-08-25T04:45:42.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.369+0000 7f5384a7b700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f538015a760 0x7f53800aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:42.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.369+0000 7f5385a7d700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53800aefc0 0x7f53800c90e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5380066f80 tx=0x7f5378011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:42.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.369+0000 7f5375ffb700 1 -- 172.21.15.16:0/312953855 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537800e040 con 0x7f53800aefc0 2023-08-25T04:45:42.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.369+0000 7f5375ffb700 1 -- 172.21.15.16:0/312953855 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537800f040 con 0x7f53800aefc0 2023-08-25T04:45:42.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.369+0000 7f53874e0700 1 -- 172.21.15.16:0/312953855 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5380159f60 con 0x7f53800aefc0 2023-08-25T04:45:42.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.369+0000 7f5375ffb700 1 -- 172.21.15.16:0/312953855 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537800fdb0 con 0x7f53800aefc0 2023-08-25T04:45:42.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.369+0000 7f53874e0700 1 -- 172.21.15.16:0/312953855 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5380150a30 con 0x7f53800aefc0 2023-08-25T04:45:42.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.370+0000 7f53874e0700 1 -- 172.21.15.16:0/312953855 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538015a480 con 0x7f53800aefc0 2023-08-25T04:45:42.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.370+0000 7f5375ffb700 1 -- 172.21.15.16:0/312953855 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5378015430 con 0x7f53800aefc0 2023-08-25T04:45:42.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.371+0000 7f5375ffb700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f536406a0e0 0x7f536406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.371+0000 7f5375ffb700 1 -- 172.21.15.16:0/312953855 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5378088a70 con 0x7f53800aefc0 2023-08-25T04:45:42.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.371+0000 7f538527c700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f536406a0e0 0x7f536406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.371+0000 7f538527c700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f536406a0e0 0x7f536406c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5370015040 tx=0x7f5370007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:42.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.375+0000 7f5375ffb700 1 -- 172.21.15.16:0/312953855 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f538015a480 con 0x7f53800aefc0 2023-08-25T04:45:42.576 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.575+0000 7f53874e0700 1 -- 172.21.15.16:0/312953855 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5380150a30 con 0x7f53800aefc0 2023-08-25T04:45:42.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.575+0000 7f5375ffb700 1 -- 172.21.15.16:0/312953855 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5380150a30 con 0x7f53800aefc0 2023-08-25T04:45:42.577 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-08-25T04:45:42.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.577+0000 7f53874e0700 1 -- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f536406a0e0 msgr2=0x7f536406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.577+0000 7f53874e0700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f536406a0e0 0x7f536406c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5370015040 tx=0x7f5370007000 comp rx=0 tx=0).stop 2023-08-25T04:45:42.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.577+0000 7f53874e0700 1 -- 172.21.15.16:0/312953855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53800aefc0 msgr2=0x7f53800c90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.577+0000 7f53874e0700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53800aefc0 0x7f53800c90e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5380066f80 tx=0x7f5378011f80 comp rx=0 tx=0).stop 2023-08-25T04:45:42.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.577+0000 7f53874e0700 1 -- 172.21.15.16:0/312953855 shutdown_connections 2023-08-25T04:45:42.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.577+0000 7f53874e0700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f536406a0e0 0x7f536406c5a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.577+0000 7f53874e0700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53800aefc0 0x7f53800c90e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.577+0000 7f53874e0700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f536c003a00 0x7f5380150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.577+0000 7f53874e0700 1 --2- 172.21.15.16:0/312953855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f538015a760 0x7f53800aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.577+0000 7f53874e0700 1 -- 172.21.15.16:0/312953855 >> 172.21.15.16:0/312953855 conn(0x7f53800d0e80 msgr2=0x7f53800cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:42.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.578+0000 7f53874e0700 1 -- 172.21.15.16:0/312953855 shutdown_connections 2023-08-25T04:45:42.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.578+0000 7f53874e0700 1 -- 172.21.15.16:0/312953855 wait complete. 2023-08-25T04:45:42.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:45:42.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.724+0000 7f4fe9b0a700 1 Processor -- start 2023-08-25T04:45:42.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.724+0000 7f4fe9b0a700 1 -- start start 2023-08-25T04:45:42.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.725+0000 7f4fe9b0a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4fe4070eb0 0x7f4fe4071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.725+0000 7f4fe9b0a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4fe4143420 0x7f4fe4071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.725+0000 7f4fe9b0a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe415b0b0 con 0x7f4fe415dab0 2023-08-25T04:45:42.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.725+0000 7f4fe9b0a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe40717d0 con 0x7f4fe4143420 2023-08-25T04:45:42.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.725+0000 7f4fe9b0a700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe415a4c0 con 0x7f4fe4070eb0 2023-08-25T04:45:42.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.725+0000 7f4fe2ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4fe4143420 0x7f4fe4071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.725+0000 7f4fe3fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4fe415dab0 0x7f4fe415df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40610/0 (socket says 172.21.15.16:40610) 2023-08-25T04:45:42.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.725+0000 7f4fe3fff700 1 -- 172.21.15.16:0/3725940025 learned_addr learned my addr 172.21.15.16:0/3725940025 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:42.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.725+0000 7f4fe37fe700 1 --2- 172.21.15.16:0/3725940025 >> v2:172.21.15.117:3300/0 conn(0x7f4fe4070eb0 0x7f4fe4071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe2ffd700 1 -- 172.21.15.16:0/3725940025 >> v2:172.21.15.117:3300/0 conn(0x7f4fe4070eb0 msgr2=0x7f4fe4071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:42.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe2ffd700 1 --2- 172.21.15.16:0/3725940025 >> v2:172.21.15.117:3300/0 conn(0x7f4fe4070eb0 0x7f4fe4071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe2ffd700 1 -- 172.21.15.16:0/3725940025 >> v1:172.21.15.16:6789/0 conn(0x7f4fe415dab0 legacy=0x7f4fe415df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe27fc700 1 -- 172.21.15.16:0/3725940025 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353039822 0 0) 0x7f4fe415b0b0 con 0x7f4fe415dab0 2023-08-25T04:45:42.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe2ffd700 1 -- 172.21.15.16:0/3725940025 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe415a780 con 0x7f4fe4143420 2023-08-25T04:45:42.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe37fe700 1 --2- 172.21.15.16:0/3725940025 >> v2:172.21.15.117:3300/0 conn(0x7f4fe4070eb0 0x7f4fe4071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:42.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe2ffd700 1 --2- 172.21.15.16:0/3725940025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fe4143420 0x7f4fe4071290 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40cda80 tx=0x7f4fcc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf394f2efa4d852 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:42.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe27fc700 1 -- 172.21.15.16:0/3725940025 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc011830 con 0x7f4fe4143420 2023-08-25T04:45:42.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe27fc700 1 -- 172.21.15.16:0/3725940025 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc011990 con 0x7f4fe4143420 2023-08-25T04:45:42.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe27fc700 1 -- 172.21.15.16:0/3725940025 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc011d20 con 0x7f4fe4143420 2023-08-25T04:45:42.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/3725940025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fe4143420 msgr2=0x7f4fe4071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe9b0a700 1 --2- 172.21.15.16:0/3725940025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fe4143420 0x7f4fe4071290 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40cda80 tx=0x7f4fcc009b20 comp rx=0 tx=0).stop 2023-08-25T04:45:42.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/3725940025 shutdown_connections 2023-08-25T04:45:42.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe9b0a700 1 --2- 172.21.15.16:0/3725940025 >> v2:172.21.15.117:3300/0 conn(0x7f4fe4070eb0 0x7f4fe4071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe9b0a700 1 --2- 172.21.15.16:0/3725940025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fe4143420 0x7f4fe4071290 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.726+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/3725940025 >> 172.21.15.16:0/3725940025 conn(0x7f4fe40cfe00 msgr2=0x7f4fe40d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:42.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.727+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/3725940025 shutdown_connections 2023-08-25T04:45:42.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.727+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/3725940025 wait complete. 2023-08-25T04:45:42.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.728+0000 7f4fe9b0a700 1 Processor -- start 2023-08-25T04:45:42.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.728+0000 7f4fe9b0a700 1 -- start start 2023-08-25T04:45:42.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe9b0a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fe4070eb0 0x7f4fe4157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe9b0a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fe4143420 0x7f4fe406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe9b0a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fe415dab0 0x7f4fe415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe9b0a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40c74d0 con 0x7f4fe4143420 2023-08-25T04:45:42.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe9b0a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40b2fd0 con 0x7f4fe415dab0 2023-08-25T04:45:42.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe9b0a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40b32b0 con 0x7f4fe4070eb0 2023-08-25T04:45:42.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fe4143420 0x7f4fe406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fe4143420 0x7f4fe406aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50200/0 (socket says 172.21.15.16:50200) 2023-08-25T04:45:42.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe2ffd700 1 -- 172.21.15.16:0/1579292389 learned_addr learned my addr 172.21.15.16:0/1579292389 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:42.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe2ffd700 1 -- 172.21.15.16:0/1579292389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fe4070eb0 msgr2=0x7f4fe4157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe2ffd700 1 --2- 172.21.15.16:0/1579292389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fe4070eb0 0x7f4fe4157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe2ffd700 1 -- 172.21.15.16:0/1579292389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fe415dab0 msgr2=0x7f4fe415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe3fff700 1 --2- 172.21.15.16:0/1579292389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fe415dab0 0x7f4fe415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe2ffd700 1 --2- 172.21.15.16:0/1579292389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fe415dab0 0x7f4fe415bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe2ffd700 1 -- 172.21.15.16:0/1579292389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc0094a0 con 0x7f4fe4143420 2023-08-25T04:45:42.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe2ffd700 1 --2- 172.21.15.16:0/1579292389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fe4143420 0x7f4fe406aba0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc000c00 tx=0x7f4fcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:42.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fdbfff700 1 -- 172.21.15.16:0/1579292389 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc0036a0 con 0x7f4fe4143420 2023-08-25T04:45:42.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fdbfff700 1 -- 172.21.15.16:0/1579292389 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc01f070 con 0x7f4fe4143420 2023-08-25T04:45:42.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/1579292389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe40b3590 con 0x7f4fe4143420 2023-08-25T04:45:42.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fdbfff700 1 -- 172.21.15.16:0/1579292389 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc003a60 con 0x7f4fe4143420 2023-08-25T04:45:42.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.729+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/1579292389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe40b3b50 con 0x7f4fe4143420 2023-08-25T04:45:42.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.730+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/1579292389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe404ee70 con 0x7f4fe4143420 2023-08-25T04:45:42.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.731+0000 7f4fdbfff700 1 -- 172.21.15.16:0/1579292389 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4fcc003bc0 con 0x7f4fe4143420 2023-08-25T04:45:42.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.731+0000 7f4fdbfff700 1 --2- 172.21.15.16:0/1579292389 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4fc406a0e0 0x7f4fc406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:42.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.731+0000 7f4fdbfff700 1 -- 172.21.15.16:0/1579292389 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4fcc021070 con 0x7f4fe4143420 2023-08-25T04:45:42.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.731+0000 7f4fe37fe700 1 --2- 172.21.15.16:0/1579292389 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4fc406a0e0 0x7f4fc406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:42.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.732+0000 7f4fe37fe700 1 --2- 172.21.15.16:0/1579292389 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4fc406a0e0 0x7f4fc406c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4009990 tx=0x7f4fd4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:42.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.736+0000 7f4fdbfff700 1 -- 172.21.15.16:0/1579292389 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4fcc055690 con 0x7f4fe4143420 2023-08-25T04:45:42.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.938+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/1579292389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4fe40719e0 con 0x7f4fe4143420 2023-08-25T04:45:42.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.939+0000 7f4fdbfff700 1 -- 172.21.15.16:0/1579292389 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4fcc02b020 con 0x7f4fe4143420 2023-08-25T04:45:42.940 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-08-25T04:45:42.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.941+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/1579292389 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4fc406a0e0 msgr2=0x7f4fc406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.941+0000 7f4fe9b0a700 1 --2- 172.21.15.16:0/1579292389 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4fc406a0e0 0x7f4fc406c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4009990 tx=0x7f4fd4008040 comp rx=0 tx=0).stop 2023-08-25T04:45:42.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.941+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/1579292389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fe4143420 msgr2=0x7f4fe406aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:42.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.941+0000 7f4fe9b0a700 1 --2- 172.21.15.16:0/1579292389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fe4143420 0x7f4fe406aba0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc000c00 tx=0x7f4fcc004750 comp rx=0 tx=0).stop 2023-08-25T04:45:42.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.941+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/1579292389 shutdown_connections 2023-08-25T04:45:42.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.941+0000 7f4fe9b0a700 1 --2- 172.21.15.16:0/1579292389 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4fc406a0e0 0x7f4fc406c5a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.941+0000 7f4fe9b0a700 1 --2- 172.21.15.16:0/1579292389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fe415dab0 0x7f4fe415bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.941+0000 7f4fe9b0a700 1 --2- 172.21.15.16:0/1579292389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fe4070eb0 0x7f4fe4157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.941+0000 7f4fe9b0a700 1 --2- 172.21.15.16:0/1579292389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fe4143420 0x7f4fe406aba0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:42.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.941+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/1579292389 >> 172.21.15.16:0/1579292389 conn(0x7f4fe40cfe00 msgr2=0x7f4fe4159840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:42.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.941+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/1579292389 shutdown_connections 2023-08-25T04:45:42.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:42.941+0000 7f4fe9b0a700 1 -- 172.21.15.16:0/1579292389 wait complete. 2023-08-25T04:45:42.954 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:45:43.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.082+0000 7fee52536700 1 Processor -- start 2023-08-25T04:45:43.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.082+0000 7fee52536700 1 -- start start 2023-08-25T04:45:43.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee52536700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fee4c15d370 0x7fee4c0d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee52536700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c0cde10 0x7fee4c0cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee52536700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c0d0060 con 0x7fee4c0b0030 2023-08-25T04:45:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee52536700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c0d0620 con 0x7fee4c15d370 2023-08-25T04:45:43.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee52536700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0d0340 con 0x7fee4c0cde10 2023-08-25T04:45:43.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee4b7fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fee4c0b0030 0x7fee4c0cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40620/0 (socket says 172.21.15.16:40620) 2023-08-25T04:45:43.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee4b7fe700 1 -- 172.21.15.16:0/107442228 learned_addr learned my addr 172.21.15.16:0/107442228 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:43.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee4bfff700 1 --2- 172.21.15.16:0/107442228 >> v2:172.21.15.117:3300/0 conn(0x7fee4c15d370 0x7fee4c0d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee50ad3700 1 --2- 172.21.15.16:0/107442228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c0cde10 0x7fee4c0cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee4affd700 1 -- 172.21.15.16:0/107442228 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571117206 0 0) 0x7fee4c0d0060 con 0x7fee4c0b0030 2023-08-25T04:45:43.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee4affd700 1 -- 172.21.15.16:0/107442228 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee380035b0 con 0x7fee4c0b0030 2023-08-25T04:45:43.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee4affd700 1 -- 172.21.15.16:0/107442228 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1768216853 0 0) 0x7fee380035b0 con 0x7fee4c0b0030 2023-08-25T04:45:43.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee4affd700 1 -- 172.21.15.16:0/107442228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c0cde10 msgr2=0x7fee4c0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:43.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee4affd700 1 --2- 172.21.15.16:0/107442228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c0cde10 0x7fee4c0cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.083+0000 7fee4affd700 1 -- 172.21.15.16:0/107442228 >> v2:172.21.15.117:3300/0 conn(0x7fee4c15d370 msgr2=0x7fee4c0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4affd700 1 --2- 172.21.15.16:0/107442228 >> v2:172.21.15.117:3300/0 conn(0x7fee4c15d370 0x7fee4c0d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4affd700 1 -- 172.21.15.16:0/107442228 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0cb650 con 0x7fee4c0b0030 2023-08-25T04:45:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4affd700 1 -- 172.21.15.16:0/107442228 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7fee34001670 con 0x7fee4c0b0030 2023-08-25T04:45:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4affd700 1 -- 172.21.15.16:0/107442228 >> v1:172.21.15.16:6789/0 conn(0x7fee4c0b0030 legacy=0x7fee4c0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4affd700 1 --2- 172.21.15.16:0/107442228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee38003a00 0x7fee38003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4affd700 1 --2- 172.21.15.16:0/107442228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c0cde10 0x7fee38004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4affd700 1 --2- 172.21.15.16:0/107442228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee38004d90 0x7fee38005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4affd700 1 -- 172.21.15.16:0/107442228 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0d0620 con 0x7fee38004d90 2023-08-25T04:45:43.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4affd700 1 -- 172.21.15.16:0/107442228 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0d0340 con 0x7fee38003a00 2023-08-25T04:45:43.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4affd700 1 -- 172.21.15.16:0/107442228 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3800ba10 con 0x7fee4c0cde10 2023-08-25T04:45:43.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee50ad3700 1 --2- 172.21.15.16:0/107442228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee38004d90 0x7fee38005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4bfff700 1 --2- 172.21.15.16:0/107442228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee38003a00 0x7fee38003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4b7fe700 1 --2- 172.21.15.16:0/107442228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c0cde10 0x7fee38004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee50ad3700 1 -- 172.21.15.16:0/107442228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c0cde10 msgr2=0x7fee38004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:43.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee50ad3700 1 --2- 172.21.15.16:0/107442228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c0cde10 0x7fee38004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee50ad3700 1 -- 172.21.15.16:0/107442228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee38003a00 msgr2=0x7fee38003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:43.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee50ad3700 1 --2- 172.21.15.16:0/107442228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee38003a00 0x7fee38003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee50ad3700 1 -- 172.21.15.16:0/107442228 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee380035b0 con 0x7fee38004d90 2023-08-25T04:45:43.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee50ad3700 1 --2- 172.21.15.16:0/107442228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee38004d90 0x7fee38005210 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fee44009fc0 tx=0x7fee38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d831c92ef85aa2d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:43.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4affd700 1 -- 172.21.15.16:0/107442228 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4400ebd0 con 0x7fee38004d90 2023-08-25T04:45:43.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4affd700 1 -- 172.21.15.16:0/107442228 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4400f040 con 0x7fee38004d90 2023-08-25T04:45:43.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.084+0000 7fee4affd700 1 -- 172.21.15.16:0/107442228 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44014480 con 0x7fee38004d90 2023-08-25T04:45:43.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.085+0000 7fee52536700 1 -- 172.21.15.16:0/107442228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee38004d90 msgr2=0x7fee38005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:43.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.085+0000 7fee52536700 1 --2- 172.21.15.16:0/107442228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee38004d90 0x7fee38005210 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fee44009fc0 tx=0x7fee38005880 comp rx=0 tx=0).stop 2023-08-25T04:45:43.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.085+0000 7fee50ad3700 1 -- 172.21.15.16:0/107442228 reap_dead start 2023-08-25T04:45:43.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.085+0000 7fee52536700 1 -- 172.21.15.16:0/107442228 shutdown_connections 2023-08-25T04:45:43.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.085+0000 7fee52536700 1 -- 172.21.15.16:0/107442228 >> 172.21.15.16:0/107442228 conn(0x7fee4c0d0e80 msgr2=0x7fee4c0d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:43.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.085+0000 7fee52536700 1 -- 172.21.15.16:0/107442228 shutdown_connections 2023-08-25T04:45:43.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.085+0000 7fee52536700 1 -- 172.21.15.16:0/107442228 wait complete. 2023-08-25T04:45:43.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.086+0000 7fee52536700 1 Processor -- start 2023-08-25T04:45:43.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.086+0000 7fee52536700 1 -- start start 2023-08-25T04:45:43.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.087+0000 7fee52536700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee38004d90 0x7fee4c1f6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.087+0000 7fee52536700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c1f6670 0x7fee4c0b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.087+0000 7fee52536700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee4c0b1c60 0x7fee4c0b5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.087+0000 7fee52536700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0c5570 con 0x7fee4c0b1c60 2023-08-25T04:45:43.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.087+0000 7fee52536700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0c5220 con 0x7fee38004d90 2023-08-25T04:45:43.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.087+0000 7fee52536700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c1f6b10 con 0x7fee4c1f6670 2023-08-25T04:45:43.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.087+0000 7fee50ad3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee4c0b1c60 0x7fee4c0b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.087+0000 7fee50ad3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee4c0b1c60 0x7fee4c0b5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50222/0 (socket says 172.21.15.16:50222) 2023-08-25T04:45:43.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.087+0000 7fee50ad3700 1 -- 172.21.15.16:0/4139132871 learned_addr learned my addr 172.21.15.16:0/4139132871 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:43.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.087+0000 7fee4bfff700 1 --2- 172.21.15.16:0/4139132871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee38004d90 0x7fee4c1f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.087+0000 7fee4b7fe700 1 --2- 172.21.15.16:0/4139132871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c1f6670 0x7fee4c0b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.088+0000 7fee50ad3700 1 -- 172.21.15.16:0/4139132871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c1f6670 msgr2=0x7fee4c0b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:43.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.088+0000 7fee50ad3700 1 --2- 172.21.15.16:0/4139132871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c1f6670 0x7fee4c0b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.088+0000 7fee50ad3700 1 -- 172.21.15.16:0/4139132871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee38004d90 msgr2=0x7fee4c1f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:43.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.088+0000 7fee50ad3700 1 --2- 172.21.15.16:0/4139132871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee38004d90 0x7fee4c1f6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.088+0000 7fee50ad3700 1 -- 172.21.15.16:0/4139132871 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c1f6df0 con 0x7fee4c0b1c60 2023-08-25T04:45:43.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.088+0000 7fee50ad3700 1 --2- 172.21.15.16:0/4139132871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee4c0b1c60 0x7fee4c0b5620 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fee44016000 tx=0x7fee44009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:43.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.088+0000 7fee48ff9700 1 -- 172.21.15.16:0/4139132871 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44014c70 con 0x7fee4c0b1c60 2023-08-25T04:45:43.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.088+0000 7fee48ff9700 1 -- 172.21.15.16:0/4139132871 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee44014df0 con 0x7fee4c0b1c60 2023-08-25T04:45:43.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.088+0000 7fee48ff9700 1 -- 172.21.15.16:0/4139132871 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44003c60 con 0x7fee4c0b1c60 2023-08-25T04:45:43.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.088+0000 7fee52536700 1 -- 172.21.15.16:0/4139132871 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c1f2d20 con 0x7fee4c0b1c60 2023-08-25T04:45:43.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.088+0000 7fee52536700 1 -- 172.21.15.16:0/4139132871 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c0b5d40 con 0x7fee4c0b1c60 2023-08-25T04:45:43.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.089+0000 7fee52536700 1 -- 172.21.15.16:0/4139132871 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4c0c56e0 con 0x7fee4c0b1c60 2023-08-25T04:45:43.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.089+0000 7fee48ff9700 1 -- 172.21.15.16:0/4139132871 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fee44023070 con 0x7fee4c0b1c60 2023-08-25T04:45:43.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.090+0000 7fee48ff9700 1 --2- 172.21.15.16:0/4139132871 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fee2c06a0e0 0x7fee2c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.090+0000 7fee48ff9700 1 -- 172.21.15.16:0/4139132871 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fee44089570 con 0x7fee4c0b1c60 2023-08-25T04:45:43.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.090+0000 7fee4bfff700 1 --2- 172.21.15.16:0/4139132871 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fee2c06a0e0 0x7fee2c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.091+0000 7fee4bfff700 1 --2- 172.21.15.16:0/4139132871 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fee2c06a0e0 0x7fee2c06c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009cc0 tx=0x7fee3c0091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:43.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.094+0000 7fee48ff9700 1 -- 172.21.15.16:0/4139132871 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fee44054dd0 con 0x7fee4c0b1c60 2023-08-25T04:45:43.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.293+0000 7fee52536700 1 -- 172.21.15.16:0/4139132871 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee4c04ee70 con 0x7fee4c0b1c60 2023-08-25T04:45:43.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.294+0000 7fee48ff9700 1 -- 172.21.15.16:0/4139132871 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee440583f0 con 0x7fee4c0b1c60 2023-08-25T04:45:43.295 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-08-25T04:45:43.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.296+0000 7fee52536700 1 -- 172.21.15.16:0/4139132871 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fee2c06a0e0 msgr2=0x7fee2c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:43.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.296+0000 7fee52536700 1 --2- 172.21.15.16:0/4139132871 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fee2c06a0e0 0x7fee2c06c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009cc0 tx=0x7fee3c0091c0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.296+0000 7fee52536700 1 -- 172.21.15.16:0/4139132871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee4c0b1c60 msgr2=0x7fee4c0b5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:43.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.296+0000 7fee52536700 1 --2- 172.21.15.16:0/4139132871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee4c0b1c60 0x7fee4c0b5620 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fee44016000 tx=0x7fee44009750 comp rx=0 tx=0).stop 2023-08-25T04:45:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.296+0000 7fee52536700 1 -- 172.21.15.16:0/4139132871 shutdown_connections 2023-08-25T04:45:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.296+0000 7fee52536700 1 --2- 172.21.15.16:0/4139132871 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fee2c06a0e0 0x7fee2c06c5a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.296+0000 7fee52536700 1 --2- 172.21.15.16:0/4139132871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee4c0b1c60 0x7fee4c0b5620 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.296+0000 7fee52536700 1 --2- 172.21.15.16:0/4139132871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee38004d90 0x7fee4c1f6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.296+0000 7fee52536700 1 --2- 172.21.15.16:0/4139132871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c1f6670 0x7fee4c0b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.296+0000 7fee52536700 1 -- 172.21.15.16:0/4139132871 >> 172.21.15.16:0/4139132871 conn(0x7fee4c0d0e80 msgr2=0x7fee4c06e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:43.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.296+0000 7fee52536700 1 -- 172.21.15.16:0/4139132871 shutdown_connections 2023-08-25T04:45:43.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.296+0000 7fee52536700 1 -- 172.21.15.16:0/4139132871 wait complete. 2023-08-25T04:45:43.310 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:45:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.435+0000 7f75fa592700 1 Processor -- start 2023-08-25T04:45:43.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.435+0000 7f75fa592700 1 -- start start 2023-08-25T04:45:43.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.436+0000 7f75fa592700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f4159690 0x7f75f415a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.436+0000 7f75fa592700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f75f40cb360 0x7f75f40709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.436+0000 7f75fa592700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75f4070f30 0x7f75f40ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.436+0000 7f75fa592700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f4159a70 con 0x7f75f40cb360 2023-08-25T04:45:43.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.436+0000 7f75fa592700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f40713a0 con 0x7f75f4070f30 2023-08-25T04:45:43.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.436+0000 7f75fa592700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f415dd70 con 0x7f75f4159690 2023-08-25T04:45:43.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.436+0000 7f75f37fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f75f40cb360 0x7f75f40709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.436+0000 7f75f37fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f75f40cb360 0x7f75f40709f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50226/0 (socket says 172.21.15.16:50226) 2023-08-25T04:45:43.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.436+0000 7f75f37fe700 1 -- 172.21.15.16:0/1926225223 learned_addr learned my addr 172.21.15.16:0/1926225223 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:43.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.436+0000 7f75f3fff700 1 --2- 172.21.15.16:0/1926225223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f4159690 0x7f75f415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.436+0000 7f75f8b2f700 1 --2- 172.21.15.16:0/1926225223 >> v2:172.21.15.117:3300/0 conn(0x7f75f4070f30 0x7f75f40ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.436+0000 7f75f37fe700 1 -- 172.21.15.16:0/1926225223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f4159690 msgr2=0x7f75f415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:43.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75f37fe700 1 --2- 172.21.15.16:0/1926225223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f4159690 0x7f75f415a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75f37fe700 1 -- 172.21.15.16:0/1926225223 >> v2:172.21.15.117:3300/0 conn(0x7f75f4070f30 msgr2=0x7f75f40ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:43.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75f37fe700 1 --2- 172.21.15.16:0/1926225223 >> v2:172.21.15.117:3300/0 conn(0x7f75f4070f30 0x7f75f40ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75f37fe700 1 -- 172.21.15.16:0/1926225223 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f40718b0 con 0x7f75f40cb360 2023-08-25T04:45:43.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75f37fe700 1 --2- 172.21.15.16:0/1926225223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75f40cb360 0x7f75f40709f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f75f40b0be0 tx=0x7f75e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8013b9a31db46109 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:43.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75f2ffd700 1 -- 172.21.15.16:0/1926225223 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e8011830 con 0x7f75f40cb360 2023-08-25T04:45:43.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75f2ffd700 1 -- 172.21.15.16:0/1926225223 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e8011990 con 0x7f75f40cb360 2023-08-25T04:45:43.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75f2ffd700 1 -- 172.21.15.16:0/1926225223 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e8011d20 con 0x7f75f40cb360 2023-08-25T04:45:43.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75fa592700 1 -- 172.21.15.16:0/1926225223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75f40cb360 msgr2=0x7f75f40709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:43.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75fa592700 1 --2- 172.21.15.16:0/1926225223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75f40cb360 0x7f75f40709f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f75f40b0be0 tx=0x7f75e8009c00 comp rx=0 tx=0).stop 2023-08-25T04:45:43.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75fa592700 1 -- 172.21.15.16:0/1926225223 shutdown_connections 2023-08-25T04:45:43.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75fa592700 1 --2- 172.21.15.16:0/1926225223 >> v2:172.21.15.117:3300/0 conn(0x7f75f4070f30 0x7f75f40ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75fa592700 1 --2- 172.21.15.16:0/1926225223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f4159690 0x7f75f415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75fa592700 1 --2- 172.21.15.16:0/1926225223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75f40cb360 0x7f75f40709f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75fa592700 1 -- 172.21.15.16:0/1926225223 >> 172.21.15.16:0/1926225223 conn(0x7f75f40cbbe0 msgr2=0x7f75f40cbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:43.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.437+0000 7f75fa592700 1 -- 172.21.15.16:0/1926225223 shutdown_connections 2023-08-25T04:45:43.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.438+0000 7f75fa592700 1 -- 172.21.15.16:0/1926225223 wait complete. 2023-08-25T04:45:43.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.439+0000 7f75fa592700 1 Processor -- start 2023-08-25T04:45:43.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.439+0000 7f75fa592700 1 -- start start 2023-08-25T04:45:43.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75fa592700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75f4070f30 0x7f75f4150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75fa592700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f40cb360 0x7f75f4142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75fa592700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f4159690 0x7f75f40ce320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75fa592700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f4143350 con 0x7f75f4070f30 2023-08-25T04:45:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75fa592700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f41513d0 con 0x7f75f40cb360 2023-08-25T04:45:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75fa592700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f41516b0 con 0x7f75f4159690 2023-08-25T04:45:43.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75f3fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75f4070f30 0x7f75f4150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75f3fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75f4070f30 0x7f75f4150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50232/0 (socket says 172.21.15.16:50232) 2023-08-25T04:45:43.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75f3fff700 1 -- 172.21.15.16:0/3627231972 learned_addr learned my addr 172.21.15.16:0/3627231972 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:43.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75f37fe700 1 --2- 172.21.15.16:0/3627231972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f40cb360 0x7f75f4142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75f8b2f700 1 --2- 172.21.15.16:0/3627231972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f4159690 0x7f75f40ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75f3fff700 1 -- 172.21.15.16:0/3627231972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f4159690 msgr2=0x7f75f40ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:43.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75f3fff700 1 --2- 172.21.15.16:0/3627231972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f4159690 0x7f75f40ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75f3fff700 1 -- 172.21.15.16:0/3627231972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f40cb360 msgr2=0x7f75f4142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:43.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75f3fff700 1 --2- 172.21.15.16:0/3627231972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f40cb360 0x7f75f4142e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75f3fff700 1 -- 172.21.15.16:0/3627231972 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e8009550 con 0x7f75f4070f30 2023-08-25T04:45:43.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75f3fff700 1 --2- 172.21.15.16:0/3627231972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75f4070f30 0x7f75f4150d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f75e400e910 tx=0x7f75e400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:43.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75f0ff9700 1 -- 172.21.15.16:0/3627231972 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4010820 con 0x7f75f4070f30 2023-08-25T04:45:43.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75f0ff9700 1 -- 172.21.15.16:0/3627231972 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e4010980 con 0x7f75f4070f30 2023-08-25T04:45:43.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75fa592700 1 -- 172.21.15.16:0/3627231972 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f4151990 con 0x7f75f4070f30 2023-08-25T04:45:43.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.440+0000 7f75f0ff9700 1 -- 172.21.15.16:0/3627231972 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4010d10 con 0x7f75f4070f30 2023-08-25T04:45:43.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.441+0000 7f75fa592700 1 -- 172.21.15.16:0/3627231972 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f4140300 con 0x7f75f4070f30 2023-08-25T04:45:43.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.442+0000 7f75fa592700 1 -- 172.21.15.16:0/3627231972 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f414f6e0 con 0x7f75f4070f30 2023-08-25T04:45:43.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.442+0000 7f75f0ff9700 1 -- 172.21.15.16:0/3627231972 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f75e40113f0 con 0x7f75f4070f30 2023-08-25T04:45:43.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.442+0000 7f75f0ff9700 1 --2- 172.21.15.16:0/3627231972 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f75e006a0e0 0x7f75e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:43.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.442+0000 7f75f0ff9700 1 -- 172.21.15.16:0/3627231972 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f75e4087ef0 con 0x7f75f4070f30 2023-08-25T04:45:43.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.442+0000 7f75f37fe700 1 --2- 172.21.15.16:0/3627231972 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f75e006a0e0 0x7f75e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:43.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.443+0000 7f75f37fe700 1 --2- 172.21.15.16:0/3627231972 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f75e006a0e0 0x7f75e006c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f75e80098f0 tx=0x7f75e8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:43.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.447+0000 7f75f0ff9700 1 -- 172.21.15.16:0/3627231972 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f75e40535a0 con 0x7f75f4070f30 2023-08-25T04:45:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.662+0000 7f75fa592700 1 -- 172.21.15.16:0/3627231972 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f75f404ee70 con 0x7f75f4070f30 2023-08-25T04:45:43.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.662+0000 7f75f0ff9700 1 -- 172.21.15.16:0/3627231972 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f75e4020080 con 0x7f75f4070f30 2023-08-25T04:45:43.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.664+0000 7f75fa592700 1 -- 172.21.15.16:0/3627231972 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f75e006a0e0 msgr2=0x7f75e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.664+0000 7f75fa592700 1 --2- 172.21.15.16:0/3627231972 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f75e006a0e0 0x7f75e006c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f75e80098f0 tx=0x7f75e8008030 comp rx=0 tx=0).stop 2023-08-25T04:45:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.664+0000 7f75fa592700 1 -- 172.21.15.16:0/3627231972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75f4070f30 msgr2=0x7f75f4150d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.664+0000 7f75fa592700 1 --2- 172.21.15.16:0/3627231972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75f4070f30 0x7f75f4150d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f75e400e910 tx=0x7f75e400ec20 comp rx=0 tx=0).stop 2023-08-25T04:45:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.664+0000 7f75fa592700 1 -- 172.21.15.16:0/3627231972 shutdown_connections 2023-08-25T04:45:43.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.664+0000 7f75fa592700 1 --2- 172.21.15.16:0/3627231972 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f75e006a0e0 0x7f75e006c5a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.664+0000 7f75fa592700 1 --2- 172.21.15.16:0/3627231972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f4159690 0x7f75f40ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.664+0000 7f75fa592700 1 --2- 172.21.15.16:0/3627231972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75f4070f30 0x7f75f4150d10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.664+0000 7f75fa592700 1 --2- 172.21.15.16:0/3627231972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f40cb360 0x7f75f4142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:43.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.664+0000 7f75fa592700 1 -- 172.21.15.16:0/3627231972 >> 172.21.15.16:0/3627231972 conn(0x7f75f40cbbe0 msgr2=0x7f75f406d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:43.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.664+0000 7f75fa592700 1 -- 172.21.15.16:0/3627231972 shutdown_connections 2023-08-25T04:45:43.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:43.664+0000 7f75fa592700 1 -- 172.21.15.16:0/3627231972 wait complete. 2023-08-25T04:45:43.669 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2023-08-25T04:45:43.678 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-08-25T04:45:43.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:43.679 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.3 2023-08-25T04:45:43.929 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-08-25T04:45:43.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:43.930 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-25T04:45:43.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:43.963 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-08-25T04:45:43.981 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-25T04:45:43.981 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T04:45:43.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:43.982 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T04:45:44.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:44.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:45:44.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:44.150 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2023-08-25T04:45:44.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:44.247 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-08-25T04:45:44.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:44.266 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2023-08-25T04:45:44.337 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2023-08-25T04:45:44.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:45:44.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:44.339 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-25T04:45:44.360 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-25T04:45:44.360 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-25T04:45:44.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:44.361 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-25T04:45:44.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:44.439 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-25T04:45:44.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:44.533 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2023-08-25T04:45:44.548 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:45:44.551 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:45:44.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:44.619 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-08-25T04:45:44.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:44.677 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2023-08-25T04:45:44.752 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2023-08-25T04:45:44.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:45:44.754 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-08-25T04:45:44.775 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-25T04:45:44.776 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:45:44.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.902+0000 7f1ed346d700 1 Processor -- start 2023-08-25T04:45:44.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.903+0000 7f1ed346d700 1 -- start start 2023-08-25T04:45:44.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.903+0000 7f1ed346d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ecc0b3170 0x7f1ecc0701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:44.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.903+0000 7f1ed346d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ecc0d0970 0x7f1ecc0b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:44.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.903+0000 7f1ed346d700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ecc0cd340 con 0x7f1ecc15b380 2023-08-25T04:45:44.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.903+0000 7f1ed346d700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ecc0cd900 con 0x7f1ecc0b3170 2023-08-25T04:45:44.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.903+0000 7f1ed346d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc070730 con 0x7f1ecc0d0970 2023-08-25T04:45:44.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ed0a08700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ecc0b3170 0x7f1ecc0701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:44.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ed1a0a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ecc0d0970 0x7f1ecc0b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:44.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ed1209700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1ecc15b380 0x7f1ecc0b2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.16:48750/0 (socket says 172.21.15.16:48750) 2023-08-25T04:45:44.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ed1209700 1 -- 172.21.15.16:0/1824708844 learned_addr learned my addr 172.21.15.16:0/1824708844 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:44.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ebffff700 1 -- 172.21.15.16:0/1824708844 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138704600 0 0) 0x7f1ecc0cd340 con 0x7f1ecc15b380 2023-08-25T04:45:44.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ebffff700 1 -- 172.21.15.16:0/1824708844 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eb80035b0 con 0x7f1ecc15b380 2023-08-25T04:45:44.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ed1a0a700 1 -- 172.21.15.16:0/1824708844 >> v2:172.21.15.117:3300/0 conn(0x7f1ecc0b3170 msgr2=0x7f1ecc0701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:44.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ed1a0a700 1 --2- 172.21.15.16:0/1824708844 >> v2:172.21.15.117:3300/0 conn(0x7f1ecc0b3170 0x7f1ecc0701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:44.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ed1a0a700 1 -- 172.21.15.16:0/1824708844 >> v1:172.21.15.117:6789/0 conn(0x7f1ecc15b380 legacy=0x7f1ecc0b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:44.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ed1a0a700 1 -- 172.21.15.16:0/1824708844 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc0cd620 con 0x7f1ecc0d0970 2023-08-25T04:45:44.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ed0a08700 1 --2- 172.21.15.16:0/1824708844 >> v2:172.21.15.117:3300/0 conn(0x7f1ecc0b3170 0x7f1ecc0701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:44.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ed1a0a700 1 --2- 172.21.15.16:0/1824708844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ecc0d0970 0x7f1ecc0b3ec0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009d90 tx=0x7f1ec400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef731f09202c5b5a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:44.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ebffff700 1 -- 172.21.15.16:0/1824708844 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec400e070 con 0x7f1ecc0d0970 2023-08-25T04:45:44.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ebffff700 1 -- 172.21.15.16:0/1824708844 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec400bb20 con 0x7f1ecc0d0970 2023-08-25T04:45:44.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.904+0000 7f1ebffff700 1 -- 172.21.15.16:0/1824708844 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4012430 con 0x7f1ecc0d0970 2023-08-25T04:45:44.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.905+0000 7f1ed346d700 1 -- 172.21.15.16:0/1824708844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ecc0d0970 msgr2=0x7f1ecc0b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:44.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.905+0000 7f1ed346d700 1 --2- 172.21.15.16:0/1824708844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ecc0d0970 0x7f1ecc0b3ec0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009d90 tx=0x7f1ec400b330 comp rx=0 tx=0).stop 2023-08-25T04:45:44.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.905+0000 7f1ed346d700 1 -- 172.21.15.16:0/1824708844 shutdown_connections 2023-08-25T04:45:44.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.905+0000 7f1ed346d700 1 --2- 172.21.15.16:0/1824708844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ecc0d0970 0x7f1ecc0b3ec0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:44.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.905+0000 7f1ed346d700 1 --2- 172.21.15.16:0/1824708844 >> v2:172.21.15.117:3300/0 conn(0x7f1ecc0b3170 0x7f1ecc0701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:44.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.905+0000 7f1ed346d700 1 -- 172.21.15.16:0/1824708844 >> 172.21.15.16:0/1824708844 conn(0x7f1ecc0d0fe0 msgr2=0x7f1ecc0d13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:44.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.905+0000 7f1ed346d700 1 -- 172.21.15.16:0/1824708844 shutdown_connections 2023-08-25T04:45:44.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.905+0000 7f1ed346d700 1 -- 172.21.15.16:0/1824708844 wait complete. 2023-08-25T04:45:44.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.906+0000 7f1ed346d700 1 Processor -- start 2023-08-25T04:45:44.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.906+0000 7f1ed346d700 1 -- start start 2023-08-25T04:45:44.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.907+0000 7f1ed346d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ecc0b3170 0x7f1ecc0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:44.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.907+0000 7f1ed346d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ecc0d0970 0x7f1ecc158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:44.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.907+0000 7f1ed346d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ecc15b380 0x7f1ecc0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:44.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.907+0000 7f1ed346d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc148100 con 0x7f1ecc0b3170 2023-08-25T04:45:44.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.907+0000 7f1ed346d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0c71a0 con 0x7f1ecc0d0970 2023-08-25T04:45:44.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.907+0000 7f1ed346d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1474f0 con 0x7f1ecc15b380 2023-08-25T04:45:44.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.907+0000 7f1ed1209700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ecc0b3170 0x7f1ecc0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:44.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.907+0000 7f1ed1209700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ecc0b3170 0x7f1ecc0c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50246/0 (socket says 172.21.15.16:50246) 2023-08-25T04:45:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.907+0000 7f1ed1209700 1 -- 172.21.15.16:0/3636783675 learned_addr learned my addr 172.21.15.16:0/3636783675 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.907+0000 7f1ed1a0a700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ecc15b380 0x7f1ecc0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.907+0000 7f1ed0a08700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ecc0d0970 0x7f1ecc158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.908+0000 7f1ed1209700 1 -- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ecc15b380 msgr2=0x7f1ecc0c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.908+0000 7f1ed1209700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ecc15b380 0x7f1ecc0c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.908+0000 7f1ed1209700 1 -- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ecc0d0970 msgr2=0x7f1ecc158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.908+0000 7f1ed1209700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ecc0d0970 0x7f1ecc158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.908+0000 7f1ed1209700 1 -- 172.21.15.16:0/3636783675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00094a0 con 0x7f1ecc0b3170 2023-08-25T04:45:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.908+0000 7f1ed0a08700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ecc0d0970 0x7f1ecc158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:44.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.908+0000 7f1ed1209700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ecc0b3170 0x7f1ecc0c6c60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800c4d0 tx=0x7f1ec800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:44.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.908+0000 7f1ebdffb700 1 -- 172.21.15.16:0/3636783675 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8005d70 con 0x7f1ecc0b3170 2023-08-25T04:45:44.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.908+0000 7f1ebdffb700 1 -- 172.21.15.16:0/3636783675 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec80070d0 con 0x7f1ecc0b3170 2023-08-25T04:45:44.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.908+0000 7f1ed346d700 1 -- 172.21.15.16:0/3636783675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec4009a70 con 0x7f1ecc0b3170 2023-08-25T04:45:44.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.908+0000 7f1ebdffb700 1 -- 172.21.15.16:0/3636783675 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8007460 con 0x7f1ecc0b3170 2023-08-25T04:45:44.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.908+0000 7f1ed346d700 1 -- 172.21.15.16:0/3636783675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc147ab0 con 0x7f1ecc0b3170 2023-08-25T04:45:44.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.909+0000 7f1ed346d700 1 -- 172.21.15.16:0/3636783675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ecc04ee70 con 0x7f1ecc0b3170 2023-08-25T04:45:44.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.910+0000 7f1ebdffb700 1 -- 172.21.15.16:0/3636783675 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1ec80075c0 con 0x7f1ecc0b3170 2023-08-25T04:45:44.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.910+0000 7f1ebdffb700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1eb006a0e0 0x7f1eb006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:44.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.910+0000 7f1ebdffb700 1 -- 172.21.15.16:0/3636783675 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1ec8087a60 con 0x7f1ecc0b3170 2023-08-25T04:45:44.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.910+0000 7f1ed0a08700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1eb006a0e0 0x7f1eb006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:44.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.911+0000 7f1ed0a08700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1eb006a0e0 0x7f1eb006c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc15e280 tx=0x7f1ec0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:44.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:44.914+0000 7f1ebdffb700 1 -- 172.21.15.16:0/3636783675 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1ec8053110 con 0x7f1ecc0b3170 2023-08-25T04:45:45.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.112+0000 7f1ed346d700 1 -- 172.21.15.16:0/3636783675 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ecc0cb990 con 0x7f1eb006a0e0 2023-08-25T04:45:45.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.122+0000 7f1ebdffb700 1 -- 172.21.15.16:0/3636783675 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311492 (secure 0 0 0) 0x7f1ec0009a30 con 0x7f1eb006a0e0 2023-08-25T04:45:45.126 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:45:45.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.125+0000 7f1ed346d700 1 -- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1eb006a0e0 msgr2=0x7f1eb006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:45.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.125+0000 7f1ed346d700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1eb006a0e0 0x7f1eb006c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc15e280 tx=0x7f1ec0008040 comp rx=0 tx=0).stop 2023-08-25T04:45:45.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.125+0000 7f1ed346d700 1 -- 172.21.15.16:0/3636783675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ecc0b3170 msgr2=0x7f1ecc0c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:45.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.125+0000 7f1ed346d700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ecc0b3170 0x7f1ecc0c6c60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800c4d0 tx=0x7f1ec800c7e0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.125+0000 7f1ed346d700 1 -- 172.21.15.16:0/3636783675 shutdown_connections 2023-08-25T04:45:45.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.125+0000 7f1ed346d700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1eb006a0e0 0x7f1eb006c5a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.125+0000 7f1ed346d700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ecc15b380 0x7f1ecc0c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.125+0000 7f1ed346d700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ecc0b3170 0x7f1ecc0c6c60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.125+0000 7f1ed346d700 1 --2- 172.21.15.16:0/3636783675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ecc0d0970 0x7f1ecc158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.125+0000 7f1ed346d700 1 -- 172.21.15.16:0/3636783675 >> 172.21.15.16:0/3636783675 conn(0x7f1ecc0d0fe0 msgr2=0x7f1ecc1591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:45.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.125+0000 7f1ed346d700 1 -- 172.21.15.16:0/3636783675 shutdown_connections 2023-08-25T04:45:45.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.125+0000 7f1ed346d700 1 -- 172.21.15.16:0/3636783675 wait complete. 2023-08-25T04:45:45.133 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-08-25T04:45:45.139 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-08-25T04:45:43.404914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":270319820,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":123,"num_read_kb":109,"num_write":846,"num_write_kb":763740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16240,"ondisk_log_size":16240,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1077956,"kb_used_data":782852,"kb_used_omap":13,"kb_used_meta":290930,"kb_avail":753896764,"statfs":{"total":773094113280,"available":771990286336,"internally_reserved":0,"allocated":801640448,"data_stored":800369697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":297912408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,3,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51246775,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":7,"num_read_kb":9,"num_write":476,"num_write_kb":547870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002880"},"pg_stats":[{"pgid":"4.3f","version":"23'217","reported_seq":232,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.833992+0000","last_change":"2023-08-25T04:43:42.895145+0000","last_active":"2023-08-25T04:45:38.833992+0000","last_peered":"2023-08-25T04:45:38.833992+0000","last_clean":"2023-08-25T04:45:38.833992+0000","last_became_active":"2023-08-25T04:43:42.894831+0000","last_became_peered":"2023-08-25T04:43:42.894831+0000","last_unstale":"2023-08-25T04:45:38.833992+0000","last_undegraded":"2023-08-25T04:45:38.833992+0000","last_fullsized":"2023-08-25T04:45:38.833992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:16.917741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'202","reported_seq":217,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.081286+0000","last_change":"2023-08-25T04:43:42.895503+0000","last_active":"2023-08-25T04:45:39.081286+0000","last_peered":"2023-08-25T04:45:39.081286+0000","last_clean":"2023-08-25T04:45:39.081286+0000","last_became_active":"2023-08-25T04:43:42.895245+0000","last_became_peered":"2023-08-25T04:43:42.895245+0000","last_unstale":"2023-08-25T04:45:39.081286+0000","last_undegraded":"2023-08-25T04:45:39.081286+0000","last_fullsized":"2023-08-25T04:45:39.081286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:39:50.519838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"23'251","reported_seq":266,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.825292+0000","last_change":"2023-08-25T04:43:42.888920+0000","last_active":"2023-08-25T04:45:38.825292+0000","last_peered":"2023-08-25T04:45:38.825292+0000","last_clean":"2023-08-25T04:45:38.825292+0000","last_became_active":"2023-08-25T04:43:42.888568+0000","last_became_peered":"2023-08-25T04:43:42.888568+0000","last_unstale":"2023-08-25T04:45:38.825292+0000","last_undegraded":"2023-08-25T04:45:38.825292+0000","last_fullsized":"2023-08-25T04:45:38.825292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:55:39.359039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"23'243","reported_seq":258,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.828550+0000","last_change":"2023-08-25T04:43:42.893868+0000","last_active":"2023-08-25T04:45:38.828550+0000","last_peered":"2023-08-25T04:45:38.828550+0000","last_clean":"2023-08-25T04:45:38.828550+0000","last_became_active":"2023-08-25T04:43:42.893534+0000","last_became_peered":"2023-08-25T04:43:42.893534+0000","last_unstale":"2023-08-25T04:45:38.828550+0000","last_undegraded":"2023-08-25T04:45:38.828550+0000","last_fullsized":"2023-08-25T04:45:38.828550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:20.295263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"23'233","reported_seq":248,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.069585+0000","last_change":"2023-08-25T04:43:42.902297+0000","last_active":"2023-08-25T04:45:39.069585+0000","last_peered":"2023-08-25T04:45:39.069585+0000","last_clean":"2023-08-25T04:45:39.069585+0000","last_became_active":"2023-08-25T04:43:42.901963+0000","last_became_peered":"2023-08-25T04:43:42.901963+0000","last_unstale":"2023-08-25T04:45:39.069585+0000","last_undegraded":"2023-08-25T04:45:39.069585+0000","last_fullsized":"2023-08-25T04:45:39.069585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:30:27.322745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'257","reported_seq":272,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.071191+0000","last_change":"2023-08-25T04:43:42.888877+0000","last_active":"2023-08-25T04:45:39.071191+0000","last_peered":"2023-08-25T04:45:39.071191+0000","last_clean":"2023-08-25T04:45:39.071191+0000","last_became_active":"2023-08-25T04:43:42.888567+0000","last_became_peered":"2023-08-25T04:43:42.888567+0000","last_unstale":"2023-08-25T04:45:39.071191+0000","last_undegraded":"2023-08-25T04:45:39.071191+0000","last_fullsized":"2023-08-25T04:45:39.071191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:15:07.375032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"23'275","reported_seq":290,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.829890+0000","last_change":"2023-08-25T04:43:42.902469+0000","last_active":"2023-08-25T04:45:38.829890+0000","last_peered":"2023-08-25T04:45:38.829890+0000","last_clean":"2023-08-25T04:45:38.829890+0000","last_became_active":"2023-08-25T04:43:42.902156+0000","last_became_peered":"2023-08-25T04:43:42.902156+0000","last_unstale":"2023-08-25T04:45:38.829890+0000","last_undegraded":"2023-08-25T04:45:38.829890+0000","last_fullsized":"2023-08-25T04:45:38.829890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:59.175818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"23'252","reported_seq":267,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.819259+0000","last_change":"2023-08-25T04:43:42.895697+0000","last_active":"2023-08-25T04:45:38.819259+0000","last_peered":"2023-08-25T04:45:38.819259+0000","last_clean":"2023-08-25T04:45:38.819259+0000","last_became_active":"2023-08-25T04:43:42.895410+0000","last_became_peered":"2023-08-25T04:43:42.895410+0000","last_unstale":"2023-08-25T04:45:38.819259+0000","last_undegraded":"2023-08-25T04:45:38.819259+0000","last_fullsized":"2023-08-25T04:45:38.819259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:17:01.748486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"23'235","reported_seq":250,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.835167+0000","last_change":"2023-08-25T04:43:42.897483+0000","last_active":"2023-08-25T04:45:38.835167+0000","last_peered":"2023-08-25T04:45:38.835167+0000","last_clean":"2023-08-25T04:45:38.835167+0000","last_became_active":"2023-08-25T04:43:42.896949+0000","last_became_peered":"2023-08-25T04:43:42.896949+0000","last_unstale":"2023-08-25T04:45:38.835167+0000","last_undegraded":"2023-08-25T04:45:38.835167+0000","last_fullsized":"2023-08-25T04:45:38.835167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:20.889807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'255","reported_seq":270,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.828268+0000","last_change":"2023-08-25T04:43:42.895115+0000","last_active":"2023-08-25T04:45:38.828268+0000","last_peered":"2023-08-25T04:45:38.828268+0000","last_clean":"2023-08-25T04:45:38.828268+0000","last_became_active":"2023-08-25T04:43:42.894786+0000","last_became_peered":"2023-08-25T04:43:42.894786+0000","last_unstale":"2023-08-25T04:45:38.828268+0000","last_undegraded":"2023-08-25T04:45:38.828268+0000","last_fullsized":"2023-08-25T04:45:38.828268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:04:31.758204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"23'230","reported_seq":245,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.077737+0000","last_change":"2023-08-25T04:43:42.892793+0000","last_active":"2023-08-25T04:45:39.077737+0000","last_peered":"2023-08-25T04:45:39.077737+0000","last_clean":"2023-08-25T04:45:39.077737+0000","last_became_active":"2023-08-25T04:43:42.892558+0000","last_became_peered":"2023-08-25T04:43:42.892558+0000","last_unstale":"2023-08-25T04:45:39.077737+0000","last_undegraded":"2023-08-25T04:45:39.077737+0000","last_fullsized":"2023-08-25T04:45:39.077737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:35:57.269293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"23'240","reported_seq":255,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.817939+0000","last_change":"2023-08-25T04:43:42.892113+0000","last_active":"2023-08-25T04:45:38.817939+0000","last_peered":"2023-08-25T04:45:38.817939+0000","last_clean":"2023-08-25T04:45:38.817939+0000","last_became_active":"2023-08-25T04:43:42.891782+0000","last_became_peered":"2023-08-25T04:43:42.891782+0000","last_unstale":"2023-08-25T04:45:38.817939+0000","last_undegraded":"2023-08-25T04:45:38.817939+0000","last_fullsized":"2023-08-25T04:45:38.817939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:15:53.162927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'244","reported_seq":259,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.836328+0000","last_change":"2023-08-25T04:43:42.896635+0000","last_active":"2023-08-25T04:45:38.836328+0000","last_peered":"2023-08-25T04:45:38.836328+0000","last_clean":"2023-08-25T04:45:38.836328+0000","last_became_active":"2023-08-25T04:43:42.896334+0000","last_became_peered":"2023-08-25T04:43:42.896334+0000","last_unstale":"2023-08-25T04:45:38.836328+0000","last_undegraded":"2023-08-25T04:45:38.836328+0000","last_fullsized":"2023-08-25T04:45:38.836328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:55:06.974267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'255","reported_seq":270,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.818599+0000","last_change":"2023-08-25T04:43:42.894765+0000","last_active":"2023-08-25T04:45:38.818599+0000","last_peered":"2023-08-25T04:45:38.818599+0000","last_clean":"2023-08-25T04:45:38.818599+0000","last_became_active":"2023-08-25T04:43:42.894472+0000","last_became_peered":"2023-08-25T04:43:42.894472+0000","last_unstale":"2023-08-25T04:45:38.818599+0000","last_undegraded":"2023-08-25T04:45:38.818599+0000","last_fullsized":"2023-08-25T04:45:38.818599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:30:27.322745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"23'251","reported_seq":266,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.829949+0000","last_change":"2023-08-25T04:43:42.902458+0000","last_active":"2023-08-25T04:45:38.829949+0000","last_peered":"2023-08-25T04:45:38.829949+0000","last_clean":"2023-08-25T04:45:38.829949+0000","last_became_active":"2023-08-25T04:43:42.902184+0000","last_became_peered":"2023-08-25T04:43:42.902184+0000","last_unstale":"2023-08-25T04:45:38.829949+0000","last_undegraded":"2023-08-25T04:45:38.829949+0000","last_fullsized":"2023-08-25T04:45:38.829949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:07.315621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"23'230","reported_seq":245,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.070980+0000","last_change":"2023-08-25T04:43:42.889087+0000","last_active":"2023-08-25T04:45:39.070980+0000","last_peered":"2023-08-25T04:45:39.070980+0000","last_clean":"2023-08-25T04:45:39.070980+0000","last_became_active":"2023-08-25T04:43:42.888730+0000","last_became_peered":"2023-08-25T04:43:42.888730+0000","last_unstale":"2023-08-25T04:45:39.070980+0000","last_undegraded":"2023-08-25T04:45:39.070980+0000","last_fullsized":"2023-08-25T04:45:39.070980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:56.162169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"23'244","reported_seq":259,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.835438+0000","last_change":"2023-08-25T04:43:42.898466+0000","last_active":"2023-08-25T04:45:38.835438+0000","last_peered":"2023-08-25T04:45:38.835438+0000","last_clean":"2023-08-25T04:45:38.835438+0000","last_became_active":"2023-08-25T04:43:42.898103+0000","last_became_peered":"2023-08-25T04:43:42.898103+0000","last_unstale":"2023-08-25T04:45:38.835438+0000","last_undegraded":"2023-08-25T04:45:38.835438+0000","last_fullsized":"2023-08-25T04:45:38.835438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:34.861062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'234","reported_seq":249,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.817040+0000","last_change":"2023-08-25T04:43:42.892153+0000","last_active":"2023-08-25T04:45:38.817040+0000","last_peered":"2023-08-25T04:45:38.817040+0000","last_clean":"2023-08-25T04:45:38.817040+0000","last_became_active":"2023-08-25T04:43:42.891874+0000","last_became_peered":"2023-08-25T04:43:42.891874+0000","last_unstale":"2023-08-25T04:45:38.817040+0000","last_undegraded":"2023-08-25T04:45:38.817040+0000","last_fullsized":"2023-08-25T04:45:38.817040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:08:00.896369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"23'219","reported_seq":234,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.824656+0000","last_change":"2023-08-25T04:43:42.895594+0000","last_active":"2023-08-25T04:45:38.824656+0000","last_peered":"2023-08-25T04:45:38.824656+0000","last_clean":"2023-08-25T04:45:38.824656+0000","last_became_active":"2023-08-25T04:43:42.895114+0000","last_became_peered":"2023-08-25T04:43:42.895114+0000","last_unstale":"2023-08-25T04:45:38.824656+0000","last_undegraded":"2023-08-25T04:45:38.824656+0000","last_fullsized":"2023-08-25T04:45:38.824656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:15.328992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'248","reported_seq":263,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.821063+0000","last_change":"2023-08-25T04:43:42.896149+0000","last_active":"2023-08-25T04:45:38.821063+0000","last_peered":"2023-08-25T04:45:38.821063+0000","last_clean":"2023-08-25T04:45:38.821063+0000","last_became_active":"2023-08-25T04:43:42.895893+0000","last_became_peered":"2023-08-25T04:43:42.895893+0000","last_unstale":"2023-08-25T04:45:38.821063+0000","last_undegraded":"2023-08-25T04:45:38.821063+0000","last_fullsized":"2023-08-25T04:45:38.821063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:26:47.525605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"23'245","reported_seq":260,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.835916+0000","last_change":"2023-08-25T04:43:42.905467+0000","last_active":"2023-08-25T04:45:38.835916+0000","last_peered":"2023-08-25T04:45:38.835916+0000","last_clean":"2023-08-25T04:45:38.835916+0000","last_became_active":"2023-08-25T04:43:42.905157+0000","last_became_peered":"2023-08-25T04:43:42.905157+0000","last_unstale":"2023-08-25T04:45:38.835916+0000","last_undegraded":"2023-08-25T04:45:38.835916+0000","last_fullsized":"2023-08-25T04:45:38.835916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:35.214306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"23'260","reported_seq":275,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.828306+0000","last_change":"2023-08-25T04:43:42.881107+0000","last_active":"2023-08-25T04:45:38.828306+0000","last_peered":"2023-08-25T04:45:38.828306+0000","last_clean":"2023-08-25T04:45:38.828306+0000","last_became_active":"2023-08-25T04:43:42.879881+0000","last_became_peered":"2023-08-25T04:43:42.879881+0000","last_unstale":"2023-08-25T04:45:38.828306+0000","last_undegraded":"2023-08-25T04:45:38.828306+0000","last_fullsized":"2023-08-25T04:45:38.828306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:12.206120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'224","reported_seq":234,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.829876+0000","last_change":"2023-08-25T04:44:30.818677+0000","last_active":"2023-08-25T04:45:38.829876+0000","last_peered":"2023-08-25T04:45:38.829876+0000","last_clean":"2023-08-25T04:45:38.829876+0000","last_became_active":"2023-08-25T04:44:30.818308+0000","last_became_peered":"2023-08-25T04:44:30.818308+0000","last_unstale":"2023-08-25T04:45:38.829876+0000","last_undegraded":"2023-08-25T04:45:38.829876+0000","last_fullsized":"2023-08-25T04:45:38.829876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:43.562022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"23'218","reported_seq":233,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.833836+0000","last_change":"2023-08-25T04:43:42.897136+0000","last_active":"2023-08-25T04:45:38.833836+0000","last_peered":"2023-08-25T04:45:38.833836+0000","last_clean":"2023-08-25T04:45:38.833836+0000","last_became_active":"2023-08-25T04:43:42.896869+0000","last_became_peered":"2023-08-25T04:43:42.896869+0000","last_unstale":"2023-08-25T04:45:38.833836+0000","last_undegraded":"2023-08-25T04:45:38.833836+0000","last_fullsized":"2023-08-25T04:45:38.833836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:04.986803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"23'233","reported_seq":248,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.065926+0000","last_change":"2023-08-25T04:43:42.893954+0000","last_active":"2023-08-25T04:45:39.065926+0000","last_peered":"2023-08-25T04:45:39.065926+0000","last_clean":"2023-08-25T04:45:39.065926+0000","last_became_active":"2023-08-25T04:43:42.893673+0000","last_became_peered":"2023-08-25T04:43:42.893673+0000","last_unstale":"2023-08-25T04:45:39.065926+0000","last_undegraded":"2023-08-25T04:45:39.065926+0000","last_fullsized":"2023-08-25T04:45:39.065926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:17:01.748486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'255","reported_seq":270,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.833200+0000","last_change":"2023-08-25T04:43:42.888116+0000","last_active":"2023-08-25T04:45:38.833200+0000","last_peered":"2023-08-25T04:45:38.833200+0000","last_clean":"2023-08-25T04:45:38.833200+0000","last_became_active":"2023-08-25T04:43:42.887831+0000","last_became_peered":"2023-08-25T04:43:42.887831+0000","last_unstale":"2023-08-25T04:45:38.833200+0000","last_undegraded":"2023-08-25T04:45:38.833200+0000","last_fullsized":"2023-08-25T04:45:38.833200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:39:50.519838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'216","reported_seq":231,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.818892+0000","last_change":"2023-08-25T04:43:42.894954+0000","last_active":"2023-08-25T04:45:38.818892+0000","last_peered":"2023-08-25T04:45:38.818892+0000","last_clean":"2023-08-25T04:45:38.818892+0000","last_became_active":"2023-08-25T04:43:42.894302+0000","last_became_peered":"2023-08-25T04:43:42.894302+0000","last_unstale":"2023-08-25T04:45:38.818892+0000","last_undegraded":"2023-08-25T04:45:38.818892+0000","last_fullsized":"2023-08-25T04:45:38.818892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:05:02.005895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282331+0000","last_change":"2023-08-25T04:43:41.888584+0000","last_active":"2023-08-25T04:44:31.282331+0000","last_peered":"2023-08-25T04:44:31.282331+0000","last_clean":"2023-08-25T04:44:31.282331+0000","last_became_active":"2023-08-25T04:43:41.888339+0000","last_became_peered":"2023-08-25T04:43:41.888339+0000","last_unstale":"2023-08-25T04:44:31.282331+0000","last_undegraded":"2023-08-25T04:44:31.282331+0000","last_fullsized":"2023-08-25T04:44:31.282331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:37.980335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'255","reported_seq":270,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.833499+0000","last_change":"2023-08-25T04:43:42.897739+0000","last_active":"2023-08-25T04:45:38.833499+0000","last_peered":"2023-08-25T04:45:38.833499+0000","last_clean":"2023-08-25T04:45:38.833499+0000","last_became_active":"2023-08-25T04:43:42.897425+0000","last_became_peered":"2023-08-25T04:43:42.897425+0000","last_unstale":"2023-08-25T04:45:38.833499+0000","last_undegraded":"2023-08-25T04:45:38.833499+0000","last_fullsized":"2023-08-25T04:45:38.833499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:46:26.445143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475661+0000","last_change":"2023-08-25T04:43:41.886122+0000","last_active":"2023-08-25T04:44:30.475661+0000","last_peered":"2023-08-25T04:44:30.475661+0000","last_clean":"2023-08-25T04:44:30.475661+0000","last_became_active":"2023-08-25T04:43:41.885184+0000","last_became_peered":"2023-08-25T04:43:41.885184+0000","last_unstale":"2023-08-25T04:44:30.475661+0000","last_undegraded":"2023-08-25T04:44:30.475661+0000","last_fullsized":"2023-08-25T04:44:30.475661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:33.855942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'269","reported_seq":284,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.078368+0000","last_change":"2023-08-25T04:43:42.890854+0000","last_active":"2023-08-25T04:45:39.078368+0000","last_peered":"2023-08-25T04:45:39.078368+0000","last_clean":"2023-08-25T04:45:39.078368+0000","last_became_active":"2023-08-25T04:43:42.890575+0000","last_became_peered":"2023-08-25T04:43:42.890575+0000","last_unstale":"2023-08-25T04:45:39.078368+0000","last_undegraded":"2023-08-25T04:45:39.078368+0000","last_fullsized":"2023-08-25T04:45:39.078368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:59.175818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.477781+0000","last_change":"2023-08-25T04:43:41.885567+0000","last_active":"2023-08-25T04:44:30.477781+0000","last_peered":"2023-08-25T04:44:30.477781+0000","last_clean":"2023-08-25T04:44:30.477781+0000","last_became_active":"2023-08-25T04:43:41.885299+0000","last_became_peered":"2023-08-25T04:43:41.885299+0000","last_unstale":"2023-08-25T04:44:30.477781+0000","last_undegraded":"2023-08-25T04:44:30.477781+0000","last_fullsized":"2023-08-25T04:44:30.477781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:14:12.640506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'250","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.821247+0000","last_change":"2023-08-25T04:43:42.899190+0000","last_active":"2023-08-25T04:45:38.821247+0000","last_peered":"2023-08-25T04:45:38.821247+0000","last_clean":"2023-08-25T04:45:38.821247+0000","last_became_active":"2023-08-25T04:43:42.898874+0000","last_became_peered":"2023-08-25T04:43:42.898874+0000","last_unstale":"2023-08-25T04:45:38.821247+0000","last_undegraded":"2023-08-25T04:45:38.821247+0000","last_fullsized":"2023-08-25T04:45:38.821247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:07.786286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.817699+0000","last_change":"2023-08-25T04:43:41.883055+0000","last_active":"2023-08-25T04:44:30.817699+0000","last_peered":"2023-08-25T04:44:30.817699+0000","last_clean":"2023-08-25T04:44:30.817699+0000","last_became_active":"2023-08-25T04:43:41.882381+0000","last_became_peered":"2023-08-25T04:43:41.882381+0000","last_unstale":"2023-08-25T04:44:30.817699+0000","last_undegraded":"2023-08-25T04:44:30.817699+0000","last_fullsized":"2023-08-25T04:44:30.817699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:46:41.140536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'241","reported_seq":261,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.063513+0000","last_change":"2023-08-25T04:44:30.481564+0000","last_active":"2023-08-25T04:45:39.063513+0000","last_peered":"2023-08-25T04:45:39.063513+0000","last_clean":"2023-08-25T04:45:39.063513+0000","last_became_active":"2023-08-25T04:44:30.481273+0000","last_became_peered":"2023-08-25T04:44:30.481273+0000","last_unstale":"2023-08-25T04:45:39.063513+0000","last_undegraded":"2023-08-25T04:45:39.063513+0000","last_fullsized":"2023-08-25T04:45:39.063513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:35.214306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475622+0000","last_change":"2023-08-25T04:43:41.882339+0000","last_active":"2023-08-25T04:44:30.475622+0000","last_peered":"2023-08-25T04:44:30.475622+0000","last_clean":"2023-08-25T04:44:30.475622+0000","last_became_active":"2023-08-25T04:43:41.882055+0000","last_became_peered":"2023-08-25T04:43:41.882055+0000","last_unstale":"2023-08-25T04:44:30.475622+0000","last_undegraded":"2023-08-25T04:44:30.475622+0000","last_fullsized":"2023-08-25T04:44:30.475622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:19.884687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"23'244","reported_seq":259,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.833060+0000","last_change":"2023-08-25T04:43:42.891741+0000","last_active":"2023-08-25T04:45:38.833060+0000","last_peered":"2023-08-25T04:45:38.833060+0000","last_clean":"2023-08-25T04:45:38.833060+0000","last_became_active":"2023-08-25T04:43:42.890100+0000","last_became_peered":"2023-08-25T04:43:42.890100+0000","last_unstale":"2023-08-25T04:45:38.833060+0000","last_undegraded":"2023-08-25T04:45:38.833060+0000","last_fullsized":"2023-08-25T04:45:38.833060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:09.859531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:37.670124+0000","last_change":"2023-08-25T04:43:41.887924+0000","last_active":"2023-08-25T04:45:37.670124+0000","last_peered":"2023-08-25T04:45:37.670124+0000","last_clean":"2023-08-25T04:45:37.670124+0000","last_became_active":"2023-08-25T04:43:41.887622+0000","last_became_peered":"2023-08-25T04:43:41.887622+0000","last_unstale":"2023-08-25T04:45:37.670124+0000","last_undegraded":"2023-08-25T04:45:37.670124+0000","last_fullsized":"2023-08-25T04:45:37.670124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:37:55.965513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"23'246","reported_seq":261,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.825586+0000","last_change":"2023-08-25T04:43:42.891006+0000","last_active":"2023-08-25T04:45:38.825586+0000","last_peered":"2023-08-25T04:45:38.825586+0000","last_clean":"2023-08-25T04:45:38.825586+0000","last_became_active":"2023-08-25T04:43:42.890648+0000","last_became_peered":"2023-08-25T04:43:42.890648+0000","last_unstale":"2023-08-25T04:45:38.825586+0000","last_undegraded":"2023-08-25T04:45:38.825586+0000","last_fullsized":"2023-08-25T04:45:38.825586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:39:11.580949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'311","reported_seq":328,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.790546+0000","last_change":"2023-08-25T04:43:41.887033+0000","last_active":"2023-08-25T04:45:38.790546+0000","last_peered":"2023-08-25T04:45:38.790546+0000","last_clean":"2023-08-25T04:45:38.790546+0000","last_became_active":"2023-08-25T04:43:41.886491+0000","last_became_peered":"2023-08-25T04:43:41.886491+0000","last_unstale":"2023-08-25T04:45:38.790546+0000","last_undegraded":"2023-08-25T04:45:38.790546+0000","last_fullsized":"2023-08-25T04:45:38.790546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:55.292210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1287643,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":1478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"23'280","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.821550+0000","last_change":"2023-08-25T04:43:42.893709+0000","last_active":"2023-08-25T04:45:38.821550+0000","last_peered":"2023-08-25T04:45:38.821550+0000","last_clean":"2023-08-25T04:45:38.821550+0000","last_became_active":"2023-08-25T04:43:42.893525+0000","last_became_peered":"2023-08-25T04:43:42.893525+0000","last_unstale":"2023-08-25T04:45:38.821550+0000","last_undegraded":"2023-08-25T04:45:38.821550+0000","last_fullsized":"2023-08-25T04:45:38.821550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:36:05.985843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138242+0000","last_change":"2023-08-25T04:43:41.890946+0000","last_active":"2023-08-25T04:44:31.138242+0000","last_peered":"2023-08-25T04:44:31.138242+0000","last_clean":"2023-08-25T04:44:31.138242+0000","last_became_active":"2023-08-25T04:43:41.890673+0000","last_became_peered":"2023-08-25T04:43:41.890673+0000","last_unstale":"2023-08-25T04:44:31.138242+0000","last_undegraded":"2023-08-25T04:44:31.138242+0000","last_fullsized":"2023-08-25T04:44:31.138242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:21:24.093061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"23'252","reported_seq":267,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.831941+0000","last_change":"2023-08-25T04:43:42.897809+0000","last_active":"2023-08-25T04:45:38.831941+0000","last_peered":"2023-08-25T04:45:38.831941+0000","last_clean":"2023-08-25T04:45:38.831941+0000","last_became_active":"2023-08-25T04:43:42.897204+0000","last_became_peered":"2023-08-25T04:43:42.897204+0000","last_unstale":"2023-08-25T04:45:38.831941+0000","last_undegraded":"2023-08-25T04:45:38.831941+0000","last_fullsized":"2023-08-25T04:45:38.831941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:25:20.195553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.817198+0000","last_change":"2023-08-25T04:43:41.881387+0000","last_active":"2023-08-25T04:44:30.817198+0000","last_peered":"2023-08-25T04:44:30.817198+0000","last_clean":"2023-08-25T04:44:30.817198+0000","last_became_active":"2023-08-25T04:43:41.881067+0000","last_became_peered":"2023-08-25T04:43:41.881067+0000","last_unstale":"2023-08-25T04:44:30.817198+0000","last_undegraded":"2023-08-25T04:44:30.817198+0000","last_fullsized":"2023-08-25T04:44:30.817198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:05.439371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'235","reported_seq":250,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.071485+0000","last_change":"2023-08-25T04:43:42.895088+0000","last_active":"2023-08-25T04:45:39.071485+0000","last_peered":"2023-08-25T04:45:39.071485+0000","last_clean":"2023-08-25T04:45:39.071485+0000","last_became_active":"2023-08-25T04:43:42.894807+0000","last_became_peered":"2023-08-25T04:43:42.894807+0000","last_unstale":"2023-08-25T04:45:39.071485+0000","last_undegraded":"2023-08-25T04:45:39.071485+0000","last_fullsized":"2023-08-25T04:45:39.071485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:46:42.145657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138466+0000","last_change":"2023-08-25T04:43:41.890995+0000","last_active":"2023-08-25T04:44:31.138466+0000","last_peered":"2023-08-25T04:44:31.138466+0000","last_clean":"2023-08-25T04:44:31.138466+0000","last_became_active":"2023-08-25T04:43:41.890706+0000","last_became_peered":"2023-08-25T04:43:41.890706+0000","last_unstale":"2023-08-25T04:44:31.138466+0000","last_undegraded":"2023-08-25T04:44:31.138466+0000","last_fullsized":"2023-08-25T04:44:31.138466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:08.854411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"23'268","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.830078+0000","last_change":"2023-08-25T04:43:42.897775+0000","last_active":"2023-08-25T04:45:38.830078+0000","last_peered":"2023-08-25T04:45:38.830078+0000","last_clean":"2023-08-25T04:45:38.830078+0000","last_became_active":"2023-08-25T04:43:42.897476+0000","last_became_peered":"2023-08-25T04:43:42.897476+0000","last_unstale":"2023-08-25T04:45:38.830078+0000","last_undegraded":"2023-08-25T04:45:38.830078+0000","last_fullsized":"2023-08-25T04:45:38.830078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:39:50.519838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500563+0000","last_change":"2023-08-25T04:43:41.892829+0000","last_active":"2023-08-25T04:44:31.500563+0000","last_peered":"2023-08-25T04:44:31.500563+0000","last_clean":"2023-08-25T04:44:31.500563+0000","last_became_active":"2023-08-25T04:43:41.892517+0000","last_became_peered":"2023-08-25T04:43:41.892517+0000","last_unstale":"2023-08-25T04:44:31.500563+0000","last_undegraded":"2023-08-25T04:44:31.500563+0000","last_fullsized":"2023-08-25T04:44:31.500563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:57:37.072728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"23'253","reported_seq":268,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.834427+0000","last_change":"2023-08-25T04:43:42.905276+0000","last_active":"2023-08-25T04:45:38.834427+0000","last_peered":"2023-08-25T04:45:38.834427+0000","last_clean":"2023-08-25T04:45:38.834427+0000","last_became_active":"2023-08-25T04:43:42.904736+0000","last_became_peered":"2023-08-25T04:43:42.904736+0000","last_unstale":"2023-08-25T04:45:38.834427+0000","last_undegraded":"2023-08-25T04:45:38.834427+0000","last_fullsized":"2023-08-25T04:45:38.834427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:38.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138672+0000","last_change":"2023-08-25T04:43:41.891246+0000","last_active":"2023-08-25T04:44:31.138672+0000","last_peered":"2023-08-25T04:44:31.138672+0000","last_clean":"2023-08-25T04:44:31.138672+0000","last_became_active":"2023-08-25T04:43:41.890942+0000","last_became_peered":"2023-08-25T04:43:41.890942+0000","last_unstale":"2023-08-25T04:44:31.138672+0000","last_undegraded":"2023-08-25T04:44:31.138672+0000","last_fullsized":"2023-08-25T04:44:31.138672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:33:59.579978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"23'217","reported_seq":232,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.819083+0000","last_change":"2023-08-25T04:43:42.895071+0000","last_active":"2023-08-25T04:45:38.819083+0000","last_peered":"2023-08-25T04:45:38.819083+0000","last_clean":"2023-08-25T04:45:38.819083+0000","last_became_active":"2023-08-25T04:43:42.894285+0000","last_became_peered":"2023-08-25T04:43:42.894285+0000","last_unstale":"2023-08-25T04:45:38.819083+0000","last_undegraded":"2023-08-25T04:45:38.819083+0000","last_fullsized":"2023-08-25T04:45:38.819083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:12.206120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138636+0000","last_change":"2023-08-25T04:43:41.891175+0000","last_active":"2023-08-25T04:44:31.138636+0000","last_peered":"2023-08-25T04:44:31.138636+0000","last_clean":"2023-08-25T04:44:31.138636+0000","last_became_active":"2023-08-25T04:43:41.890883+0000","last_became_peered":"2023-08-25T04:43:41.890883+0000","last_unstale":"2023-08-25T04:44:31.138636+0000","last_undegraded":"2023-08-25T04:44:31.138636+0000","last_fullsized":"2023-08-25T04:44:31.138636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:38.632609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"23'241","reported_seq":256,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.831909+0000","last_change":"2023-08-25T04:43:42.891686+0000","last_active":"2023-08-25T04:45:38.831909+0000","last_peered":"2023-08-25T04:45:38.831909+0000","last_clean":"2023-08-25T04:45:38.831909+0000","last_became_active":"2023-08-25T04:43:42.891443+0000","last_became_peered":"2023-08-25T04:43:42.891443+0000","last_unstale":"2023-08-25T04:45:38.831909+0000","last_undegraded":"2023-08-25T04:45:38.831909+0000","last_fullsized":"2023-08-25T04:45:38.831909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:18:58.719117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138361+0000","last_change":"2023-08-25T04:43:41.888723+0000","last_active":"2023-08-25T04:44:31.138361+0000","last_peered":"2023-08-25T04:44:31.138361+0000","last_clean":"2023-08-25T04:44:31.138361+0000","last_became_active":"2023-08-25T04:43:41.888447+0000","last_became_peered":"2023-08-25T04:43:41.888447+0000","last_unstale":"2023-08-25T04:44:31.138361+0000","last_undegraded":"2023-08-25T04:44:31.138361+0000","last_fullsized":"2023-08-25T04:44:31.138361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:42.712431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"23'242","reported_seq":257,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.826543+0000","last_change":"2023-08-25T04:43:42.892447+0000","last_active":"2023-08-25T04:45:38.826543+0000","last_peered":"2023-08-25T04:45:38.826543+0000","last_clean":"2023-08-25T04:45:38.826543+0000","last_became_active":"2023-08-25T04:43:42.892191+0000","last_became_peered":"2023-08-25T04:43:42.892191+0000","last_unstale":"2023-08-25T04:45:38.826543+0000","last_undegraded":"2023-08-25T04:45:38.826543+0000","last_fullsized":"2023-08-25T04:45:38.826543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:18.265853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475964+0000","last_change":"2023-08-25T04:43:41.884395+0000","last_active":"2023-08-25T04:44:30.475964+0000","last_peered":"2023-08-25T04:44:30.475964+0000","last_clean":"2023-08-25T04:44:30.475964+0000","last_became_active":"2023-08-25T04:43:41.884098+0000","last_became_peered":"2023-08-25T04:43:41.884098+0000","last_unstale":"2023-08-25T04:44:30.475964+0000","last_undegraded":"2023-08-25T04:44:30.475964+0000","last_fullsized":"2023-08-25T04:44:30.475964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:20.449241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"23'248","reported_seq":263,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.828532+0000","last_change":"2023-08-25T04:43:42.881050+0000","last_active":"2023-08-25T04:45:38.828532+0000","last_peered":"2023-08-25T04:45:38.828532+0000","last_clean":"2023-08-25T04:45:38.828532+0000","last_became_active":"2023-08-25T04:43:42.880104+0000","last_became_peered":"2023-08-25T04:43:42.880104+0000","last_unstale":"2023-08-25T04:45:38.828532+0000","last_undegraded":"2023-08-25T04:45:38.828532+0000","last_fullsized":"2023-08-25T04:45:38.828532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:21.454361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:30.051992+0000","last_change":"2023-08-25T04:43:41.885729+0000","last_active":"2023-08-25T04:45:30.051992+0000","last_peered":"2023-08-25T04:45:30.051992+0000","last_clean":"2023-08-25T04:45:30.051992+0000","last_became_active":"2023-08-25T04:43:41.885433+0000","last_became_peered":"2023-08-25T04:43:41.885433+0000","last_unstale":"2023-08-25T04:45:30.051992+0000","last_undegraded":"2023-08-25T04:45:30.051992+0000","last_fullsized":"2023-08-25T04:45:30.051992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:38.632609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'223","reported_seq":238,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.827923+0000","last_change":"2023-08-25T04:43:42.896701+0000","last_active":"2023-08-25T04:45:38.827923+0000","last_peered":"2023-08-25T04:45:38.827923+0000","last_clean":"2023-08-25T04:45:38.827923+0000","last_became_active":"2023-08-25T04:43:42.896440+0000","last_became_peered":"2023-08-25T04:43:42.896440+0000","last_unstale":"2023-08-25T04:45:38.827923+0000","last_undegraded":"2023-08-25T04:45:38.827923+0000","last_fullsized":"2023-08-25T04:45:38.827923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:15.437547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500655+0000","last_change":"2023-08-25T04:43:41.891087+0000","last_active":"2023-08-25T04:44:31.500655+0000","last_peered":"2023-08-25T04:44:31.500655+0000","last_clean":"2023-08-25T04:44:31.500655+0000","last_became_active":"2023-08-25T04:43:41.890827+0000","last_became_peered":"2023-08-25T04:43:41.890827+0000","last_unstale":"2023-08-25T04:44:31.500655+0000","last_undegraded":"2023-08-25T04:44:31.500655+0000","last_fullsized":"2023-08-25T04:44:31.500655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:00:12.731255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"23'273","reported_seq":288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.818091+0000","last_change":"2023-08-25T04:43:42.897377+0000","last_active":"2023-08-25T04:45:38.818091+0000","last_peered":"2023-08-25T04:45:38.818091+0000","last_clean":"2023-08-25T04:45:38.818091+0000","last_became_active":"2023-08-25T04:43:42.897108+0000","last_became_peered":"2023-08-25T04:43:42.897108+0000","last_unstale":"2023-08-25T04:45:38.818091+0000","last_undegraded":"2023-08-25T04:45:38.818091+0000","last_fullsized":"2023-08-25T04:45:38.818091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:59.768622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282280+0000","last_change":"2023-08-25T04:43:41.888568+0000","last_active":"2023-08-25T04:44:31.282280+0000","last_peered":"2023-08-25T04:44:31.282280+0000","last_clean":"2023-08-25T04:44:31.282280+0000","last_became_active":"2023-08-25T04:43:41.888323+0000","last_became_peered":"2023-08-25T04:43:41.888323+0000","last_unstale":"2023-08-25T04:44:31.282280+0000","last_undegraded":"2023-08-25T04:44:31.282280+0000","last_fullsized":"2023-08-25T04:44:31.282280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:53:53.170122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"23'276","reported_seq":291,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.821226+0000","last_change":"2023-08-25T04:43:42.897222+0000","last_active":"2023-08-25T04:45:38.821226+0000","last_peered":"2023-08-25T04:45:38.821226+0000","last_clean":"2023-08-25T04:45:38.821226+0000","last_became_active":"2023-08-25T04:43:42.896943+0000","last_became_peered":"2023-08-25T04:43:42.896943+0000","last_unstale":"2023-08-25T04:45:38.821226+0000","last_undegraded":"2023-08-25T04:45:38.821226+0000","last_fullsized":"2023-08-25T04:45:38.821226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:39.531589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.477627+0000","last_change":"2023-08-25T04:43:41.887489+0000","last_active":"2023-08-25T04:44:30.477627+0000","last_peered":"2023-08-25T04:44:30.477627+0000","last_clean":"2023-08-25T04:44:30.477627+0000","last_became_active":"2023-08-25T04:43:41.886846+0000","last_became_peered":"2023-08-25T04:43:41.886846+0000","last_unstale":"2023-08-25T04:44:30.477627+0000","last_undegraded":"2023-08-25T04:44:30.477627+0000","last_fullsized":"2023-08-25T04:44:30.477627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:06.310501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'265","reported_seq":280,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.067034+0000","last_change":"2023-08-25T04:43:42.903030+0000","last_active":"2023-08-25T04:45:39.067034+0000","last_peered":"2023-08-25T04:45:39.067034+0000","last_clean":"2023-08-25T04:45:39.067034+0000","last_became_active":"2023-08-25T04:43:42.902123+0000","last_became_peered":"2023-08-25T04:43:42.902123+0000","last_unstale":"2023-08-25T04:45:39.067034+0000","last_undegraded":"2023-08-25T04:45:39.067034+0000","last_fullsized":"2023-08-25T04:45:39.067034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:04:31.758204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478851+0000","last_change":"2023-08-25T04:43:41.883173+0000","last_active":"2023-08-25T04:44:30.478851+0000","last_peered":"2023-08-25T04:44:30.478851+0000","last_clean":"2023-08-25T04:44:30.478851+0000","last_became_active":"2023-08-25T04:43:41.882776+0000","last_became_peered":"2023-08-25T04:43:41.882776+0000","last_unstale":"2023-08-25T04:44:30.478851+0000","last_undegraded":"2023-08-25T04:44:30.478851+0000","last_fullsized":"2023-08-25T04:44:30.478851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:43.055214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282674+0000","last_change":"2023-08-25T04:43:36.786045+0000","last_active":"2023-08-25T04:44:31.282674+0000","last_peered":"2023-08-25T04:44:31.282674+0000","last_clean":"2023-08-25T04:44:31.282674+0000","last_became_active":"2023-08-25T04:43:36.785725+0000","last_became_peered":"2023-08-25T04:43:36.785725+0000","last_unstale":"2023-08-25T04:44:31.282674+0000","last_undegraded":"2023-08-25T04:44:31.282674+0000","last_fullsized":"2023-08-25T04:44:31.282674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:13.214839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"23'240","reported_seq":255,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.832690+0000","last_change":"2023-08-25T04:43:42.890044+0000","last_active":"2023-08-25T04:45:38.832690+0000","last_peered":"2023-08-25T04:45:38.832690+0000","last_clean":"2023-08-25T04:45:38.832690+0000","last_became_active":"2023-08-25T04:43:42.889721+0000","last_became_peered":"2023-08-25T04:43:42.889721+0000","last_unstale":"2023-08-25T04:45:38.832690+0000","last_undegraded":"2023-08-25T04:45:38.832690+0000","last_fullsized":"2023-08-25T04:45:38.832690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:59.175818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478602+0000","last_change":"2023-08-25T04:43:36.782928+0000","last_active":"2023-08-25T04:44:30.478602+0000","last_peered":"2023-08-25T04:44:30.478602+0000","last_clean":"2023-08-25T04:44:30.478602+0000","last_became_active":"2023-08-25T04:43:36.782680+0000","last_became_peered":"2023-08-25T04:43:36.782680+0000","last_unstale":"2023-08-25T04:44:30.478602+0000","last_undegraded":"2023-08-25T04:44:30.478602+0000","last_fullsized":"2023-08-25T04:44:30.478602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:33:54.492649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:31.929409+0000","last_change":"2023-08-25T04:43:41.888878+0000","last_active":"2023-08-25T04:45:31.929409+0000","last_peered":"2023-08-25T04:45:31.929409+0000","last_clean":"2023-08-25T04:45:31.929409+0000","last_became_active":"2023-08-25T04:43:41.885363+0000","last_became_peered":"2023-08-25T04:43:41.885363+0000","last_unstale":"2023-08-25T04:45:31.929409+0000","last_undegraded":"2023-08-25T04:45:31.929409+0000","last_fullsized":"2023-08-25T04:45:31.929409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:06.310501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'231","reported_seq":246,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.064310+0000","last_change":"2023-08-25T04:43:42.899201+0000","last_active":"2023-08-25T04:45:39.064310+0000","last_peered":"2023-08-25T04:45:39.064310+0000","last_clean":"2023-08-25T04:45:39.064310+0000","last_became_active":"2023-08-25T04:43:42.898942+0000","last_became_peered":"2023-08-25T04:43:42.898942+0000","last_unstale":"2023-08-25T04:45:39.064310+0000","last_undegraded":"2023-08-25T04:45:39.064310+0000","last_fullsized":"2023-08-25T04:45:39.064310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:57:45.095370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.474957+0000","last_change":"2023-08-25T04:43:36.785266+0000","last_active":"2023-08-25T04:44:30.474957+0000","last_peered":"2023-08-25T04:44:30.474957+0000","last_clean":"2023-08-25T04:44:30.474957+0000","last_became_active":"2023-08-25T04:43:36.784937+0000","last_became_peered":"2023-08-25T04:43:36.784937+0000","last_unstale":"2023-08-25T04:44:30.474957+0000","last_undegraded":"2023-08-25T04:44:30.474957+0000","last_fullsized":"2023-08-25T04:44:30.474957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:05:30.545713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138986+0000","last_change":"2023-08-25T04:43:36.785867+0000","last_active":"2023-08-25T04:44:31.138986+0000","last_peered":"2023-08-25T04:44:31.138986+0000","last_clean":"2023-08-25T04:44:31.138986+0000","last_became_active":"2023-08-25T04:43:36.785451+0000","last_became_peered":"2023-08-25T04:43:36.785451+0000","last_unstale":"2023-08-25T04:44:31.138986+0000","last_undegraded":"2023-08-25T04:44:31.138986+0000","last_fullsized":"2023-08-25T04:44:31.138986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:10.216462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'8","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.058425+0000","last_change":"2023-08-25T04:43:41.886451+0000","last_active":"2023-08-25T04:45:39.058425+0000","last_peered":"2023-08-25T04:45:39.058425+0000","last_clean":"2023-08-25T04:45:39.058425+0000","last_became_active":"2023-08-25T04:43:41.885029+0000","last_became_peered":"2023-08-25T04:43:41.885029+0000","last_unstale":"2023-08-25T04:45:39.058425+0000","last_undegraded":"2023-08-25T04:45:39.058425+0000","last_fullsized":"2023-08-25T04:45:39.058425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:05:01.000775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5555,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9,"num_write":7,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'259","reported_seq":274,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.830335+0000","last_change":"2023-08-25T04:43:42.881048+0000","last_active":"2023-08-25T04:45:38.830335+0000","last_peered":"2023-08-25T04:45:38.830335+0000","last_clean":"2023-08-25T04:45:38.830335+0000","last_became_active":"2023-08-25T04:43:42.880591+0000","last_became_peered":"2023-08-25T04:43:42.880591+0000","last_unstale":"2023-08-25T04:45:38.830335+0000","last_undegraded":"2023-08-25T04:45:38.830335+0000","last_fullsized":"2023-08-25T04:45:38.830335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:35.214306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138158+0000","last_change":"2023-08-25T04:43:37.192872+0000","last_active":"2023-08-25T04:44:31.138158+0000","last_peered":"2023-08-25T04:44:31.138158+0000","last_clean":"2023-08-25T04:44:31.138158+0000","last_became_active":"2023-08-25T04:43:37.192594+0000","last_became_peered":"2023-08-25T04:43:37.192594+0000","last_unstale":"2023-08-25T04:44:31.138158+0000","last_undegraded":"2023-08-25T04:44:31.138158+0000","last_fullsized":"2023-08-25T04:44:31.138158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:14:07.553177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.474858+0000","last_change":"2023-08-25T04:43:41.888507+0000","last_active":"2023-08-25T04:44:30.474858+0000","last_peered":"2023-08-25T04:44:30.474858+0000","last_clean":"2023-08-25T04:44:30.474858+0000","last_became_active":"2023-08-25T04:43:41.888158+0000","last_became_peered":"2023-08-25T04:43:41.888158+0000","last_unstale":"2023-08-25T04:44:30.474858+0000","last_undegraded":"2023-08-25T04:44:30.474858+0000","last_fullsized":"2023-08-25T04:44:30.474858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:46:50.995055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'229","reported_seq":244,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.831847+0000","last_change":"2023-08-25T04:43:42.902440+0000","last_active":"2023-08-25T04:45:38.831847+0000","last_peered":"2023-08-25T04:45:38.831847+0000","last_clean":"2023-08-25T04:45:38.831847+0000","last_became_active":"2023-08-25T04:43:42.901657+0000","last_became_peered":"2023-08-25T04:43:42.901657+0000","last_unstale":"2023-08-25T04:45:38.831847+0000","last_undegraded":"2023-08-25T04:45:38.831847+0000","last_fullsized":"2023-08-25T04:45:38.831847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:30:27.322745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138904+0000","last_change":"2023-08-25T04:43:37.192977+0000","last_active":"2023-08-25T04:44:31.138904+0000","last_peered":"2023-08-25T04:44:31.138904+0000","last_clean":"2023-08-25T04:44:31.138904+0000","last_became_active":"2023-08-25T04:43:37.192427+0000","last_became_peered":"2023-08-25T04:43:37.192427+0000","last_unstale":"2023-08-25T04:44:31.138904+0000","last_undegraded":"2023-08-25T04:44:31.138904+0000","last_fullsized":"2023-08-25T04:44:31.138904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:25:14.103104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478272+0000","last_change":"2023-08-25T04:43:41.883960+0000","last_active":"2023-08-25T04:44:30.478272+0000","last_peered":"2023-08-25T04:44:30.478272+0000","last_clean":"2023-08-25T04:44:30.478272+0000","last_became_active":"2023-08-25T04:43:41.883621+0000","last_became_peered":"2023-08-25T04:43:41.883621+0000","last_unstale":"2023-08-25T04:44:30.478272+0000","last_undegraded":"2023-08-25T04:44:30.478272+0000","last_fullsized":"2023-08-25T04:44:30.478272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:37:55.965513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'246","reported_seq":261,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.822226+0000","last_change":"2023-08-25T04:43:42.893639+0000","last_active":"2023-08-25T04:45:38.822226+0000","last_peered":"2023-08-25T04:45:38.822226+0000","last_clean":"2023-08-25T04:45:38.822226+0000","last_became_active":"2023-08-25T04:43:42.893333+0000","last_became_peered":"2023-08-25T04:43:42.893333+0000","last_unstale":"2023-08-25T04:45:38.822226+0000","last_undegraded":"2023-08-25T04:45:38.822226+0000","last_fullsized":"2023-08-25T04:45:38.822226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:37.784121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475466+0000","last_change":"2023-08-25T04:43:37.192780+0000","last_active":"2023-08-25T04:44:30.475466+0000","last_peered":"2023-08-25T04:44:30.475466+0000","last_clean":"2023-08-25T04:44:30.475466+0000","last_became_active":"2023-08-25T04:43:37.192432+0000","last_became_peered":"2023-08-25T04:43:37.192432+0000","last_unstale":"2023-08-25T04:44:30.475466+0000","last_undegraded":"2023-08-25T04:44:30.475466+0000","last_fullsized":"2023-08-25T04:44:30.475466+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:00.352042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282455+0000","last_change":"2023-08-25T04:43:41.889966+0000","last_active":"2023-08-25T04:44:31.282455+0000","last_peered":"2023-08-25T04:44:31.282455+0000","last_clean":"2023-08-25T04:44:31.282455+0000","last_became_active":"2023-08-25T04:43:41.889717+0000","last_became_peered":"2023-08-25T04:43:41.889717+0000","last_unstale":"2023-08-25T04:44:31.282455+0000","last_undegraded":"2023-08-25T04:44:31.282455+0000","last_fullsized":"2023-08-25T04:44:31.282455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:46:39.529025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"23'242","reported_seq":257,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.832770+0000","last_change":"2023-08-25T04:43:42.885970+0000","last_active":"2023-08-25T04:45:38.832770+0000","last_peered":"2023-08-25T04:45:38.832770+0000","last_clean":"2023-08-25T04:45:38.832770+0000","last_became_active":"2023-08-25T04:43:42.885671+0000","last_became_peered":"2023-08-25T04:43:42.885671+0000","last_unstale":"2023-08-25T04:45:38.832770+0000","last_undegraded":"2023-08-25T04:45:38.832770+0000","last_fullsized":"2023-08-25T04:45:38.832770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:20.889807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500828+0000","last_change":"2023-08-25T04:43:37.192768+0000","last_active":"2023-08-25T04:44:31.500828+0000","last_peered":"2023-08-25T04:44:31.500828+0000","last_clean":"2023-08-25T04:44:31.500828+0000","last_became_active":"2023-08-25T04:43:37.192429+0000","last_became_peered":"2023-08-25T04:43:37.192429+0000","last_unstale":"2023-08-25T04:44:31.500828+0000","last_undegraded":"2023-08-25T04:44:31.500828+0000","last_fullsized":"2023-08-25T04:44:31.500828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:26.497020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:36.180533+0000","last_change":"2023-08-25T04:43:41.888493+0000","last_active":"2023-08-25T04:45:36.180533+0000","last_peered":"2023-08-25T04:45:36.180533+0000","last_clean":"2023-08-25T04:45:36.180533+0000","last_became_active":"2023-08-25T04:43:41.888207+0000","last_became_peered":"2023-08-25T04:43:41.888207+0000","last_unstale":"2023-08-25T04:45:36.180533+0000","last_undegraded":"2023-08-25T04:45:36.180533+0000","last_fullsized":"2023-08-25T04:45:36.180533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:11.200999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'288","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.071301+0000","last_change":"2023-08-25T04:43:42.900866+0000","last_active":"2023-08-25T04:45:39.071301+0000","last_peered":"2023-08-25T04:45:39.071301+0000","last_clean":"2023-08-25T04:45:39.071301+0000","last_became_active":"2023-08-25T04:43:42.900470+0000","last_became_peered":"2023-08-25T04:43:42.900470+0000","last_unstale":"2023-08-25T04:45:39.071301+0000","last_undegraded":"2023-08-25T04:45:39.071301+0000","last_fullsized":"2023-08-25T04:45:39.071301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:04:31.758204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500882+0000","last_change":"2023-08-25T04:43:36.785280+0000","last_active":"2023-08-25T04:44:31.500882+0000","last_peered":"2023-08-25T04:44:31.500882+0000","last_clean":"2023-08-25T04:44:31.500882+0000","last_became_active":"2023-08-25T04:43:36.784943+0000","last_became_peered":"2023-08-25T04:43:36.784943+0000","last_unstale":"2023-08-25T04:44:31.500882+0000","last_undegraded":"2023-08-25T04:44:31.500882+0000","last_fullsized":"2023-08-25T04:44:31.500882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.996393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.476180+0000","last_change":"2023-08-25T04:43:41.884839+0000","last_active":"2023-08-25T04:44:30.476180+0000","last_peered":"2023-08-25T04:44:30.476180+0000","last_clean":"2023-08-25T04:44:30.476180+0000","last_became_active":"2023-08-25T04:43:41.884535+0000","last_became_peered":"2023-08-25T04:43:41.884535+0000","last_unstale":"2023-08-25T04:44:30.476180+0000","last_undegraded":"2023-08-25T04:44:30.476180+0000","last_fullsized":"2023-08-25T04:44:30.476180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:57:40.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"23'256","reported_seq":271,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.079344+0000","last_change":"2023-08-25T04:43:42.903007+0000","last_active":"2023-08-25T04:45:39.079344+0000","last_peered":"2023-08-25T04:45:39.079344+0000","last_clean":"2023-08-25T04:45:39.079344+0000","last_became_active":"2023-08-25T04:43:42.902721+0000","last_became_peered":"2023-08-25T04:43:42.902721+0000","last_unstale":"2023-08-25T04:45:39.079344+0000","last_undegraded":"2023-08-25T04:45:39.079344+0000","last_fullsized":"2023-08-25T04:45:39.079344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:06.444491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.817827+0000","last_change":"2023-08-25T04:43:41.889969+0000","last_active":"2023-08-25T04:44:30.817827+0000","last_peered":"2023-08-25T04:44:30.817827+0000","last_clean":"2023-08-25T04:44:30.817827+0000","last_became_active":"2023-08-25T04:43:41.889659+0000","last_became_peered":"2023-08-25T04:43:41.889659+0000","last_unstale":"2023-08-25T04:44:30.817827+0000","last_undegraded":"2023-08-25T04:44:30.817827+0000","last_fullsized":"2023-08-25T04:44:30.817827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:03.981683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'257","reported_seq":272,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.830800+0000","last_change":"2023-08-25T04:43:42.894953+0000","last_active":"2023-08-25T04:45:38.830800+0000","last_peered":"2023-08-25T04:45:38.830800+0000","last_clean":"2023-08-25T04:45:38.830800+0000","last_became_active":"2023-08-25T04:43:42.894618+0000","last_became_peered":"2023-08-25T04:43:42.894618+0000","last_unstale":"2023-08-25T04:45:38.830800+0000","last_undegraded":"2023-08-25T04:45:38.830800+0000","last_fullsized":"2023-08-25T04:45:38.830800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:01.444718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475832+0000","last_change":"2023-08-25T04:43:41.886470+0000","last_active":"2023-08-25T04:44:30.475832+0000","last_peered":"2023-08-25T04:44:30.475832+0000","last_clean":"2023-08-25T04:44:30.475832+0000","last_became_active":"2023-08-25T04:43:41.886063+0000","last_became_peered":"2023-08-25T04:43:41.886063+0000","last_unstale":"2023-08-25T04:44:30.475832+0000","last_undegraded":"2023-08-25T04:44:30.475832+0000","last_fullsized":"2023-08-25T04:44:30.475832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:33.855942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'250","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.834297+0000","last_change":"2023-08-25T04:43:42.900475+0000","last_active":"2023-08-25T04:45:38.834297+0000","last_peered":"2023-08-25T04:45:38.834297+0000","last_clean":"2023-08-25T04:45:38.834297+0000","last_became_active":"2023-08-25T04:43:42.900135+0000","last_became_peered":"2023-08-25T04:43:42.900135+0000","last_unstale":"2023-08-25T04:45:38.834297+0000","last_undegraded":"2023-08-25T04:45:38.834297+0000","last_fullsized":"2023-08-25T04:45:38.834297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:38.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.476228+0000","last_change":"2023-08-25T04:43:41.891609+0000","last_active":"2023-08-25T04:44:30.476228+0000","last_peered":"2023-08-25T04:44:30.476228+0000","last_clean":"2023-08-25T04:44:30.476228+0000","last_became_active":"2023-08-25T04:43:41.891306+0000","last_became_peered":"2023-08-25T04:43:41.891306+0000","last_unstale":"2023-08-25T04:44:30.476228+0000","last_undegraded":"2023-08-25T04:44:30.476228+0000","last_fullsized":"2023-08-25T04:44:30.476228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:03.981683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'244","reported_seq":259,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.828071+0000","last_change":"2023-08-25T04:43:42.894647+0000","last_active":"2023-08-25T04:45:38.828071+0000","last_peered":"2023-08-25T04:45:38.828071+0000","last_clean":"2023-08-25T04:45:38.828071+0000","last_became_active":"2023-08-25T04:43:42.894386+0000","last_became_peered":"2023-08-25T04:43:42.894386+0000","last_unstale":"2023-08-25T04:45:38.828071+0000","last_undegraded":"2023-08-25T04:45:38.828071+0000","last_fullsized":"2023-08-25T04:45:38.828071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:41:20.742718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478810+0000","last_change":"2023-08-25T04:43:41.893331+0000","last_active":"2023-08-25T04:44:30.478810+0000","last_peered":"2023-08-25T04:44:30.478810+0000","last_clean":"2023-08-25T04:44:30.478810+0000","last_became_active":"2023-08-25T04:43:41.892929+0000","last_became_peered":"2023-08-25T04:43:41.892929+0000","last_unstale":"2023-08-25T04:44:30.478810+0000","last_undegraded":"2023-08-25T04:44:30.478810+0000","last_fullsized":"2023-08-25T04:44:30.478810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:58:44.113433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'237","reported_seq":252,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.830263+0000","last_change":"2023-08-25T04:43:42.894553+0000","last_active":"2023-08-25T04:45:38.830263+0000","last_peered":"2023-08-25T04:45:38.830263+0000","last_clean":"2023-08-25T04:45:38.830263+0000","last_became_active":"2023-08-25T04:43:42.894239+0000","last_became_peered":"2023-08-25T04:43:42.894239+0000","last_unstale":"2023-08-25T04:45:38.830263+0000","last_undegraded":"2023-08-25T04:45:38.830263+0000","last_fullsized":"2023-08-25T04:45:38.830263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:43.717551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.817799+0000","last_change":"2023-08-25T04:43:41.883254+0000","last_active":"2023-08-25T04:44:30.817799+0000","last_peered":"2023-08-25T04:44:30.817799+0000","last_clean":"2023-08-25T04:44:30.817799+0000","last_became_active":"2023-08-25T04:43:41.882756+0000","last_became_peered":"2023-08-25T04:43:41.882756+0000","last_unstale":"2023-08-25T04:44:30.817799+0000","last_undegraded":"2023-08-25T04:44:30.817799+0000","last_fullsized":"2023-08-25T04:44:30.817799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:57:40.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'265","reported_seq":280,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.071066+0000","last_change":"2023-08-25T04:43:42.895154+0000","last_active":"2023-08-25T04:45:39.071066+0000","last_peered":"2023-08-25T04:45:39.071066+0000","last_clean":"2023-08-25T04:45:39.071066+0000","last_became_active":"2023-08-25T04:43:42.894912+0000","last_became_peered":"2023-08-25T04:43:42.894912+0000","last_unstale":"2023-08-25T04:45:39.071066+0000","last_undegraded":"2023-08-25T04:45:39.071066+0000","last_fullsized":"2023-08-25T04:45:39.071066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:53.893508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"23'234","reported_seq":249,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.062459+0000","last_change":"2023-08-25T04:43:42.893541+0000","last_active":"2023-08-25T04:45:39.062459+0000","last_peered":"2023-08-25T04:45:39.062459+0000","last_clean":"2023-08-25T04:45:39.062459+0000","last_became_active":"2023-08-25T04:43:42.893255+0000","last_became_peered":"2023-08-25T04:43:42.893255+0000","last_unstale":"2023-08-25T04:45:39.062459+0000","last_undegraded":"2023-08-25T04:45:39.062459+0000","last_fullsized":"2023-08-25T04:45:39.062459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:43:44.192741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"23'278","reported_seq":293,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.075469+0000","last_change":"2023-08-25T04:43:42.897868+0000","last_active":"2023-08-25T04:45:39.075469+0000","last_peered":"2023-08-25T04:45:39.075469+0000","last_clean":"2023-08-25T04:45:39.075469+0000","last_became_active":"2023-08-25T04:43:42.897394+0000","last_became_peered":"2023-08-25T04:43:42.897394+0000","last_unstale":"2023-08-25T04:45:39.075469+0000","last_undegraded":"2023-08-25T04:45:39.075469+0000","last_fullsized":"2023-08-25T04:45:39.075469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:21:25.098181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'267","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.080756+0000","last_change":"2023-08-25T04:43:42.894698+0000","last_active":"2023-08-25T04:45:39.080756+0000","last_peered":"2023-08-25T04:45:39.080756+0000","last_clean":"2023-08-25T04:45:39.080756+0000","last_became_active":"2023-08-25T04:43:42.894176+0000","last_became_peered":"2023-08-25T04:43:42.894176+0000","last_unstale":"2023-08-25T04:45:39.080756+0000","last_undegraded":"2023-08-25T04:45:39.080756+0000","last_fullsized":"2023-08-25T04:45:39.080756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:57:17.411245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"23'234","reported_seq":249,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.833984+0000","last_change":"2023-08-25T04:43:42.899435+0000","last_active":"2023-08-25T04:45:38.833984+0000","last_peered":"2023-08-25T04:45:38.833984+0000","last_clean":"2023-08-25T04:45:38.833984+0000","last_became_active":"2023-08-25T04:43:42.898842+0000","last_became_peered":"2023-08-25T04:43:42.898842+0000","last_unstale":"2023-08-25T04:45:38.833984+0000","last_undegraded":"2023-08-25T04:45:38.833984+0000","last_fullsized":"2023-08-25T04:45:38.833984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:16.308912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'243","reported_seq":258,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.834427+0000","last_change":"2023-08-25T04:43:42.890136+0000","last_active":"2023-08-25T04:45:38.834427+0000","last_peered":"2023-08-25T04:45:38.834427+0000","last_clean":"2023-08-25T04:45:38.834427+0000","last_became_active":"2023-08-25T04:43:42.889849+0000","last_became_peered":"2023-08-25T04:43:42.889849+0000","last_unstale":"2023-08-25T04:45:38.834427+0000","last_undegraded":"2023-08-25T04:45:38.834427+0000","last_fullsized":"2023-08-25T04:45:38.834427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:42:41.840740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":759808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536870912,"data_stored":536870912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15744,"ondisk_log_size":15744,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1293996,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":7,"num_read_kb":9,"num_write":375,"num_write_kb":1516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2654208,"data_stored":2587992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":379,"ondisk_log_size":379,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98940,"kb_used_data":59444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94272900,"statfs":{"total":96636764160,"available":96535449600,"internally_reserved":0,"allocated":60870656,"data_stored":60690354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.9349999999999996,"5min":1.8160000000000001,"15min":0.96299999999999997},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":18.02,"5min":18.02,"15min":18.02},"last":0.35599999999999998},{"interface":"front","average":{"1min":7.6100000000000003,"5min":1.954,"15min":1.012},"min":{"1min":0.48299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":22.920999999999999,"5min":22.920999999999999,"15min":22.920999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.5759999999999996,"5min":2.0209999999999999,"15min":1.095},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":21.199999999999999,"5min":21.199999999999999,"15min":21.199999999999999},"last":0.314},{"interface":"front","average":{"1min":7.585,"5min":1.968,"15min":1.032},"min":{"1min":0.46600000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":22.437999999999999,"5min":22.437999999999999,"15min":22.437999999999999},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.3620000000000001,"5min":1.806,"15min":1.0469999999999999},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":17.844000000000001,"5min":17.844000000000001,"15min":17.844000000000001},"last":0.441},{"interface":"front","average":{"1min":7.2610000000000001,"5min":2.0910000000000002,"15min":1.2290000000000001},"min":{"1min":0.42699999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":19.690999999999999,"5min":19.690999999999999,"15min":19.690999999999999},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.7789999999999999,"5min":1.823,"15min":0.997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":17.731000000000002,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.38},{"interface":"front","average":{"1min":7.0229999999999997,"5min":2.0950000000000002,"15min":1.2729999999999999},"min":{"1min":0.45700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":21.143999999999998,"5min":21.143999999999998,"15min":21.143999999999998},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":5.4710000000000001,"5min":1.4690000000000001,"15min":0.80200000000000005},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":22.465,"5min":22.465,"15min":22.465},"last":0.42099999999999999},{"interface":"front","average":{"1min":4.8609999999999998,"5min":1.373,"15min":0.79100000000000004},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":14.042999999999999,"5min":14.042999999999999,"15min":14.042999999999999},"last":0.502}]},{"osd":5,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":3.9830000000000001,"5min":1.238,"15min":0.78000000000000003},"min":{"1min":0.33600000000000002,"5min":0.307,"15min":0.307},"max":{"1min":14.117000000000001,"5min":14.117000000000001,"15min":14.117000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":5.8049999999999997,"5min":1.617,"15min":0.91900000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":22.334,"5min":22.334,"15min":22.334},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.8259999999999996,"5min":2.0169999999999999,"15min":1.0489999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":22.385000000000002,"5min":22.385000000000002,"15min":22.385000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":3.907,"5min":1.2529999999999999,"15min":0.81100000000000005},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":17.623000000000001,"5min":17.623000000000001,"15min":17.623000000000001},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125748,"kb_used_data":82156,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94246092,"statfs":{"total":96636764160,"available":96507998208,"internally_reserved":0,"allocated":84127744,"data_stored":83977951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.52300000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":10.108000000000001,"5min":10.108000000000001,"15min":10.108000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.1630000000000003,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":11.154,"5min":11.154,"15min":11.154},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.495},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.164,"5min":10.164,"15min":10.164},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.628},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.75},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.71399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117944,"kb_used_data":90928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94253896,"statfs":{"total":96636764160,"available":96515989504,"internally_reserved":0,"allocated":93110272,"data_stored":92956927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.7160000000000002,"5min":1.427,"15min":0.71199999999999997},"min":{"1min":0.245,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":23.989999999999998,"5min":23.989999999999998,"15min":23.989999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":5.024,"5min":1.3009999999999999,"15min":0.68100000000000005},"min":{"1min":0.255,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":15.622,"5min":15.622,"15min":15.622},"last":0.255}]},{"osd":2,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.6580000000000004,"5min":1.4430000000000001,"15min":0.74099999999999999},"min":{"1min":0.29899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":23.954000000000001,"5min":23.954000000000001,"15min":23.954000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":5.4690000000000003,"5min":1.4530000000000001,"15min":0.78400000000000003},"min":{"1min":0.34499999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":20.946000000000002,"5min":20.946000000000002,"15min":20.946000000000002},"last":0.34499999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.2939999999999996,"5min":1.4059999999999999,"15min":0.75800000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":27.884,"5min":27.884,"15min":27.884},"last":0.308},{"interface":"front","average":{"1min":5.6310000000000002,"5min":1.4450000000000001,"15min":0.747},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":23.018000000000001,"5min":23.018000000000001,"15min":23.018000000000001},"last":0.39100000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.2439999999999998,"5min":1.952,"15min":1.0700000000000001},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":24.044,"5min":24.044,"15min":24.044},"last":0.65300000000000002},{"interface":"front","average":{"1min":7.9050000000000002,"5min":2.0840000000000001,"15min":1.1140000000000001},"min":{"1min":0.501,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":27.940000000000001,"5min":27.940000000000001,"15min":27.940000000000001},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":8.516,"5min":2.2000000000000002,"15min":1.147},"min":{"1min":0.44,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":26.969999999999999,"5min":26.969999999999999,"15min":26.969999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":7.0430000000000001,"5min":1.923,"15min":1.0700000000000001},"min":{"1min":0.42399999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":24.018000000000001,"5min":24.018000000000001,"15min":24.018000000000001},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.899,"5min":2.0950000000000002,"15min":1.127},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":22.899999999999999,"5min":22.899999999999999,"15min":22.899999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":7.0890000000000004,"5min":1.9550000000000001,"15min":1.099},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":23.898,"5min":23.898,"15min":23.898},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.718,"5min":2.0779999999999998,"15min":1.1379999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":21.010999999999999,"5min":21.010999999999999,"15min":21.010999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":6.2210000000000001,"5min":1.7669999999999999,"15min":1.0249999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":23.053999999999998,"5min":23.053999999999998,"15min":23.053999999999998},"last":0.70499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":158524,"kb_used_data":119028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94213316,"statfs":{"total":96636764160,"available":96474435584,"internally_reserved":0,"allocated":121884672,"data_stored":121730752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":3.8849999999999998,"5min":1.0649999999999999,"15min":0.59499999999999997},"min":{"1min":0.32800000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":19.956,"5min":19.956,"15min":19.956},"last":0.32800000000000001},{"interface":"front","average":{"1min":4.4450000000000003,"5min":1.2150000000000001,"15min":0.67700000000000005},"min":{"1min":0.29599999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":14.029999999999999,"5min":14.029999999999999,"15min":14.029999999999999},"last":0.34599999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":6.3410000000000002,"5min":1.627,"15min":0.84099999999999997},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":22.942,"5min":22.942,"15min":22.942},"last":0.38300000000000001},{"interface":"front","average":{"1min":2.7879999999999998,"5min":0.87,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.016,"5min":11.016,"15min":11.016},"last":0.37}]},{"osd":3,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":4.9039999999999999,"5min":1.3069999999999999,"15min":0.70699999999999996},"min":{"1min":0.35899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":19.997,"5min":19.997,"15min":19.997},"last":0.39300000000000002},{"interface":"front","average":{"1min":5.9139999999999997,"5min":1.522,"15min":0.79000000000000004},"min":{"1min":0.40400000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":17.045999999999999,"5min":17.045999999999999,"15min":17.045999999999999},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":4.484,"5min":1.786,"15min":1.3360000000000001},"min":{"1min":0.49199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":21.001000000000001,"5min":21.001000000000001,"15min":21.001000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":8.2750000000000004,"5min":2.1640000000000001,"15min":1.1459999999999999},"min":{"1min":0.46400000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":9.8439999999999994,"5min":2.4820000000000002,"15min":1.2549999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":23.93,"5min":23.93,"15min":23.93},"last":0.5},{"interface":"front","average":{"1min":6.6479999999999997,"5min":1.8500000000000001,"15min":1.05},"min":{"1min":0.51600000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":17.010000000000002,"5min":17.010000000000002,"15min":17.010000000000002},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":7.6139999999999999,"5min":2.0379999999999998,"15min":1.109},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":27.701000000000001,"5min":27.701000000000001,"15min":27.701000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":4.758,"5min":1.5029999999999999,"15min":0.96099999999999997},"min":{"1min":0.62,"5min":0.443,"15min":0.443},"max":{"1min":20.942,"5min":20.942,"15min":20.942},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":5.657,"5min":1.6879999999999999,"15min":1.026},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":21.030999999999999,"5min":21.030999999999999,"15min":21.030999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":7.9189999999999996,"5min":2.125,"15min":1.159},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":20.902999999999999,"5min":20.902999999999999,"15min":20.902999999999999},"last":0.70799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97076,"kb_used_data":57580,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94274764,"statfs":{"total":96636764160,"available":96537358336,"internally_reserved":0,"allocated":58961920,"data_stored":58812127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":4.1100000000000003,"5min":1.1180000000000001,"15min":0.61899999999999999},"min":{"1min":0.33900000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":18.98,"5min":18.98,"15min":18.98},"last":0.33900000000000002},{"interface":"front","average":{"1min":4.9240000000000004,"5min":1.302,"15min":0.69799999999999995},"min":{"1min":0.27300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":20.966999999999999,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.27300000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":3.899,"5min":1.127,"15min":0.66500000000000004},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":20.995999999999999,"5min":20.995999999999999,"15min":20.995999999999999},"last":0.438},{"interface":"front","average":{"1min":3.6629999999999998,"5min":1.0680000000000001,"15min":0.63600000000000001},"min":{"1min":0.34499999999999997,"5min":0.307,"15min":0.307},"max":{"1min":12.052,"5min":12.052,"15min":12.052},"last":0.47399999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.0149999999999997,"5min":1.341,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":19.925999999999998,"5min":19.925999999999998,"15min":19.925999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":4.4059999999999997,"5min":1.2589999999999999,"15min":0.73499999999999999},"min":{"1min":0.373,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":20.916,"5min":20.916,"15min":20.916},"last":0.373}]},{"osd":4,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.2930000000000001,"5min":1.982,"15min":1.097},"min":{"1min":0.46600000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":19.940999999999999,"5min":19.940999999999999,"15min":19.940999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":8.3059999999999992,"5min":2.1480000000000001,"15min":1.1220000000000001},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":22.038,"5min":22.038,"15min":22.038},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":6.3300000000000001,"5min":1.8140000000000001,"15min":1.0609999999999999},"min":{"1min":0.59499999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":19.98,"5min":19.98,"15min":19.98},"last":0.63},{"interface":"front","average":{"1min":7.8689999999999998,"5min":2.0790000000000002,"15min":1.1140000000000001},"min":{"1min":0.53500000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":21.050999999999998,"5min":21.050999999999998,"15min":21.050999999999998},"last":0.54700000000000004}]},{"osd":6,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.3419999999999996,"5min":1.9910000000000001,"15min":1.099},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":22.021999999999998,"5min":22.021999999999998,"15min":22.021999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":6.9569999999999999,"5min":1.921,"15min":1.0820000000000001},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.498},"max":{"1min":19.007999999999999,"5min":19.007999999999999,"15min":19.007999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":6.8129999999999997,"5min":1.885,"15min":1.0640000000000001},"min":{"1min":0.49199999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":21.023,"5min":21.023,"15min":21.023},"last":0.49199999999999999},{"interface":"front","average":{"1min":9.3469999999999995,"5min":2.411,"15min":1.2549999999999999},"min":{"1min":0.498,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":28.928000000000001,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.61699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":194168,"kb_used_data":167152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94177672,"statfs":{"total":96636764160,"available":96437936128,"internally_reserved":0,"allocated":171163648,"data_stored":171009849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,3,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.6289999999999996,"5min":1.266,"15min":0.70599999999999996},"min":{"1min":0.28399999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":23.542000000000002,"5min":23.542000000000002,"15min":23.542000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":4.4550000000000001,"5min":1.2949999999999999,"15min":0.76800000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":20.547000000000001,"5min":20.547000000000001,"15min":20.547000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.3869999999999996,"5min":1.2709999999999999,"15min":0.752},"min":{"1min":0.31900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":18.984999999999999,"5min":18.984999999999999,"15min":18.984999999999999},"last":5.976},{"interface":"front","average":{"1min":4.9550000000000001,"5min":1.3380000000000001,"15min":0.73499999999999999},"min":{"1min":0.32300000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":20.052,"5min":20.052,"15min":20.052},"last":5.1859999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":5.7050000000000001,"5min":1.5329999999999999,"15min":0.83799999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":20.861000000000001,"5min":20.861000000000001,"15min":20.861000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":5.0060000000000002,"5min":1.405,"15min":0.80500000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":21.984000000000002,"5min":21.984000000000002,"15min":21.984000000000002},"last":0.30499999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.6619999999999999,"5min":2.1160000000000001,"15min":1.1919999999999999},"min":{"1min":0.40300000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":22.015999999999998,"5min":22.015999999999998,"15min":22.015999999999998},"last":0.443},{"interface":"front","average":{"1min":6.4500000000000002,"5min":1.8380000000000001,"15min":1.0700000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":20.934999999999999,"5min":20.934999999999999,"15min":20.934999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.859,"5min":1.9039999999999999,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":23.474,"5min":23.474,"15min":23.474},"last":0.54700000000000004},{"interface":"front","average":{"1min":7.242,"5min":2.069,"15min":1.2070000000000001},"min":{"1min":0.441,"5min":0.376,"15min":0.376},"max":{"1min":21.975999999999999,"5min":21.975999999999999,"15min":21.975999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.9580000000000002,"5min":2.1429999999999998,"15min":1.1739999999999999},"min":{"1min":0.45400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":20.898,"5min":20.898,"15min":20.898},"last":0.76700000000000002},{"interface":"front","average":{"1min":6.3879999999999999,"5min":1.8169999999999999,"15min":1.0549999999999999},"min":{"1min":0.48799999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":23.513000000000002,"5min":23.513000000000002,"15min":23.513000000000002},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.843,"5min":2.2029999999999998,"15min":1.2629999999999999},"min":{"1min":0.432,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":22.039999999999999,"5min":22.039999999999999,"15min":22.039999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":7.2370000000000001,"5min":2.0449999999999999,"15min":1.179},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.905000000000001,"5min":20.905000000000001,"15min":20.905000000000001},"last":0.69799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":176248,"kb_used_data":132592,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94195592,"statfs":{"total":96636764160,"available":96456286208,"internally_reserved":0,"allocated":135774208,"data_stored":135601742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":44693771},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.2069999999999999,"5min":1.657,"15min":0.89900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":17.920000000000002,"5min":17.920000000000002,"15min":17.920000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":6.46,"5min":1.7130000000000001,"15min":0.92200000000000004},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":20.904,"5min":20.904,"15min":20.904},"last":0.76800000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.3390000000000004,"5min":1.7170000000000001,"15min":0.94699999999999995},"min":{"1min":0.503,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":23.911000000000001,"5min":23.911000000000001,"15min":23.911000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":6.5750000000000002,"5min":1.756,"15min":0.95299999999999996},"min":{"1min":0.375,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":21.952999999999999,"5min":21.952999999999999,"15min":21.952999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.9210000000000003,"5min":1.833,"15min":0.98499999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":21.847999999999999,"5min":21.847999999999999,"15min":21.847999999999999},"last":0.308},{"interface":"front","average":{"1min":8.0950000000000006,"5min":2.0750000000000002,"15min":1.0720000000000001},"min":{"1min":0.504,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":33.182000000000002,"5min":33.182000000000002,"15min":33.182000000000002},"last":0.86299999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.1100000000000003,"5min":1.8660000000000001,"15min":0.99199999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":17.010999999999999,"5min":17.010999999999999,"15min":17.010999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":5.5220000000000002,"5min":1.575,"15min":0.91700000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":15.022,"5min":15.022,"15min":15.022},"last":0.38100000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":4.0679999999999996,"5min":1.1919999999999999,"15min":0.71299999999999997},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":5.1680000000000001,"5min":1.4570000000000001,"15min":0.83899999999999997},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":30.946999999999999,"5min":30.946999999999999,"15min":30.946999999999999},"last":0.79700000000000004}]},{"osd":6,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":5.859,"5min":1.5800000000000001,"15min":0.86699999999999999},"min":{"1min":0.42399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":15.936999999999999,"5min":15.936999999999999,"15min":15.936999999999999},"last":0.623},{"interface":"front","average":{"1min":5.0999999999999996,"5min":1.464,"15min":0.85799999999999998},"min":{"1min":0.42399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":20.937000000000001,"5min":20.937000000000001,"15min":20.937000000000001},"last":0.89300000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":4.4710000000000001,"5min":1.339,"15min":0.81699999999999995},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":12.914,"5min":12.914,"15min":12.914},"last":1.1919999999999999},{"interface":"front","average":{"1min":5.6820000000000004,"5min":1.6080000000000001,"15min":0.92900000000000005},"min":{"1min":0.48999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":15.045999999999999,"5min":15.045999999999999,"15min":15.045999999999999},"last":0.65500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109308,"kb_used_data":73972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94262532,"statfs":{"total":96636764160,"available":96524832768,"internally_reserved":0,"allocated":75747328,"data_stored":75589995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.438}]},{"osd":1,"last update":"Fri Aug 25 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.40799999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.47799999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.45200000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.39500000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.42899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":6137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1314816,"data_stored":1293254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1314816,"data_stored":1287859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":58720256,"data_stored":58720256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":92274688,"data_stored":92274688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58720256,"data_stored":58720256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":96468992,"data_stored":96468992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54525952,"data_stored":54525952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":75497472,"data_stored":75497472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":41943040,"data_stored":41943040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":58720256,"data_stored":58720256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:45:45.148 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:45:45.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.303+0000 7fec08b03700 1 Processor -- start 2023-08-25T04:45:45.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.303+0000 7fec08b03700 1 -- start start 2023-08-25T04:45:45.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.304+0000 7fec08b03700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec040cf970 0x7fec0406a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.304+0000 7fec08b03700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fec0415d320 0x7fec0406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.304+0000 7fec08b03700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec040ac850 con 0x7fec0415cf40 2023-08-25T04:45:45.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.304+0000 7fec08b03700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec040ce240 con 0x7fec0415d320 2023-08-25T04:45:45.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.304+0000 7fec08b03700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec04071a60 con 0x7fec040cf970 2023-08-25T04:45:45.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.304+0000 7fec02d9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fec0415d320 0x7fec0406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.304+0000 7fec0259c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fec0415cf40 0x7fec040cda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40668/0 (socket says 172.21.15.16:40668) 2023-08-25T04:45:45.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.304+0000 7fec0259c700 1 -- 172.21.15.16:0/1722967367 learned_addr learned my addr 172.21.15.16:0/1722967367 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:45.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.304+0000 7fec01d9b700 1 --2- 172.21.15.16:0/1722967367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec040cf970 0x7fec0406a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.304+0000 7fec02d9d700 1 -- 172.21.15.16:0/1722967367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec040cf970 msgr2=0x7fec0406a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:45.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.304+0000 7fec02d9d700 1 --2- 172.21.15.16:0/1722967367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec040cf970 0x7fec0406a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.304+0000 7fec02d9d700 1 -- 172.21.15.16:0/1722967367 >> v1:172.21.15.16:6789/0 conn(0x7fec0415cf40 legacy=0x7fec040cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:45.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.304+0000 7fec02d9d700 1 -- 172.21.15.16:0/1722967367 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec04071d40 con 0x7fec0415d320 2023-08-25T04:45:45.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.304+0000 7fec0159a700 1 -- 172.21.15.16:0/1722967367 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932616582 0 0) 0x7fec040ac850 con 0x7fec0415cf40 2023-08-25T04:45:45.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.305+0000 7fec02d9d700 1 --2- 172.21.15.16:0/1722967367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec0415d320 0x7fec0406a880 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7febfc009d90 tx=0x7febfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ae68f1ae214698 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:45.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.305+0000 7fec0159a700 1 -- 172.21.15.16:0/1722967367 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc00e070 con 0x7fec0415d320 2023-08-25T04:45:45.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.305+0000 7fec0159a700 1 -- 172.21.15.16:0/1722967367 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc00bb20 con 0x7fec0415d320 2023-08-25T04:45:45.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.305+0000 7fec0159a700 1 -- 172.21.15.16:0/1722967367 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc012430 con 0x7fec0415d320 2023-08-25T04:45:45.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.305+0000 7fec08b03700 1 -- 172.21.15.16:0/1722967367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec0415d320 msgr2=0x7fec0406a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:45.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.305+0000 7fec08b03700 1 --2- 172.21.15.16:0/1722967367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec0415d320 0x7fec0406a880 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7febfc009d90 tx=0x7febfc00b330 comp rx=0 tx=0).stop 2023-08-25T04:45:45.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.305+0000 7fec08b03700 1 -- 172.21.15.16:0/1722967367 shutdown_connections 2023-08-25T04:45:45.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.305+0000 7fec08b03700 1 --2- 172.21.15.16:0/1722967367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec0415d320 0x7fec0406a880 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.305+0000 7fec08b03700 1 --2- 172.21.15.16:0/1722967367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec040cf970 0x7fec0406a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.305+0000 7fec08b03700 1 -- 172.21.15.16:0/1722967367 >> 172.21.15.16:0/1722967367 conn(0x7fec040b1a10 msgr2=0x7fec040b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:45.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.305+0000 7fec08b03700 1 -- 172.21.15.16:0/1722967367 shutdown_connections 2023-08-25T04:45:45.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.305+0000 7fec08b03700 1 -- 172.21.15.16:0/1722967367 wait complete. 2023-08-25T04:45:45.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.307+0000 7fec08b03700 1 Processor -- start 2023-08-25T04:45:45.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.307+0000 7fec08b03700 1 -- start start 2023-08-25T04:45:45.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.307+0000 7fec08b03700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec040cf970 0x7fec041490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.307+0000 7fec08b03700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec0415cf40 0x7fec0415f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.307+0000 7fec08b03700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec0415d320 0x7fec0415f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec08b03700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec04156c90 con 0x7fec0415cf40 2023-08-25T04:45:45.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec08b03700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec04156f70 con 0x7fec040cf970 2023-08-25T04:45:45.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec08b03700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec04157250 con 0x7fec0415d320 2023-08-25T04:45:45.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec01d9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec0415cf40 0x7fec0415f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec01d9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec0415cf40 0x7fec0415f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50262/0 (socket says 172.21.15.16:50262) 2023-08-25T04:45:45.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec01d9b700 1 -- 172.21.15.16:0/1970337388 learned_addr learned my addr 172.21.15.16:0/1970337388 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:45.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec02d9d700 1 --2- 172.21.15.16:0/1970337388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec0415d320 0x7fec0415f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec0259c700 1 --2- 172.21.15.16:0/1970337388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec040cf970 0x7fec041490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec01d9b700 1 -- 172.21.15.16:0/1970337388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec0415d320 msgr2=0x7fec0415f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:45.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec01d9b700 1 --2- 172.21.15.16:0/1970337388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec0415d320 0x7fec0415f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec01d9b700 1 -- 172.21.15.16:0/1970337388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec040cf970 msgr2=0x7fec041490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec01d9b700 1 --2- 172.21.15.16:0/1970337388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec040cf970 0x7fec041490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec01d9b700 1 -- 172.21.15.16:0/1970337388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc009a70 con 0x7fec0415cf40 2023-08-25T04:45:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec01d9b700 1 --2- 172.21.15.16:0/1970337388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec0415cf40 0x7fec0415f270 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7febf400e9b0 tx=0x7febf400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7febf2ffd700 1 -- 172.21.15.16:0/1970337388 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4009710 con 0x7fec0415cf40 2023-08-25T04:45:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7febf2ffd700 1 -- 172.21.15.16:0/1970337388 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf400ee50 con 0x7fec0415cf40 2023-08-25T04:45:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec08b03700 1 -- 172.21.15.16:0/1970337388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec04157530 con 0x7fec0415cf40 2023-08-25T04:45:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7febf2ffd700 1 -- 172.21.15.16:0/1970337388 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf400ca50 con 0x7fec0415cf40 2023-08-25T04:45:45.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.308+0000 7fec08b03700 1 -- 172.21.15.16:0/1970337388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec04157d30 con 0x7fec0415cf40 2023-08-25T04:45:45.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.309+0000 7fec08b03700 1 -- 172.21.15.16:0/1970337388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0404ee70 con 0x7fec0415cf40 2023-08-25T04:45:45.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.310+0000 7febf2ffd700 1 -- 172.21.15.16:0/1970337388 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7febf400cbb0 con 0x7fec0415cf40 2023-08-25T04:45:45.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.310+0000 7febf2ffd700 1 --2- 172.21.15.16:0/1970337388 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7febe406a0e0 0x7febe406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.310+0000 7febf2ffd700 1 -- 172.21.15.16:0/1970337388 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7febf4088560 con 0x7fec0415cf40 2023-08-25T04:45:45.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.311+0000 7fec0259c700 1 --2- 172.21.15.16:0/1970337388 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7febe406a0e0 0x7febe406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.311+0000 7fec0259c700 1 --2- 172.21.15.16:0/1970337388 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7febe406a0e0 0x7febe406c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7febf8007fd0 tx=0x7febf8007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:45.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.315+0000 7febf2ffd700 1 -- 172.21.15.16:0/1970337388 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7febf40576a0 con 0x7fec0415cf40 2023-08-25T04:45:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.511+0000 7fec08b03700 1 -- 172.21.15.16:0/1970337388 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec041570e0 con 0x7febe406a0e0 2023-08-25T04:45:45.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.520+0000 7febf2ffd700 1 -- 172.21.15.16:0/1970337388 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311167 (secure 0 0 0) 0x7fec041570e0 con 0x7febe406a0e0 2023-08-25T04:45:45.525 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:45:45.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.523+0000 7fec08b03700 1 -- 172.21.15.16:0/1970337388 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7febe406a0e0 msgr2=0x7febe406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:45.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.523+0000 7fec08b03700 1 --2- 172.21.15.16:0/1970337388 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7febe406a0e0 0x7febe406c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7febf8007fd0 tx=0x7febf8007de0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.523+0000 7fec08b03700 1 -- 172.21.15.16:0/1970337388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec0415cf40 msgr2=0x7fec0415f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:45.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.523+0000 7fec08b03700 1 --2- 172.21.15.16:0/1970337388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec0415cf40 0x7fec0415f270 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7febf400e9b0 tx=0x7febf400ecc0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.523+0000 7fec08b03700 1 -- 172.21.15.16:0/1970337388 shutdown_connections 2023-08-25T04:45:45.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.523+0000 7fec08b03700 1 --2- 172.21.15.16:0/1970337388 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7febe406a0e0 0x7febe406c5a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.523+0000 7fec08b03700 1 --2- 172.21.15.16:0/1970337388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec0415d320 0x7fec0415f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.523+0000 7fec08b03700 1 --2- 172.21.15.16:0/1970337388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec040cf970 0x7fec041490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.523+0000 7fec08b03700 1 --2- 172.21.15.16:0/1970337388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec0415cf40 0x7fec0415f270 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.523+0000 7fec08b03700 1 -- 172.21.15.16:0/1970337388 >> 172.21.15.16:0/1970337388 conn(0x7fec040b1a10 msgr2=0x7fec040b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:45.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.523+0000 7fec08b03700 1 -- 172.21.15.16:0/1970337388 shutdown_connections 2023-08-25T04:45:45.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.523+0000 7fec08b03700 1 -- 172.21.15.16:0/1970337388 wait complete. 2023-08-25T04:45:45.534 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-08-25T04:45:45.537 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-08-25T04:45:45.405378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102658171,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":129,"num_read_kb":115,"num_write":1099,"num_write_kb":1105890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17497,"ondisk_log_size":17497,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":593620,"kb_used_data":315092,"kb_used_omap":13,"kb_used_meta":278450,"kb_avail":754381100,"statfs":{"total":773094113280,"available":772486246400,"internally_reserved":0,"allocated":322654208,"data_stored":321393103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":285132888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":62,"apply_latency_ms":62,"commit_latency_ns":62000000,"apply_latency_ns":62000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-116414874,"num_objects":-29,"num_object_clones":0,"num_object_copies":-58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-29,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":729,"num_write_kb":890020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002622"},"pg_stats":[{"pgid":"4.3f","version":"23'232","reported_seq":247,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.942176+0000","last_change":"2023-08-25T04:43:42.895145+0000","last_active":"2023-08-25T04:45:43.942176+0000","last_peered":"2023-08-25T04:45:43.942176+0000","last_clean":"2023-08-25T04:45:43.942176+0000","last_became_active":"2023-08-25T04:43:42.894831+0000","last_became_peered":"2023-08-25T04:43:42.894831+0000","last_unstale":"2023-08-25T04:45:43.942176+0000","last_undegraded":"2023-08-25T04:45:43.942176+0000","last_fullsized":"2023-08-25T04:45:43.942176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:16.917741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'220","reported_seq":235,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.950118+0000","last_change":"2023-08-25T04:43:42.895503+0000","last_active":"2023-08-25T04:45:43.950118+0000","last_peered":"2023-08-25T04:45:43.950118+0000","last_clean":"2023-08-25T04:45:43.950118+0000","last_became_active":"2023-08-25T04:43:42.895245+0000","last_became_peered":"2023-08-25T04:43:42.895245+0000","last_unstale":"2023-08-25T04:45:43.950118+0000","last_undegraded":"2023-08-25T04:45:43.950118+0000","last_fullsized":"2023-08-25T04:45:43.950118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:39:50.519838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"23'276","reported_seq":291,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.955588+0000","last_change":"2023-08-25T04:43:42.888920+0000","last_active":"2023-08-25T04:45:43.955588+0000","last_peered":"2023-08-25T04:45:43.955588+0000","last_clean":"2023-08-25T04:45:43.955588+0000","last_became_active":"2023-08-25T04:43:42.888568+0000","last_became_peered":"2023-08-25T04:43:42.888568+0000","last_unstale":"2023-08-25T04:45:43.955588+0000","last_undegraded":"2023-08-25T04:45:43.955588+0000","last_fullsized":"2023-08-25T04:45:43.955588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:55:39.359039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"23'253","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.950989+0000","last_change":"2023-08-25T04:43:42.893868+0000","last_active":"2023-08-25T04:45:43.950989+0000","last_peered":"2023-08-25T04:45:43.950989+0000","last_clean":"2023-08-25T04:45:43.950989+0000","last_became_active":"2023-08-25T04:43:42.893534+0000","last_became_peered":"2023-08-25T04:43:42.893534+0000","last_unstale":"2023-08-25T04:45:43.950989+0000","last_undegraded":"2023-08-25T04:45:43.950989+0000","last_fullsized":"2023-08-25T04:45:43.950989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:20.295263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"23'256","reported_seq":271,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.951061+0000","last_change":"2023-08-25T04:43:42.902297+0000","last_active":"2023-08-25T04:45:43.951061+0000","last_peered":"2023-08-25T04:45:43.951061+0000","last_clean":"2023-08-25T04:45:43.951061+0000","last_became_active":"2023-08-25T04:43:42.901963+0000","last_became_peered":"2023-08-25T04:43:42.901963+0000","last_unstale":"2023-08-25T04:45:43.951061+0000","last_undegraded":"2023-08-25T04:45:43.951061+0000","last_fullsized":"2023-08-25T04:45:43.951061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:30:27.322745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'278","reported_seq":293,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.954382+0000","last_change":"2023-08-25T04:43:42.888877+0000","last_active":"2023-08-25T04:45:43.954382+0000","last_peered":"2023-08-25T04:45:43.954382+0000","last_clean":"2023-08-25T04:45:43.954382+0000","last_became_active":"2023-08-25T04:43:42.888567+0000","last_became_peered":"2023-08-25T04:43:42.888567+0000","last_unstale":"2023-08-25T04:45:43.954382+0000","last_undegraded":"2023-08-25T04:45:43.954382+0000","last_fullsized":"2023-08-25T04:45:43.954382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:15:07.375032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"23'293","reported_seq":308,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.949275+0000","last_change":"2023-08-25T04:43:42.902469+0000","last_active":"2023-08-25T04:45:43.949275+0000","last_peered":"2023-08-25T04:45:43.949275+0000","last_clean":"2023-08-25T04:45:43.949275+0000","last_became_active":"2023-08-25T04:43:42.902156+0000","last_became_peered":"2023-08-25T04:43:42.902156+0000","last_unstale":"2023-08-25T04:45:43.949275+0000","last_undegraded":"2023-08-25T04:45:43.949275+0000","last_fullsized":"2023-08-25T04:45:43.949275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:59.175818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"23'270","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.074470+0000","last_change":"2023-08-25T04:43:42.895697+0000","last_active":"2023-08-25T04:45:44.074470+0000","last_peered":"2023-08-25T04:45:44.074470+0000","last_clean":"2023-08-25T04:45:44.074470+0000","last_became_active":"2023-08-25T04:43:42.895410+0000","last_became_peered":"2023-08-25T04:43:42.895410+0000","last_unstale":"2023-08-25T04:45:44.074470+0000","last_undegraded":"2023-08-25T04:45:44.074470+0000","last_fullsized":"2023-08-25T04:45:44.074470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:17:01.748486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"23'248","reported_seq":263,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947053+0000","last_change":"2023-08-25T04:43:42.897483+0000","last_active":"2023-08-25T04:45:43.947053+0000","last_peered":"2023-08-25T04:45:43.947053+0000","last_clean":"2023-08-25T04:45:43.947053+0000","last_became_active":"2023-08-25T04:43:42.896949+0000","last_became_peered":"2023-08-25T04:43:42.896949+0000","last_unstale":"2023-08-25T04:45:43.947053+0000","last_undegraded":"2023-08-25T04:45:43.947053+0000","last_fullsized":"2023-08-25T04:45:43.947053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:20.889807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'282","reported_seq":297,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.088318+0000","last_change":"2023-08-25T04:43:42.895115+0000","last_active":"2023-08-25T04:45:44.088318+0000","last_peered":"2023-08-25T04:45:44.088318+0000","last_clean":"2023-08-25T04:45:44.088318+0000","last_became_active":"2023-08-25T04:43:42.894786+0000","last_became_peered":"2023-08-25T04:43:42.894786+0000","last_unstale":"2023-08-25T04:45:44.088318+0000","last_undegraded":"2023-08-25T04:45:44.088318+0000","last_fullsized":"2023-08-25T04:45:44.088318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:04:31.758204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"23'244","reported_seq":259,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.955622+0000","last_change":"2023-08-25T04:43:42.892793+0000","last_active":"2023-08-25T04:45:43.955622+0000","last_peered":"2023-08-25T04:45:43.955622+0000","last_clean":"2023-08-25T04:45:43.955622+0000","last_became_active":"2023-08-25T04:43:42.892558+0000","last_became_peered":"2023-08-25T04:43:42.892558+0000","last_unstale":"2023-08-25T04:45:43.955622+0000","last_undegraded":"2023-08-25T04:45:43.955622+0000","last_fullsized":"2023-08-25T04:45:43.955622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:35:57.269293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"23'260","reported_seq":275,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.950039+0000","last_change":"2023-08-25T04:43:42.892113+0000","last_active":"2023-08-25T04:45:43.950039+0000","last_peered":"2023-08-25T04:45:43.950039+0000","last_clean":"2023-08-25T04:45:43.950039+0000","last_became_active":"2023-08-25T04:43:42.891782+0000","last_became_peered":"2023-08-25T04:43:42.891782+0000","last_unstale":"2023-08-25T04:45:43.950039+0000","last_undegraded":"2023-08-25T04:45:43.950039+0000","last_fullsized":"2023-08-25T04:45:43.950039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:15:53.162927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'253","reported_seq":268,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.937601+0000","last_change":"2023-08-25T04:43:42.896635+0000","last_active":"2023-08-25T04:45:43.937601+0000","last_peered":"2023-08-25T04:45:43.937601+0000","last_clean":"2023-08-25T04:45:43.937601+0000","last_became_active":"2023-08-25T04:43:42.896334+0000","last_became_peered":"2023-08-25T04:43:42.896334+0000","last_unstale":"2023-08-25T04:45:43.937601+0000","last_undegraded":"2023-08-25T04:45:43.937601+0000","last_fullsized":"2023-08-25T04:45:43.937601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:55:06.974267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'273","reported_seq":288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947016+0000","last_change":"2023-08-25T04:43:42.894765+0000","last_active":"2023-08-25T04:45:43.947016+0000","last_peered":"2023-08-25T04:45:43.947016+0000","last_clean":"2023-08-25T04:45:43.947016+0000","last_became_active":"2023-08-25T04:43:42.894472+0000","last_became_peered":"2023-08-25T04:43:42.894472+0000","last_unstale":"2023-08-25T04:45:43.947016+0000","last_undegraded":"2023-08-25T04:45:43.947016+0000","last_fullsized":"2023-08-25T04:45:43.947016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:30:27.322745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"23'267","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.948843+0000","last_change":"2023-08-25T04:43:42.902458+0000","last_active":"2023-08-25T04:45:43.948843+0000","last_peered":"2023-08-25T04:45:43.948843+0000","last_clean":"2023-08-25T04:45:43.948843+0000","last_became_active":"2023-08-25T04:43:42.902184+0000","last_became_peered":"2023-08-25T04:43:42.902184+0000","last_unstale":"2023-08-25T04:45:43.948843+0000","last_undegraded":"2023-08-25T04:45:43.948843+0000","last_fullsized":"2023-08-25T04:45:43.948843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:07.315621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"23'258","reported_seq":273,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.093285+0000","last_change":"2023-08-25T04:43:42.889087+0000","last_active":"2023-08-25T04:45:44.093285+0000","last_peered":"2023-08-25T04:45:44.093285+0000","last_clean":"2023-08-25T04:45:44.093285+0000","last_became_active":"2023-08-25T04:43:42.888730+0000","last_became_peered":"2023-08-25T04:43:42.888730+0000","last_unstale":"2023-08-25T04:45:44.093285+0000","last_undegraded":"2023-08-25T04:45:44.093285+0000","last_fullsized":"2023-08-25T04:45:44.093285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:56.162169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"23'266","reported_seq":281,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.097052+0000","last_change":"2023-08-25T04:43:42.898466+0000","last_active":"2023-08-25T04:45:44.097052+0000","last_peered":"2023-08-25T04:45:44.097052+0000","last_clean":"2023-08-25T04:45:44.097052+0000","last_became_active":"2023-08-25T04:43:42.898103+0000","last_became_peered":"2023-08-25T04:43:42.898103+0000","last_unstale":"2023-08-25T04:45:44.097052+0000","last_undegraded":"2023-08-25T04:45:44.097052+0000","last_fullsized":"2023-08-25T04:45:44.097052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:34.861062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'250","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947372+0000","last_change":"2023-08-25T04:43:42.892153+0000","last_active":"2023-08-25T04:45:43.947372+0000","last_peered":"2023-08-25T04:45:43.947372+0000","last_clean":"2023-08-25T04:45:43.947372+0000","last_became_active":"2023-08-25T04:43:42.891874+0000","last_became_peered":"2023-08-25T04:43:42.891874+0000","last_unstale":"2023-08-25T04:45:43.947372+0000","last_undegraded":"2023-08-25T04:45:43.947372+0000","last_fullsized":"2023-08-25T04:45:43.947372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:08:00.896369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"23'237","reported_seq":252,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.945354+0000","last_change":"2023-08-25T04:43:42.895594+0000","last_active":"2023-08-25T04:45:43.945354+0000","last_peered":"2023-08-25T04:45:43.945354+0000","last_clean":"2023-08-25T04:45:43.945354+0000","last_became_active":"2023-08-25T04:43:42.895114+0000","last_became_peered":"2023-08-25T04:43:42.895114+0000","last_unstale":"2023-08-25T04:45:43.945354+0000","last_undegraded":"2023-08-25T04:45:43.945354+0000","last_fullsized":"2023-08-25T04:45:43.945354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:15.328992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'267","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.952396+0000","last_change":"2023-08-25T04:43:42.896149+0000","last_active":"2023-08-25T04:45:43.952396+0000","last_peered":"2023-08-25T04:45:43.952396+0000","last_clean":"2023-08-25T04:45:43.952396+0000","last_became_active":"2023-08-25T04:43:42.895893+0000","last_became_peered":"2023-08-25T04:43:42.895893+0000","last_unstale":"2023-08-25T04:45:43.952396+0000","last_undegraded":"2023-08-25T04:45:43.952396+0000","last_fullsized":"2023-08-25T04:45:43.952396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:26:47.525605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"23'266","reported_seq":281,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.943626+0000","last_change":"2023-08-25T04:43:42.905467+0000","last_active":"2023-08-25T04:45:43.943626+0000","last_peered":"2023-08-25T04:45:43.943626+0000","last_clean":"2023-08-25T04:45:43.943626+0000","last_became_active":"2023-08-25T04:43:42.905157+0000","last_became_peered":"2023-08-25T04:43:42.905157+0000","last_unstale":"2023-08-25T04:45:43.943626+0000","last_undegraded":"2023-08-25T04:45:43.943626+0000","last_fullsized":"2023-08-25T04:45:43.943626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:35.214306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"23'278","reported_seq":293,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.951055+0000","last_change":"2023-08-25T04:43:42.881107+0000","last_active":"2023-08-25T04:45:43.951055+0000","last_peered":"2023-08-25T04:45:43.951055+0000","last_clean":"2023-08-25T04:45:43.951055+0000","last_became_active":"2023-08-25T04:43:42.879881+0000","last_became_peered":"2023-08-25T04:43:42.879881+0000","last_unstale":"2023-08-25T04:45:43.951055+0000","last_undegraded":"2023-08-25T04:45:43.951055+0000","last_fullsized":"2023-08-25T04:45:43.951055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:12.206120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'246","reported_seq":256,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.941083+0000","last_change":"2023-08-25T04:44:30.818677+0000","last_active":"2023-08-25T04:45:43.941083+0000","last_peered":"2023-08-25T04:45:43.941083+0000","last_clean":"2023-08-25T04:45:43.941083+0000","last_became_active":"2023-08-25T04:44:30.818308+0000","last_became_peered":"2023-08-25T04:44:30.818308+0000","last_unstale":"2023-08-25T04:45:43.941083+0000","last_undegraded":"2023-08-25T04:45:43.941083+0000","last_fullsized":"2023-08-25T04:45:43.941083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:43.562022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"23'239","reported_seq":254,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.943417+0000","last_change":"2023-08-25T04:43:42.897136+0000","last_active":"2023-08-25T04:45:43.943417+0000","last_peered":"2023-08-25T04:45:43.943417+0000","last_clean":"2023-08-25T04:45:43.943417+0000","last_became_active":"2023-08-25T04:43:42.896869+0000","last_became_peered":"2023-08-25T04:43:42.896869+0000","last_unstale":"2023-08-25T04:45:43.943417+0000","last_undegraded":"2023-08-25T04:45:43.943417+0000","last_fullsized":"2023-08-25T04:45:43.943417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:04.986803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"23'255","reported_seq":270,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.950889+0000","last_change":"2023-08-25T04:43:42.893954+0000","last_active":"2023-08-25T04:45:43.950889+0000","last_peered":"2023-08-25T04:45:43.950889+0000","last_clean":"2023-08-25T04:45:43.950889+0000","last_became_active":"2023-08-25T04:43:42.893673+0000","last_became_peered":"2023-08-25T04:43:42.893673+0000","last_unstale":"2023-08-25T04:45:43.950889+0000","last_undegraded":"2023-08-25T04:45:43.950889+0000","last_fullsized":"2023-08-25T04:45:43.950889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:17:01.748486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'273","reported_seq":288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.950944+0000","last_change":"2023-08-25T04:43:42.888116+0000","last_active":"2023-08-25T04:45:43.950944+0000","last_peered":"2023-08-25T04:45:43.950944+0000","last_clean":"2023-08-25T04:45:43.950944+0000","last_became_active":"2023-08-25T04:43:42.887831+0000","last_became_peered":"2023-08-25T04:43:42.887831+0000","last_unstale":"2023-08-25T04:45:43.950944+0000","last_undegraded":"2023-08-25T04:45:43.950944+0000","last_fullsized":"2023-08-25T04:45:43.950944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:39:50.519838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'237","reported_seq":252,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.072546+0000","last_change":"2023-08-25T04:43:42.894954+0000","last_active":"2023-08-25T04:45:44.072546+0000","last_peered":"2023-08-25T04:45:44.072546+0000","last_clean":"2023-08-25T04:45:44.072546+0000","last_became_active":"2023-08-25T04:43:42.894302+0000","last_became_peered":"2023-08-25T04:43:42.894302+0000","last_unstale":"2023-08-25T04:45:44.072546+0000","last_undegraded":"2023-08-25T04:45:44.072546+0000","last_fullsized":"2023-08-25T04:45:44.072546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:05:02.005895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282331+0000","last_change":"2023-08-25T04:43:41.888584+0000","last_active":"2023-08-25T04:44:31.282331+0000","last_peered":"2023-08-25T04:44:31.282331+0000","last_clean":"2023-08-25T04:44:31.282331+0000","last_became_active":"2023-08-25T04:43:41.888339+0000","last_became_peered":"2023-08-25T04:43:41.888339+0000","last_unstale":"2023-08-25T04:44:31.282331+0000","last_undegraded":"2023-08-25T04:44:31.282331+0000","last_fullsized":"2023-08-25T04:44:31.282331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:37.980335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'271","reported_seq":286,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947167+0000","last_change":"2023-08-25T04:43:42.897739+0000","last_active":"2023-08-25T04:45:43.947167+0000","last_peered":"2023-08-25T04:45:43.947167+0000","last_clean":"2023-08-25T04:45:43.947167+0000","last_became_active":"2023-08-25T04:43:42.897425+0000","last_became_peered":"2023-08-25T04:43:42.897425+0000","last_unstale":"2023-08-25T04:45:43.947167+0000","last_undegraded":"2023-08-25T04:45:43.947167+0000","last_fullsized":"2023-08-25T04:45:43.947167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:46:26.445143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475661+0000","last_change":"2023-08-25T04:43:41.886122+0000","last_active":"2023-08-25T04:44:30.475661+0000","last_peered":"2023-08-25T04:44:30.475661+0000","last_clean":"2023-08-25T04:44:30.475661+0000","last_became_active":"2023-08-25T04:43:41.885184+0000","last_became_peered":"2023-08-25T04:43:41.885184+0000","last_unstale":"2023-08-25T04:44:30.475661+0000","last_undegraded":"2023-08-25T04:44:30.475661+0000","last_fullsized":"2023-08-25T04:44:30.475661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:33.855942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'291","reported_seq":307,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.067644+0000","last_change":"2023-08-25T04:43:42.890854+0000","last_active":"2023-08-25T04:45:44.067644+0000","last_peered":"2023-08-25T04:45:44.067644+0000","last_clean":"2023-08-25T04:45:44.067644+0000","last_became_active":"2023-08-25T04:43:42.890575+0000","last_became_peered":"2023-08-25T04:43:42.890575+0000","last_unstale":"2023-08-25T04:45:44.067644+0000","last_undegraded":"2023-08-25T04:45:44.067644+0000","last_fullsized":"2023-08-25T04:45:44.067644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:59.175818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.477781+0000","last_change":"2023-08-25T04:43:41.885567+0000","last_active":"2023-08-25T04:44:30.477781+0000","last_peered":"2023-08-25T04:44:30.477781+0000","last_clean":"2023-08-25T04:44:30.477781+0000","last_became_active":"2023-08-25T04:43:41.885299+0000","last_became_peered":"2023-08-25T04:43:41.885299+0000","last_unstale":"2023-08-25T04:44:30.477781+0000","last_undegraded":"2023-08-25T04:44:30.477781+0000","last_fullsized":"2023-08-25T04:44:30.477781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:14:12.640506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'269","reported_seq":284,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.934097+0000","last_change":"2023-08-25T04:43:42.899190+0000","last_active":"2023-08-25T04:45:43.934097+0000","last_peered":"2023-08-25T04:45:43.934097+0000","last_clean":"2023-08-25T04:45:43.934097+0000","last_became_active":"2023-08-25T04:43:42.898874+0000","last_became_peered":"2023-08-25T04:43:42.898874+0000","last_unstale":"2023-08-25T04:45:43.934097+0000","last_undegraded":"2023-08-25T04:45:43.934097+0000","last_fullsized":"2023-08-25T04:45:43.934097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:07.786286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.817699+0000","last_change":"2023-08-25T04:43:41.883055+0000","last_active":"2023-08-25T04:44:30.817699+0000","last_peered":"2023-08-25T04:44:30.817699+0000","last_clean":"2023-08-25T04:44:30.817699+0000","last_became_active":"2023-08-25T04:43:41.882381+0000","last_became_peered":"2023-08-25T04:43:41.882381+0000","last_unstale":"2023-08-25T04:44:30.817699+0000","last_undegraded":"2023-08-25T04:44:30.817699+0000","last_fullsized":"2023-08-25T04:44:30.817699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:46:41.140536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'261","reported_seq":281,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.074319+0000","last_change":"2023-08-25T04:44:30.481564+0000","last_active":"2023-08-25T04:45:44.074319+0000","last_peered":"2023-08-25T04:45:44.074319+0000","last_clean":"2023-08-25T04:45:44.074319+0000","last_became_active":"2023-08-25T04:44:30.481273+0000","last_became_peered":"2023-08-25T04:44:30.481273+0000","last_unstale":"2023-08-25T04:45:44.074319+0000","last_undegraded":"2023-08-25T04:45:44.074319+0000","last_fullsized":"2023-08-25T04:45:44.074319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:35.214306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475622+0000","last_change":"2023-08-25T04:43:41.882339+0000","last_active":"2023-08-25T04:44:30.475622+0000","last_peered":"2023-08-25T04:44:30.475622+0000","last_clean":"2023-08-25T04:44:30.475622+0000","last_became_active":"2023-08-25T04:43:41.882055+0000","last_became_peered":"2023-08-25T04:43:41.882055+0000","last_unstale":"2023-08-25T04:44:30.475622+0000","last_undegraded":"2023-08-25T04:44:30.475622+0000","last_fullsized":"2023-08-25T04:44:30.475622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:19.884687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"23'268","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.090214+0000","last_change":"2023-08-25T04:43:42.891741+0000","last_active":"2023-08-25T04:45:44.090214+0000","last_peered":"2023-08-25T04:45:44.090214+0000","last_clean":"2023-08-25T04:45:44.090214+0000","last_became_active":"2023-08-25T04:43:42.890100+0000","last_became_peered":"2023-08-25T04:43:42.890100+0000","last_unstale":"2023-08-25T04:45:44.090214+0000","last_undegraded":"2023-08-25T04:45:44.090214+0000","last_fullsized":"2023-08-25T04:45:44.090214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:09.859531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'12","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:42.091016+0000","last_change":"2023-08-25T04:43:41.887924+0000","last_active":"2023-08-25T04:45:42.091016+0000","last_peered":"2023-08-25T04:45:42.091016+0000","last_clean":"2023-08-25T04:45:42.091016+0000","last_became_active":"2023-08-25T04:43:41.887622+0000","last_became_peered":"2023-08-25T04:43:41.887622+0000","last_unstale":"2023-08-25T04:45:42.091016+0000","last_undegraded":"2023-08-25T04:45:42.091016+0000","last_fullsized":"2023-08-25T04:45:42.091016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:37:55.965513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"23'273","reported_seq":288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.094435+0000","last_change":"2023-08-25T04:43:42.891006+0000","last_active":"2023-08-25T04:45:44.094435+0000","last_peered":"2023-08-25T04:45:44.094435+0000","last_clean":"2023-08-25T04:45:44.094435+0000","last_became_active":"2023-08-25T04:43:42.890648+0000","last_became_peered":"2023-08-25T04:43:42.890648+0000","last_unstale":"2023-08-25T04:45:44.094435+0000","last_undegraded":"2023-08-25T04:45:44.094435+0000","last_fullsized":"2023-08-25T04:45:44.094435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:39:11.580949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'341","reported_seq":358,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.909488+0000","last_change":"2023-08-25T04:43:41.887033+0000","last_active":"2023-08-25T04:45:43.909488+0000","last_peered":"2023-08-25T04:45:43.909488+0000","last_clean":"2023-08-25T04:45:43.909488+0000","last_became_active":"2023-08-25T04:43:41.886491+0000","last_became_peered":"2023-08-25T04:43:41.886491+0000","last_unstale":"2023-08-25T04:45:43.909488+0000","last_undegraded":"2023-08-25T04:45:43.909488+0000","last_fullsized":"2023-08-25T04:45:43.909488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:55.292210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396437,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":1603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"23'297","reported_seq":312,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.954956+0000","last_change":"2023-08-25T04:43:42.893709+0000","last_active":"2023-08-25T04:45:43.954956+0000","last_peered":"2023-08-25T04:45:43.954956+0000","last_clean":"2023-08-25T04:45:43.954956+0000","last_became_active":"2023-08-25T04:43:42.893525+0000","last_became_peered":"2023-08-25T04:43:42.893525+0000","last_unstale":"2023-08-25T04:45:43.954956+0000","last_undegraded":"2023-08-25T04:45:43.954956+0000","last_fullsized":"2023-08-25T04:45:43.954956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:36:05.985843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138242+0000","last_change":"2023-08-25T04:43:41.890946+0000","last_active":"2023-08-25T04:44:31.138242+0000","last_peered":"2023-08-25T04:44:31.138242+0000","last_clean":"2023-08-25T04:44:31.138242+0000","last_became_active":"2023-08-25T04:43:41.890673+0000","last_became_peered":"2023-08-25T04:43:41.890673+0000","last_unstale":"2023-08-25T04:44:31.138242+0000","last_undegraded":"2023-08-25T04:44:31.138242+0000","last_fullsized":"2023-08-25T04:44:31.138242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:21:24.093061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"23'269","reported_seq":284,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.097987+0000","last_change":"2023-08-25T04:43:42.897809+0000","last_active":"2023-08-25T04:45:44.097987+0000","last_peered":"2023-08-25T04:45:44.097987+0000","last_clean":"2023-08-25T04:45:44.097987+0000","last_became_active":"2023-08-25T04:43:42.897204+0000","last_became_peered":"2023-08-25T04:43:42.897204+0000","last_unstale":"2023-08-25T04:45:44.097987+0000","last_undegraded":"2023-08-25T04:45:44.097987+0000","last_fullsized":"2023-08-25T04:45:44.097987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:25:20.195553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.817198+0000","last_change":"2023-08-25T04:43:41.881387+0000","last_active":"2023-08-25T04:44:30.817198+0000","last_peered":"2023-08-25T04:44:30.817198+0000","last_clean":"2023-08-25T04:44:30.817198+0000","last_became_active":"2023-08-25T04:43:41.881067+0000","last_became_peered":"2023-08-25T04:43:41.881067+0000","last_unstale":"2023-08-25T04:44:30.817198+0000","last_undegraded":"2023-08-25T04:44:30.817198+0000","last_fullsized":"2023-08-25T04:44:30.817198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:05.439371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'253","reported_seq":268,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.937984+0000","last_change":"2023-08-25T04:43:42.895088+0000","last_active":"2023-08-25T04:45:43.937984+0000","last_peered":"2023-08-25T04:45:43.937984+0000","last_clean":"2023-08-25T04:45:43.937984+0000","last_became_active":"2023-08-25T04:43:42.894807+0000","last_became_peered":"2023-08-25T04:43:42.894807+0000","last_unstale":"2023-08-25T04:45:43.937984+0000","last_undegraded":"2023-08-25T04:45:43.937984+0000","last_fullsized":"2023-08-25T04:45:43.937984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:46:42.145657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138466+0000","last_change":"2023-08-25T04:43:41.890995+0000","last_active":"2023-08-25T04:44:31.138466+0000","last_peered":"2023-08-25T04:44:31.138466+0000","last_clean":"2023-08-25T04:44:31.138466+0000","last_became_active":"2023-08-25T04:43:41.890706+0000","last_became_peered":"2023-08-25T04:43:41.890706+0000","last_unstale":"2023-08-25T04:44:31.138466+0000","last_undegraded":"2023-08-25T04:44:31.138466+0000","last_fullsized":"2023-08-25T04:44:31.138466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:08.854411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"23'288","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.091649+0000","last_change":"2023-08-25T04:43:42.897775+0000","last_active":"2023-08-25T04:45:44.091649+0000","last_peered":"2023-08-25T04:45:44.091649+0000","last_clean":"2023-08-25T04:45:44.091649+0000","last_became_active":"2023-08-25T04:43:42.897476+0000","last_became_peered":"2023-08-25T04:43:42.897476+0000","last_unstale":"2023-08-25T04:45:44.091649+0000","last_undegraded":"2023-08-25T04:45:44.091649+0000","last_fullsized":"2023-08-25T04:45:44.091649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:39:50.519838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500563+0000","last_change":"2023-08-25T04:43:41.892829+0000","last_active":"2023-08-25T04:44:31.500563+0000","last_peered":"2023-08-25T04:44:31.500563+0000","last_clean":"2023-08-25T04:44:31.500563+0000","last_became_active":"2023-08-25T04:43:41.892517+0000","last_became_peered":"2023-08-25T04:43:41.892517+0000","last_unstale":"2023-08-25T04:44:31.500563+0000","last_undegraded":"2023-08-25T04:44:31.500563+0000","last_fullsized":"2023-08-25T04:44:31.500563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:57:37.072728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"23'268","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.939447+0000","last_change":"2023-08-25T04:43:42.905276+0000","last_active":"2023-08-25T04:45:43.939447+0000","last_peered":"2023-08-25T04:45:43.939447+0000","last_clean":"2023-08-25T04:45:43.939447+0000","last_became_active":"2023-08-25T04:43:42.904736+0000","last_became_peered":"2023-08-25T04:43:42.904736+0000","last_unstale":"2023-08-25T04:45:43.939447+0000","last_undegraded":"2023-08-25T04:45:43.939447+0000","last_fullsized":"2023-08-25T04:45:43.939447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:38.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138672+0000","last_change":"2023-08-25T04:43:41.891246+0000","last_active":"2023-08-25T04:44:31.138672+0000","last_peered":"2023-08-25T04:44:31.138672+0000","last_clean":"2023-08-25T04:44:31.138672+0000","last_became_active":"2023-08-25T04:43:41.890942+0000","last_became_peered":"2023-08-25T04:43:41.890942+0000","last_unstale":"2023-08-25T04:44:31.138672+0000","last_undegraded":"2023-08-25T04:44:31.138672+0000","last_fullsized":"2023-08-25T04:44:31.138672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:33:59.579978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"23'238","reported_seq":253,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.068264+0000","last_change":"2023-08-25T04:43:42.895071+0000","last_active":"2023-08-25T04:45:44.068264+0000","last_peered":"2023-08-25T04:45:44.068264+0000","last_clean":"2023-08-25T04:45:44.068264+0000","last_became_active":"2023-08-25T04:43:42.894285+0000","last_became_peered":"2023-08-25T04:43:42.894285+0000","last_unstale":"2023-08-25T04:45:44.068264+0000","last_undegraded":"2023-08-25T04:45:44.068264+0000","last_fullsized":"2023-08-25T04:45:44.068264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:12.206120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138636+0000","last_change":"2023-08-25T04:43:41.891175+0000","last_active":"2023-08-25T04:44:31.138636+0000","last_peered":"2023-08-25T04:44:31.138636+0000","last_clean":"2023-08-25T04:44:31.138636+0000","last_became_active":"2023-08-25T04:43:41.890883+0000","last_became_peered":"2023-08-25T04:43:41.890883+0000","last_unstale":"2023-08-25T04:44:31.138636+0000","last_undegraded":"2023-08-25T04:44:31.138636+0000","last_fullsized":"2023-08-25T04:44:31.138636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:38.632609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"23'265","reported_seq":280,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.955269+0000","last_change":"2023-08-25T04:43:42.891686+0000","last_active":"2023-08-25T04:45:43.955269+0000","last_peered":"2023-08-25T04:45:43.955269+0000","last_clean":"2023-08-25T04:45:43.955269+0000","last_became_active":"2023-08-25T04:43:42.891443+0000","last_became_peered":"2023-08-25T04:43:42.891443+0000","last_unstale":"2023-08-25T04:45:43.955269+0000","last_undegraded":"2023-08-25T04:45:43.955269+0000","last_fullsized":"2023-08-25T04:45:43.955269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:18:58.719117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138361+0000","last_change":"2023-08-25T04:43:41.888723+0000","last_active":"2023-08-25T04:44:31.138361+0000","last_peered":"2023-08-25T04:44:31.138361+0000","last_clean":"2023-08-25T04:44:31.138361+0000","last_became_active":"2023-08-25T04:43:41.888447+0000","last_became_peered":"2023-08-25T04:43:41.888447+0000","last_unstale":"2023-08-25T04:44:31.138361+0000","last_undegraded":"2023-08-25T04:44:31.138361+0000","last_fullsized":"2023-08-25T04:44:31.138361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:42.712431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"23'270","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.086705+0000","last_change":"2023-08-25T04:43:42.892447+0000","last_active":"2023-08-25T04:45:44.086705+0000","last_peered":"2023-08-25T04:45:44.086705+0000","last_clean":"2023-08-25T04:45:44.086705+0000","last_became_active":"2023-08-25T04:43:42.892191+0000","last_became_peered":"2023-08-25T04:43:42.892191+0000","last_unstale":"2023-08-25T04:45:44.086705+0000","last_undegraded":"2023-08-25T04:45:44.086705+0000","last_fullsized":"2023-08-25T04:45:44.086705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:18.265853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475964+0000","last_change":"2023-08-25T04:43:41.884395+0000","last_active":"2023-08-25T04:44:30.475964+0000","last_peered":"2023-08-25T04:44:30.475964+0000","last_clean":"2023-08-25T04:44:30.475964+0000","last_became_active":"2023-08-25T04:43:41.884098+0000","last_became_peered":"2023-08-25T04:43:41.884098+0000","last_unstale":"2023-08-25T04:44:30.475964+0000","last_undegraded":"2023-08-25T04:44:30.475964+0000","last_fullsized":"2023-08-25T04:44:30.475964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:20.449241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"23'269","reported_seq":284,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.952454+0000","last_change":"2023-08-25T04:43:42.881050+0000","last_active":"2023-08-25T04:45:43.952454+0000","last_peered":"2023-08-25T04:45:43.952454+0000","last_clean":"2023-08-25T04:45:43.952454+0000","last_became_active":"2023-08-25T04:43:42.880104+0000","last_became_peered":"2023-08-25T04:43:42.880104+0000","last_unstale":"2023-08-25T04:45:43.952454+0000","last_undegraded":"2023-08-25T04:45:43.952454+0000","last_fullsized":"2023-08-25T04:45:43.952454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:21.454361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:30.051992+0000","last_change":"2023-08-25T04:43:41.885729+0000","last_active":"2023-08-25T04:45:30.051992+0000","last_peered":"2023-08-25T04:45:30.051992+0000","last_clean":"2023-08-25T04:45:30.051992+0000","last_became_active":"2023-08-25T04:43:41.885433+0000","last_became_peered":"2023-08-25T04:43:41.885433+0000","last_unstale":"2023-08-25T04:45:30.051992+0000","last_undegraded":"2023-08-25T04:45:30.051992+0000","last_fullsized":"2023-08-25T04:45:30.051992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:38.632609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'243","reported_seq":258,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.090177+0000","last_change":"2023-08-25T04:43:42.896701+0000","last_active":"2023-08-25T04:45:44.090177+0000","last_peered":"2023-08-25T04:45:44.090177+0000","last_clean":"2023-08-25T04:45:44.090177+0000","last_became_active":"2023-08-25T04:43:42.896440+0000","last_became_peered":"2023-08-25T04:43:42.896440+0000","last_unstale":"2023-08-25T04:45:44.090177+0000","last_undegraded":"2023-08-25T04:45:44.090177+0000","last_fullsized":"2023-08-25T04:45:44.090177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:15.437547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500655+0000","last_change":"2023-08-25T04:43:41.891087+0000","last_active":"2023-08-25T04:44:31.500655+0000","last_peered":"2023-08-25T04:44:31.500655+0000","last_clean":"2023-08-25T04:44:31.500655+0000","last_became_active":"2023-08-25T04:43:41.890827+0000","last_became_peered":"2023-08-25T04:43:41.890827+0000","last_unstale":"2023-08-25T04:44:31.500655+0000","last_undegraded":"2023-08-25T04:44:31.500655+0000","last_fullsized":"2023-08-25T04:44:31.500655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:00:12.731255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"23'288","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.955555+0000","last_change":"2023-08-25T04:43:42.897377+0000","last_active":"2023-08-25T04:45:43.955555+0000","last_peered":"2023-08-25T04:45:43.955555+0000","last_clean":"2023-08-25T04:45:43.955555+0000","last_became_active":"2023-08-25T04:43:42.897108+0000","last_became_peered":"2023-08-25T04:43:42.897108+0000","last_unstale":"2023-08-25T04:45:43.955555+0000","last_undegraded":"2023-08-25T04:45:43.955555+0000","last_fullsized":"2023-08-25T04:45:43.955555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:59.768622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282280+0000","last_change":"2023-08-25T04:43:41.888568+0000","last_active":"2023-08-25T04:44:31.282280+0000","last_peered":"2023-08-25T04:44:31.282280+0000","last_clean":"2023-08-25T04:44:31.282280+0000","last_became_active":"2023-08-25T04:43:41.888323+0000","last_became_peered":"2023-08-25T04:43:41.888323+0000","last_unstale":"2023-08-25T04:44:31.282280+0000","last_undegraded":"2023-08-25T04:44:31.282280+0000","last_fullsized":"2023-08-25T04:44:31.282280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:53:53.170122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"23'285","reported_seq":300,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.954940+0000","last_change":"2023-08-25T04:43:42.897222+0000","last_active":"2023-08-25T04:45:43.954940+0000","last_peered":"2023-08-25T04:45:43.954940+0000","last_clean":"2023-08-25T04:45:43.954940+0000","last_became_active":"2023-08-25T04:43:42.896943+0000","last_became_peered":"2023-08-25T04:43:42.896943+0000","last_unstale":"2023-08-25T04:45:43.954940+0000","last_undegraded":"2023-08-25T04:45:43.954940+0000","last_fullsized":"2023-08-25T04:45:43.954940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:39.531589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.477627+0000","last_change":"2023-08-25T04:43:41.887489+0000","last_active":"2023-08-25T04:44:30.477627+0000","last_peered":"2023-08-25T04:44:30.477627+0000","last_clean":"2023-08-25T04:44:30.477627+0000","last_became_active":"2023-08-25T04:43:41.886846+0000","last_became_peered":"2023-08-25T04:43:41.886846+0000","last_unstale":"2023-08-25T04:44:30.477627+0000","last_undegraded":"2023-08-25T04:44:30.477627+0000","last_fullsized":"2023-08-25T04:44:30.477627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:06.310501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'280","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.951699+0000","last_change":"2023-08-25T04:43:42.903030+0000","last_active":"2023-08-25T04:45:43.951699+0000","last_peered":"2023-08-25T04:45:43.951699+0000","last_clean":"2023-08-25T04:45:43.951699+0000","last_became_active":"2023-08-25T04:43:42.902123+0000","last_became_peered":"2023-08-25T04:43:42.902123+0000","last_unstale":"2023-08-25T04:45:43.951699+0000","last_undegraded":"2023-08-25T04:45:43.951699+0000","last_fullsized":"2023-08-25T04:45:43.951699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:04:31.758204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478851+0000","last_change":"2023-08-25T04:43:41.883173+0000","last_active":"2023-08-25T04:44:30.478851+0000","last_peered":"2023-08-25T04:44:30.478851+0000","last_clean":"2023-08-25T04:44:30.478851+0000","last_became_active":"2023-08-25T04:43:41.882776+0000","last_became_peered":"2023-08-25T04:43:41.882776+0000","last_unstale":"2023-08-25T04:44:30.478851+0000","last_undegraded":"2023-08-25T04:44:30.478851+0000","last_fullsized":"2023-08-25T04:44:30.478851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:43.055214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282709+0000","last_change":"2023-08-25T04:43:36.786045+0000","last_active":"2023-08-25T04:44:31.282709+0000","last_peered":"2023-08-25T04:44:31.282709+0000","last_clean":"2023-08-25T04:44:31.282709+0000","last_became_active":"2023-08-25T04:43:36.785725+0000","last_became_peered":"2023-08-25T04:43:36.785725+0000","last_unstale":"2023-08-25T04:44:31.282709+0000","last_undegraded":"2023-08-25T04:44:31.282709+0000","last_fullsized":"2023-08-25T04:44:31.282709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:13.214839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"23'253","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.095457+0000","last_change":"2023-08-25T04:43:42.890044+0000","last_active":"2023-08-25T04:45:44.095457+0000","last_peered":"2023-08-25T04:45:44.095457+0000","last_clean":"2023-08-25T04:45:44.095457+0000","last_became_active":"2023-08-25T04:43:42.889721+0000","last_became_peered":"2023-08-25T04:43:42.889721+0000","last_unstale":"2023-08-25T04:45:44.095457+0000","last_undegraded":"2023-08-25T04:45:44.095457+0000","last_fullsized":"2023-08-25T04:45:44.095457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:59.175818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478654+0000","last_change":"2023-08-25T04:43:36.782928+0000","last_active":"2023-08-25T04:44:30.478654+0000","last_peered":"2023-08-25T04:44:30.478654+0000","last_clean":"2023-08-25T04:44:30.478654+0000","last_became_active":"2023-08-25T04:43:36.782680+0000","last_became_peered":"2023-08-25T04:43:36.782680+0000","last_unstale":"2023-08-25T04:44:30.478654+0000","last_undegraded":"2023-08-25T04:44:30.478654+0000","last_fullsized":"2023-08-25T04:44:30.478654+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:33:54.492649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:36.931752+0000","last_change":"2023-08-25T04:43:41.888878+0000","last_active":"2023-08-25T04:45:36.931752+0000","last_peered":"2023-08-25T04:45:36.931752+0000","last_clean":"2023-08-25T04:45:36.931752+0000","last_became_active":"2023-08-25T04:43:41.885363+0000","last_became_peered":"2023-08-25T04:43:41.885363+0000","last_unstale":"2023-08-25T04:45:36.931752+0000","last_undegraded":"2023-08-25T04:45:36.931752+0000","last_fullsized":"2023-08-25T04:45:36.931752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:06.310501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'246","reported_seq":261,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.954730+0000","last_change":"2023-08-25T04:43:42.899201+0000","last_active":"2023-08-25T04:45:43.954730+0000","last_peered":"2023-08-25T04:45:43.954730+0000","last_clean":"2023-08-25T04:45:43.954730+0000","last_became_active":"2023-08-25T04:43:42.898942+0000","last_became_peered":"2023-08-25T04:43:42.898942+0000","last_unstale":"2023-08-25T04:45:43.954730+0000","last_undegraded":"2023-08-25T04:45:43.954730+0000","last_fullsized":"2023-08-25T04:45:43.954730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:57:45.095370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.474997+0000","last_change":"2023-08-25T04:43:36.785266+0000","last_active":"2023-08-25T04:44:30.474997+0000","last_peered":"2023-08-25T04:44:30.474997+0000","last_clean":"2023-08-25T04:44:30.474997+0000","last_became_active":"2023-08-25T04:43:36.784937+0000","last_became_peered":"2023-08-25T04:43:36.784937+0000","last_unstale":"2023-08-25T04:44:30.474997+0000","last_undegraded":"2023-08-25T04:44:30.474997+0000","last_fullsized":"2023-08-25T04:44:30.474997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:05:30.545713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138986+0000","last_change":"2023-08-25T04:43:36.785867+0000","last_active":"2023-08-25T04:44:31.138986+0000","last_peered":"2023-08-25T04:44:31.138986+0000","last_clean":"2023-08-25T04:44:31.138986+0000","last_became_active":"2023-08-25T04:43:36.785451+0000","last_became_peered":"2023-08-25T04:43:36.785451+0000","last_unstale":"2023-08-25T04:44:31.138986+0000","last_undegraded":"2023-08-25T04:44:31.138986+0000","last_fullsized":"2023-08-25T04:44:31.138986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:10.216462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'14","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.062429+0000","last_change":"2023-08-25T04:43:41.886451+0000","last_active":"2023-08-25T04:45:44.062429+0000","last_peered":"2023-08-25T04:45:44.062429+0000","last_clean":"2023-08-25T04:45:44.062429+0000","last_became_active":"2023-08-25T04:43:41.885029+0000","last_became_peered":"2023-08-25T04:43:41.885029+0000","last_unstale":"2023-08-25T04:45:44.062429+0000","last_undegraded":"2023-08-25T04:45:44.062429+0000","last_fullsized":"2023-08-25T04:45:44.062429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:05:01.000775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7272,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":13,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'275","reported_seq":290,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.069940+0000","last_change":"2023-08-25T04:43:42.881048+0000","last_active":"2023-08-25T04:45:44.069940+0000","last_peered":"2023-08-25T04:45:44.069940+0000","last_clean":"2023-08-25T04:45:44.069940+0000","last_became_active":"2023-08-25T04:43:42.880591+0000","last_became_peered":"2023-08-25T04:43:42.880591+0000","last_unstale":"2023-08-25T04:45:44.069940+0000","last_undegraded":"2023-08-25T04:45:44.069940+0000","last_fullsized":"2023-08-25T04:45:44.069940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:35.214306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138202+0000","last_change":"2023-08-25T04:43:37.192872+0000","last_active":"2023-08-25T04:44:31.138202+0000","last_peered":"2023-08-25T04:44:31.138202+0000","last_clean":"2023-08-25T04:44:31.138202+0000","last_became_active":"2023-08-25T04:43:37.192594+0000","last_became_peered":"2023-08-25T04:43:37.192594+0000","last_unstale":"2023-08-25T04:44:31.138202+0000","last_undegraded":"2023-08-25T04:44:31.138202+0000","last_fullsized":"2023-08-25T04:44:31.138202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:14:07.553177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.474916+0000","last_change":"2023-08-25T04:43:41.888507+0000","last_active":"2023-08-25T04:44:30.474916+0000","last_peered":"2023-08-25T04:44:30.474916+0000","last_clean":"2023-08-25T04:44:30.474916+0000","last_became_active":"2023-08-25T04:43:41.888158+0000","last_became_peered":"2023-08-25T04:43:41.888158+0000","last_unstale":"2023-08-25T04:44:30.474916+0000","last_undegraded":"2023-08-25T04:44:30.474916+0000","last_fullsized":"2023-08-25T04:44:30.474916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:46:50.995055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'249","reported_seq":264,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.087271+0000","last_change":"2023-08-25T04:43:42.902440+0000","last_active":"2023-08-25T04:45:44.087271+0000","last_peered":"2023-08-25T04:45:44.087271+0000","last_clean":"2023-08-25T04:45:44.087271+0000","last_became_active":"2023-08-25T04:43:42.901657+0000","last_became_peered":"2023-08-25T04:43:42.901657+0000","last_unstale":"2023-08-25T04:45:44.087271+0000","last_undegraded":"2023-08-25T04:45:44.087271+0000","last_fullsized":"2023-08-25T04:45:44.087271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:30:27.322745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138904+0000","last_change":"2023-08-25T04:43:37.192977+0000","last_active":"2023-08-25T04:44:31.138904+0000","last_peered":"2023-08-25T04:44:31.138904+0000","last_clean":"2023-08-25T04:44:31.138904+0000","last_became_active":"2023-08-25T04:43:37.192427+0000","last_became_peered":"2023-08-25T04:43:37.192427+0000","last_unstale":"2023-08-25T04:44:31.138904+0000","last_undegraded":"2023-08-25T04:44:31.138904+0000","last_fullsized":"2023-08-25T04:44:31.138904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:25:14.103104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478272+0000","last_change":"2023-08-25T04:43:41.883960+0000","last_active":"2023-08-25T04:44:30.478272+0000","last_peered":"2023-08-25T04:44:30.478272+0000","last_clean":"2023-08-25T04:44:30.478272+0000","last_became_active":"2023-08-25T04:43:41.883621+0000","last_became_peered":"2023-08-25T04:43:41.883621+0000","last_unstale":"2023-08-25T04:44:30.478272+0000","last_undegraded":"2023-08-25T04:44:30.478272+0000","last_fullsized":"2023-08-25T04:44:30.478272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:37:55.965513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'267","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.955335+0000","last_change":"2023-08-25T04:43:42.893639+0000","last_active":"2023-08-25T04:45:43.955335+0000","last_peered":"2023-08-25T04:45:43.955335+0000","last_clean":"2023-08-25T04:45:43.955335+0000","last_became_active":"2023-08-25T04:43:42.893333+0000","last_became_peered":"2023-08-25T04:43:42.893333+0000","last_unstale":"2023-08-25T04:45:43.955335+0000","last_undegraded":"2023-08-25T04:45:43.955335+0000","last_fullsized":"2023-08-25T04:45:43.955335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:37.784121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475519+0000","last_change":"2023-08-25T04:43:37.192780+0000","last_active":"2023-08-25T04:44:30.475519+0000","last_peered":"2023-08-25T04:44:30.475519+0000","last_clean":"2023-08-25T04:44:30.475519+0000","last_became_active":"2023-08-25T04:43:37.192432+0000","last_became_peered":"2023-08-25T04:43:37.192432+0000","last_unstale":"2023-08-25T04:44:30.475519+0000","last_undegraded":"2023-08-25T04:44:30.475519+0000","last_fullsized":"2023-08-25T04:44:30.475519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:00.352042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282455+0000","last_change":"2023-08-25T04:43:41.889966+0000","last_active":"2023-08-25T04:44:31.282455+0000","last_peered":"2023-08-25T04:44:31.282455+0000","last_clean":"2023-08-25T04:44:31.282455+0000","last_became_active":"2023-08-25T04:43:41.889717+0000","last_became_peered":"2023-08-25T04:43:41.889717+0000","last_unstale":"2023-08-25T04:44:31.282455+0000","last_undegraded":"2023-08-25T04:44:31.282455+0000","last_fullsized":"2023-08-25T04:44:31.282455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:46:39.529025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"23'260","reported_seq":275,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.950517+0000","last_change":"2023-08-25T04:43:42.885970+0000","last_active":"2023-08-25T04:45:43.950517+0000","last_peered":"2023-08-25T04:45:43.950517+0000","last_clean":"2023-08-25T04:45:43.950517+0000","last_became_active":"2023-08-25T04:43:42.885671+0000","last_became_peered":"2023-08-25T04:43:42.885671+0000","last_unstale":"2023-08-25T04:45:43.950517+0000","last_undegraded":"2023-08-25T04:45:43.950517+0000","last_fullsized":"2023-08-25T04:45:43.950517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:20.889807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500828+0000","last_change":"2023-08-25T04:43:37.192768+0000","last_active":"2023-08-25T04:44:31.500828+0000","last_peered":"2023-08-25T04:44:31.500828+0000","last_clean":"2023-08-25T04:44:31.500828+0000","last_became_active":"2023-08-25T04:43:37.192429+0000","last_became_peered":"2023-08-25T04:43:37.192429+0000","last_unstale":"2023-08-25T04:44:31.500828+0000","last_undegraded":"2023-08-25T04:44:31.500828+0000","last_fullsized":"2023-08-25T04:44:31.500828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:26.497020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:36.180533+0000","last_change":"2023-08-25T04:43:41.888493+0000","last_active":"2023-08-25T04:45:36.180533+0000","last_peered":"2023-08-25T04:45:36.180533+0000","last_clean":"2023-08-25T04:45:36.180533+0000","last_became_active":"2023-08-25T04:43:41.888207+0000","last_became_peered":"2023-08-25T04:43:41.888207+0000","last_unstale":"2023-08-25T04:45:36.180533+0000","last_undegraded":"2023-08-25T04:45:36.180533+0000","last_fullsized":"2023-08-25T04:45:36.180533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:11.200999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'310","reported_seq":325,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.067670+0000","last_change":"2023-08-25T04:43:42.900866+0000","last_active":"2023-08-25T04:45:44.067670+0000","last_peered":"2023-08-25T04:45:44.067670+0000","last_clean":"2023-08-25T04:45:44.067670+0000","last_became_active":"2023-08-25T04:43:42.900470+0000","last_became_peered":"2023-08-25T04:43:42.900470+0000","last_unstale":"2023-08-25T04:45:44.067670+0000","last_undegraded":"2023-08-25T04:45:44.067670+0000","last_fullsized":"2023-08-25T04:45:44.067670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:04:31.758204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500882+0000","last_change":"2023-08-25T04:43:36.785280+0000","last_active":"2023-08-25T04:44:31.500882+0000","last_peered":"2023-08-25T04:44:31.500882+0000","last_clean":"2023-08-25T04:44:31.500882+0000","last_became_active":"2023-08-25T04:43:36.784943+0000","last_became_peered":"2023-08-25T04:43:36.784943+0000","last_unstale":"2023-08-25T04:44:31.500882+0000","last_undegraded":"2023-08-25T04:44:31.500882+0000","last_fullsized":"2023-08-25T04:44:31.500882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.996393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.476180+0000","last_change":"2023-08-25T04:43:41.884839+0000","last_active":"2023-08-25T04:44:30.476180+0000","last_peered":"2023-08-25T04:44:30.476180+0000","last_clean":"2023-08-25T04:44:30.476180+0000","last_became_active":"2023-08-25T04:43:41.884535+0000","last_became_peered":"2023-08-25T04:43:41.884535+0000","last_unstale":"2023-08-25T04:44:30.476180+0000","last_undegraded":"2023-08-25T04:44:30.476180+0000","last_fullsized":"2023-08-25T04:44:30.476180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:57:40.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"23'272","reported_seq":287,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.948309+0000","last_change":"2023-08-25T04:43:42.903007+0000","last_active":"2023-08-25T04:45:43.948309+0000","last_peered":"2023-08-25T04:45:43.948309+0000","last_clean":"2023-08-25T04:45:43.948309+0000","last_became_active":"2023-08-25T04:43:42.902721+0000","last_became_peered":"2023-08-25T04:43:42.902721+0000","last_unstale":"2023-08-25T04:45:43.948309+0000","last_undegraded":"2023-08-25T04:45:43.948309+0000","last_fullsized":"2023-08-25T04:45:43.948309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:06.444491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.817827+0000","last_change":"2023-08-25T04:43:41.889969+0000","last_active":"2023-08-25T04:44:30.817827+0000","last_peered":"2023-08-25T04:44:30.817827+0000","last_clean":"2023-08-25T04:44:30.817827+0000","last_became_active":"2023-08-25T04:43:41.889659+0000","last_became_peered":"2023-08-25T04:43:41.889659+0000","last_unstale":"2023-08-25T04:44:30.817827+0000","last_undegraded":"2023-08-25T04:44:30.817827+0000","last_fullsized":"2023-08-25T04:44:30.817827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:03.981683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'274","reported_seq":289,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.948984+0000","last_change":"2023-08-25T04:43:42.894953+0000","last_active":"2023-08-25T04:45:43.948984+0000","last_peered":"2023-08-25T04:45:43.948984+0000","last_clean":"2023-08-25T04:45:43.948984+0000","last_became_active":"2023-08-25T04:43:42.894618+0000","last_became_peered":"2023-08-25T04:43:42.894618+0000","last_unstale":"2023-08-25T04:45:43.948984+0000","last_undegraded":"2023-08-25T04:45:43.948984+0000","last_fullsized":"2023-08-25T04:45:43.948984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:01.444718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475832+0000","last_change":"2023-08-25T04:43:41.886470+0000","last_active":"2023-08-25T04:44:30.475832+0000","last_peered":"2023-08-25T04:44:30.475832+0000","last_clean":"2023-08-25T04:44:30.475832+0000","last_became_active":"2023-08-25T04:43:41.886063+0000","last_became_peered":"2023-08-25T04:43:41.886063+0000","last_unstale":"2023-08-25T04:44:30.475832+0000","last_undegraded":"2023-08-25T04:44:30.475832+0000","last_fullsized":"2023-08-25T04:44:30.475832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:33.855942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'263","reported_seq":278,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.952687+0000","last_change":"2023-08-25T04:43:42.900475+0000","last_active":"2023-08-25T04:45:43.952687+0000","last_peered":"2023-08-25T04:45:43.952687+0000","last_clean":"2023-08-25T04:45:43.952687+0000","last_became_active":"2023-08-25T04:43:42.900135+0000","last_became_peered":"2023-08-25T04:43:42.900135+0000","last_unstale":"2023-08-25T04:45:43.952687+0000","last_undegraded":"2023-08-25T04:45:43.952687+0000","last_fullsized":"2023-08-25T04:45:43.952687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:38.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.476228+0000","last_change":"2023-08-25T04:43:41.891609+0000","last_active":"2023-08-25T04:44:30.476228+0000","last_peered":"2023-08-25T04:44:30.476228+0000","last_clean":"2023-08-25T04:44:30.476228+0000","last_became_active":"2023-08-25T04:43:41.891306+0000","last_became_peered":"2023-08-25T04:43:41.891306+0000","last_unstale":"2023-08-25T04:44:30.476228+0000","last_undegraded":"2023-08-25T04:44:30.476228+0000","last_fullsized":"2023-08-25T04:44:30.476228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:03.981683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'257","reported_seq":272,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.953493+0000","last_change":"2023-08-25T04:43:42.894647+0000","last_active":"2023-08-25T04:45:43.953493+0000","last_peered":"2023-08-25T04:45:43.953493+0000","last_clean":"2023-08-25T04:45:43.953493+0000","last_became_active":"2023-08-25T04:43:42.894386+0000","last_became_peered":"2023-08-25T04:43:42.894386+0000","last_unstale":"2023-08-25T04:45:43.953493+0000","last_undegraded":"2023-08-25T04:45:43.953493+0000","last_fullsized":"2023-08-25T04:45:43.953493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:41:20.742718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478873+0000","last_change":"2023-08-25T04:43:41.893331+0000","last_active":"2023-08-25T04:44:30.478873+0000","last_peered":"2023-08-25T04:44:30.478873+0000","last_clean":"2023-08-25T04:44:30.478873+0000","last_became_active":"2023-08-25T04:43:41.892929+0000","last_became_peered":"2023-08-25T04:43:41.892929+0000","last_unstale":"2023-08-25T04:44:30.478873+0000","last_undegraded":"2023-08-25T04:44:30.478873+0000","last_fullsized":"2023-08-25T04:44:30.478873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:58:44.113433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'252","reported_seq":267,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.948860+0000","last_change":"2023-08-25T04:43:42.894553+0000","last_active":"2023-08-25T04:45:43.948860+0000","last_peered":"2023-08-25T04:45:43.948860+0000","last_clean":"2023-08-25T04:45:43.948860+0000","last_became_active":"2023-08-25T04:43:42.894239+0000","last_became_peered":"2023-08-25T04:43:42.894239+0000","last_unstale":"2023-08-25T04:45:43.948860+0000","last_undegraded":"2023-08-25T04:45:43.948860+0000","last_fullsized":"2023-08-25T04:45:43.948860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:43.717551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.817799+0000","last_change":"2023-08-25T04:43:41.883254+0000","last_active":"2023-08-25T04:44:30.817799+0000","last_peered":"2023-08-25T04:44:30.817799+0000","last_clean":"2023-08-25T04:44:30.817799+0000","last_became_active":"2023-08-25T04:43:41.882756+0000","last_became_peered":"2023-08-25T04:43:41.882756+0000","last_unstale":"2023-08-25T04:44:30.817799+0000","last_undegraded":"2023-08-25T04:44:30.817799+0000","last_fullsized":"2023-08-25T04:44:30.817799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:57:40.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'285","reported_seq":300,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.953917+0000","last_change":"2023-08-25T04:43:42.895154+0000","last_active":"2023-08-25T04:45:43.953917+0000","last_peered":"2023-08-25T04:45:43.953917+0000","last_clean":"2023-08-25T04:45:43.953917+0000","last_became_active":"2023-08-25T04:43:42.894912+0000","last_became_peered":"2023-08-25T04:43:42.894912+0000","last_unstale":"2023-08-25T04:45:43.953917+0000","last_undegraded":"2023-08-25T04:45:43.953917+0000","last_fullsized":"2023-08-25T04:45:43.953917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:53.893508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"23'260","reported_seq":275,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947078+0000","last_change":"2023-08-25T04:43:42.893541+0000","last_active":"2023-08-25T04:45:43.947078+0000","last_peered":"2023-08-25T04:45:43.947078+0000","last_clean":"2023-08-25T04:45:43.947078+0000","last_became_active":"2023-08-25T04:43:42.893255+0000","last_became_peered":"2023-08-25T04:43:42.893255+0000","last_unstale":"2023-08-25T04:45:43.947078+0000","last_undegraded":"2023-08-25T04:45:43.947078+0000","last_fullsized":"2023-08-25T04:45:43.947078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:43:44.192741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"23'306","reported_seq":321,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.087688+0000","last_change":"2023-08-25T04:43:42.897868+0000","last_active":"2023-08-25T04:45:44.087688+0000","last_peered":"2023-08-25T04:45:44.087688+0000","last_clean":"2023-08-25T04:45:44.087688+0000","last_became_active":"2023-08-25T04:43:42.897394+0000","last_became_peered":"2023-08-25T04:43:42.897394+0000","last_unstale":"2023-08-25T04:45:44.087688+0000","last_undegraded":"2023-08-25T04:45:44.087688+0000","last_fullsized":"2023-08-25T04:45:44.087688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:21:25.098181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'286","reported_seq":301,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.946337+0000","last_change":"2023-08-25T04:43:42.894698+0000","last_active":"2023-08-25T04:45:43.946337+0000","last_peered":"2023-08-25T04:45:43.946337+0000","last_clean":"2023-08-25T04:45:43.946337+0000","last_became_active":"2023-08-25T04:43:42.894176+0000","last_became_peered":"2023-08-25T04:43:42.894176+0000","last_unstale":"2023-08-25T04:45:43.946337+0000","last_undegraded":"2023-08-25T04:45:43.946337+0000","last_fullsized":"2023-08-25T04:45:43.946337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:57:17.411245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"23'256","reported_seq":271,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.076659+0000","last_change":"2023-08-25T04:43:42.899435+0000","last_active":"2023-08-25T04:45:44.076659+0000","last_peered":"2023-08-25T04:45:44.076659+0000","last_clean":"2023-08-25T04:45:44.076659+0000","last_became_active":"2023-08-25T04:43:42.898842+0000","last_became_peered":"2023-08-25T04:43:42.898842+0000","last_unstale":"2023-08-25T04:45:44.076659+0000","last_undegraded":"2023-08-25T04:45:44.076659+0000","last_fullsized":"2023-08-25T04:45:44.076659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:16.308912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'267","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.942433+0000","last_change":"2023-08-25T04:43:42.890136+0000","last_active":"2023-08-25T04:45:43.942433+0000","last_peered":"2023-08-25T04:45:43.942433+0000","last_clean":"2023-08-25T04:45:43.942433+0000","last_became_active":"2023-08-25T04:43:42.889849+0000","last_became_peered":"2023-08-25T04:43:42.889849+0000","last_unstale":"2023-08-25T04:45:43.942433+0000","last_undegraded":"2023-08-25T04:45:43.942433+0000","last_fullsized":"2023-08-25T04:45:43.942433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:42:41.840740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":524,"num_write_kb":1101824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16961,"ondisk_log_size":16961,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1404507,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":416,"num_write_kb":1650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2867200,"data_stored":2809014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":419,"ondisk_log_size":419,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66276,"kb_used_data":26780,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94305564,"statfs":{"total":96636764160,"available":96568897536,"internally_reserved":0,"allocated":27422720,"data_stored":27244716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.9349999999999996,"5min":1.8160000000000001,"15min":0.96299999999999997},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":18.02,"5min":18.02,"15min":18.02},"last":0.29399999999999998},{"interface":"front","average":{"1min":7.6100000000000003,"5min":1.954,"15min":1.012},"min":{"1min":0.48299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":22.920999999999999,"5min":22.920999999999999,"15min":22.920999999999999},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.5759999999999996,"5min":2.0209999999999999,"15min":1.095},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":21.199999999999999,"5min":21.199999999999999,"15min":21.199999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":7.585,"5min":1.968,"15min":1.032},"min":{"1min":0.46600000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":22.437999999999999,"5min":22.437999999999999,"15min":22.437999999999999},"last":0.57899999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.3620000000000001,"5min":1.806,"15min":1.0469999999999999},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":17.844000000000001,"5min":17.844000000000001,"15min":17.844000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":7.2610000000000001,"5min":2.0910000000000002,"15min":1.2290000000000001},"min":{"1min":0.42699999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":19.690999999999999,"5min":19.690999999999999,"15min":19.690999999999999},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.7789999999999999,"5min":1.823,"15min":0.997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":17.731000000000002,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":7.0229999999999997,"5min":2.0950000000000002,"15min":1.2729999999999999},"min":{"1min":0.45700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":21.143999999999998,"5min":21.143999999999998,"15min":21.143999999999998},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":5.4710000000000001,"5min":1.4690000000000001,"15min":0.80200000000000005},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":22.465,"5min":22.465,"15min":22.465},"last":0.42599999999999999},{"interface":"front","average":{"1min":4.8609999999999998,"5min":1.373,"15min":0.79100000000000004},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":14.042999999999999,"5min":14.042999999999999,"15min":14.042999999999999},"last":0.36199999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":3.9830000000000001,"5min":1.238,"15min":0.78000000000000003},"min":{"1min":0.33600000000000002,"5min":0.307,"15min":0.307},"max":{"1min":14.117000000000001,"5min":14.117000000000001,"15min":14.117000000000001},"last":0.378},{"interface":"front","average":{"1min":5.8049999999999997,"5min":1.617,"15min":0.91900000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":22.334,"5min":22.334,"15min":22.334},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.8259999999999996,"5min":2.0169999999999999,"15min":1.0489999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":22.385000000000002,"5min":22.385000000000002,"15min":22.385000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":3.907,"5min":1.2529999999999999,"15min":0.81100000000000005},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":17.623000000000001,"5min":17.623000000000001,"15min":17.623000000000001},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56116,"kb_used_data":16620,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315724,"statfs":{"total":96636764160,"available":96579301376,"internally_reserved":0,"allocated":17018880,"data_stored":16869087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":6.2830000000000004,"5min":1.708,"15min":0.94599999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":21.954999999999998,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.97199999999999998},{"interface":"front","average":{"1min":6.2729999999999997,"5min":1.7330000000000001,"15min":0.97699999999999998},"min":{"1min":0.35599999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":21.109000000000002,"5min":21.109000000000002,"15min":21.109000000000002},"last":1.171}]},{"osd":1,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.7000000000000002,"5min":1.7889999999999999,"15min":1.304},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":16.664999999999999,"5min":16.664999999999999,"15min":16.664999999999999},"last":1.149},{"interface":"front","average":{"1min":5.1100000000000003,"5min":1.6619999999999999,"15min":1.0880000000000001},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":22.042000000000002,"5min":22.042000000000002,"15min":22.042000000000002},"last":0.373}]},{"osd":2,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.75,"5min":1.827,"15min":1.3400000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":19.658000000000001,"5min":19.658000000000001,"15min":19.658000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":4.891,"5min":1.4790000000000001,"15min":0.91000000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":21.138999999999999,"5min":21.138999999999999,"15min":21.138999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":6.1159999999999997,"5min":1.7210000000000001,"15min":0.98899999999999999},"min":{"1min":0.39200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":21.971,"5min":21.971,"15min":21.971},"last":0.39200000000000002},{"interface":"front","average":{"1min":6.274,"5min":2.1110000000000002,"15min":1.417},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":23.931000000000001,"5min":23.931000000000001,"15min":23.931000000000001},"last":1.107}]},{"osd":4,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.468,"5min":1.302,"15min":0.77400000000000002},"min":{"1min":0.29399999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":14.532999999999999,"5min":14.532999999999999,"15min":14.532999999999999},"last":1.29},{"interface":"front","average":{"1min":4.1900000000000004,"5min":1.27,"15min":0.78300000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":21.081,"5min":21.081,"15min":21.081},"last":0.317}]},{"osd":5,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":2.5649999999999999,"5min":0.94599999999999995,"15min":0.67600000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":12.946,"5min":12.946,"15min":12.946},"last":0.92900000000000005},{"interface":"front","average":{"1min":2.6429999999999998,"5min":0.97999999999999998,"15min":0.70299999999999996},"min":{"1min":0.35199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":19.597000000000001,"5min":19.597000000000001,"15min":19.597000000000001},"last":0.40699999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":2.633,"5min":1.006,"15min":0.73499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.266999999999999,"5min":11.266999999999999,"15min":11.266999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":4.2560000000000002,"5min":1.3320000000000001,"15min":0.84499999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":16.693000000000001,"5min":16.693000000000001,"15min":16.693000000000001},"last":1.0529999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76984,"kb_used_data":49968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94294856,"statfs":{"total":96636764160,"available":96557932544,"internally_reserved":0,"allocated":51167232,"data_stored":51013887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.7160000000000002,"5min":1.427,"15min":0.71199999999999997},"min":{"1min":0.245,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":23.989999999999998,"5min":23.989999999999998,"15min":23.989999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":5.024,"5min":1.3009999999999999,"15min":0.68100000000000005},"min":{"1min":0.255,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":15.622,"5min":15.622,"15min":15.622},"last":0.28899999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.6580000000000004,"5min":1.4430000000000001,"15min":0.74099999999999999},"min":{"1min":0.29899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":23.954000000000001,"5min":23.954000000000001,"15min":23.954000000000001},"last":0.311},{"interface":"front","average":{"1min":5.4690000000000003,"5min":1.4530000000000001,"15min":0.78400000000000003},"min":{"1min":0.34499999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":20.946000000000002,"5min":20.946000000000002,"15min":20.946000000000002},"last":0.33900000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.2939999999999996,"5min":1.4059999999999999,"15min":0.75800000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":27.884,"5min":27.884,"15min":27.884},"last":0.375},{"interface":"front","average":{"1min":5.6310000000000002,"5min":1.4450000000000001,"15min":0.747},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":23.018000000000001,"5min":23.018000000000001,"15min":23.018000000000001},"last":0.45300000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.2439999999999998,"5min":1.952,"15min":1.0700000000000001},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":24.044,"5min":24.044,"15min":24.044},"last":0.38900000000000001},{"interface":"front","average":{"1min":7.9050000000000002,"5min":2.0840000000000001,"15min":1.1140000000000001},"min":{"1min":0.501,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":27.940000000000001,"5min":27.940000000000001,"15min":27.940000000000001},"last":0.437}]},{"osd":5,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":8.516,"5min":2.2000000000000002,"15min":1.147},"min":{"1min":0.44,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":26.969999999999999,"5min":26.969999999999999,"15min":26.969999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":7.0430000000000001,"5min":1.923,"15min":1.0700000000000001},"min":{"1min":0.42399999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":24.018000000000001,"5min":24.018000000000001,"15min":24.018000000000001},"last":0.35599999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.899,"5min":2.0950000000000002,"15min":1.127},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":22.899999999999999,"5min":22.899999999999999,"15min":22.899999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":7.0890000000000004,"5min":1.9550000000000001,"15min":1.099},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":23.898,"5min":23.898,"15min":23.898},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.718,"5min":2.0779999999999998,"15min":1.1379999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":21.010999999999999,"5min":21.010999999999999,"15min":21.010999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":6.2210000000000001,"5min":1.7669999999999999,"15min":1.0249999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":23.053999999999998,"5min":23.053999999999998,"15min":23.053999999999998},"last":0.52800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122684,"kb_used_data":83188,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94249156,"statfs":{"total":96636764160,"available":96511135744,"internally_reserved":0,"allocated":85184512,"data_stored":85032814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":3.8849999999999998,"5min":1.0649999999999999,"15min":0.59499999999999997},"min":{"1min":0.32800000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":19.956,"5min":19.956,"15min":19.956},"last":0.218},{"interface":"front","average":{"1min":4.4450000000000003,"5min":1.2150000000000001,"15min":0.67700000000000005},"min":{"1min":0.29599999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":14.029999999999999,"5min":14.029999999999999,"15min":14.029999999999999},"last":0.27300000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":6.3410000000000002,"5min":1.627,"15min":0.84099999999999997},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":22.942,"5min":22.942,"15min":22.942},"last":0.33100000000000002},{"interface":"front","average":{"1min":2.7879999999999998,"5min":0.87,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.016,"5min":11.016,"15min":11.016},"last":0.25600000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":4.9039999999999999,"5min":1.3069999999999999,"15min":0.70699999999999996},"min":{"1min":0.35899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":19.997,"5min":19.997,"15min":19.997},"last":0.40500000000000003},{"interface":"front","average":{"1min":5.9139999999999997,"5min":1.522,"15min":0.79000000000000004},"min":{"1min":0.40400000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":17.045999999999999,"5min":17.045999999999999,"15min":17.045999999999999},"last":0.36199999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":4.484,"5min":1.786,"15min":1.3360000000000001},"min":{"1min":0.49199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":21.001000000000001,"5min":21.001000000000001,"15min":21.001000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":8.2750000000000004,"5min":2.1640000000000001,"15min":1.1459999999999999},"min":{"1min":0.46400000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.379}]},{"osd":5,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":9.8439999999999994,"5min":2.4820000000000002,"15min":1.2549999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":23.93,"5min":23.93,"15min":23.93},"last":0.51600000000000001},{"interface":"front","average":{"1min":6.6479999999999997,"5min":1.8500000000000001,"15min":1.05},"min":{"1min":0.51600000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":17.010000000000002,"5min":17.010000000000002,"15min":17.010000000000002},"last":0.44900000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":7.6139999999999999,"5min":2.0379999999999998,"15min":1.109},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":27.701000000000001,"5min":27.701000000000001,"15min":27.701000000000001},"last":0.498},{"interface":"front","average":{"1min":4.758,"5min":1.5029999999999999,"15min":0.96099999999999997},"min":{"1min":0.62,"5min":0.443,"15min":0.443},"max":{"1min":20.942,"5min":20.942,"15min":20.942},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":5.657,"5min":1.6879999999999999,"15min":1.026},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":21.030999999999999,"5min":21.030999999999999,"15min":21.030999999999999},"last":0.433},{"interface":"front","average":{"1min":7.9189999999999996,"5min":2.125,"15min":1.159},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":20.902999999999999,"5min":20.902999999999999,"15min":20.902999999999999},"last":0.47099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56116,"kb_used_data":16620,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315724,"statfs":{"total":96636764160,"available":96579301376,"internally_reserved":0,"allocated":17018880,"data_stored":16869087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":4.1100000000000003,"5min":1.1180000000000001,"15min":0.61899999999999999},"min":{"1min":0.33900000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":18.98,"5min":18.98,"15min":18.98},"last":0.36199999999999999},{"interface":"front","average":{"1min":4.9240000000000004,"5min":1.302,"15min":0.69799999999999995},"min":{"1min":0.27300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":20.966999999999999,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.32700000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":3.899,"5min":1.127,"15min":0.66500000000000004},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":20.995999999999999,"5min":20.995999999999999,"15min":20.995999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":3.6629999999999998,"5min":1.0680000000000001,"15min":0.63600000000000001},"min":{"1min":0.34499999999999997,"5min":0.307,"15min":0.307},"max":{"1min":12.052,"5min":12.052,"15min":12.052},"last":0.30599999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.0149999999999997,"5min":1.341,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":19.925999999999998,"5min":19.925999999999998,"15min":19.925999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":4.4059999999999997,"5min":1.2589999999999999,"15min":0.73499999999999999},"min":{"1min":0.373,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":20.916,"5min":20.916,"15min":20.916},"last":0.379}]},{"osd":4,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.2930000000000001,"5min":1.982,"15min":1.097},"min":{"1min":0.46600000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":19.940999999999999,"5min":19.940999999999999,"15min":19.940999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":8.3059999999999992,"5min":2.1480000000000001,"15min":1.1220000000000001},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":22.038,"5min":22.038,"15min":22.038},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":6.3300000000000001,"5min":1.8140000000000001,"15min":1.0609999999999999},"min":{"1min":0.59499999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":19.98,"5min":19.98,"15min":19.98},"last":0.53400000000000003},{"interface":"front","average":{"1min":7.8689999999999998,"5min":2.0790000000000002,"15min":1.1140000000000001},"min":{"1min":0.53500000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":21.050999999999998,"5min":21.050999999999998,"15min":21.050999999999998},"last":0.504}]},{"osd":6,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.3419999999999996,"5min":1.9910000000000001,"15min":1.099},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":22.021999999999998,"5min":22.021999999999998,"15min":22.021999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":6.9569999999999999,"5min":1.921,"15min":1.0820000000000001},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.498},"max":{"1min":19.007999999999999,"5min":19.007999999999999,"15min":19.007999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":6.8129999999999997,"5min":1.885,"15min":1.0640000000000001},"min":{"1min":0.49199999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":21.023,"5min":21.023,"15min":21.023},"last":0.61499999999999999},{"interface":"front","average":{"1min":9.3469999999999995,"5min":2.411,"15min":1.2549999999999999},"min":{"1min":0.498,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":28.928000000000001,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.57599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110200,"kb_used_data":83184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94261640,"statfs":{"total":96636764160,"available":96523919360,"internally_reserved":0,"allocated":85180416,"data_stored":85026617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.6289999999999996,"5min":1.266,"15min":0.70599999999999996},"min":{"1min":0.28399999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":23.542000000000002,"5min":23.542000000000002,"15min":23.542000000000002},"last":0.28799999999999998},{"interface":"front","average":{"1min":4.4550000000000001,"5min":1.2949999999999999,"15min":0.76800000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":20.547000000000001,"5min":20.547000000000001,"15min":20.547000000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.3869999999999996,"5min":1.2709999999999999,"15min":0.752},"min":{"1min":0.31900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":18.984999999999999,"5min":18.984999999999999,"15min":18.984999999999999},"last":0.371},{"interface":"front","average":{"1min":4.9550000000000001,"5min":1.3380000000000001,"15min":0.73499999999999999},"min":{"1min":0.32300000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":20.052,"5min":20.052,"15min":20.052},"last":0.35699999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":5.7050000000000001,"5min":1.5329999999999999,"15min":0.83799999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":20.861000000000001,"5min":20.861000000000001,"15min":20.861000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":5.0060000000000002,"5min":1.405,"15min":0.80500000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":21.984000000000002,"5min":21.984000000000002,"15min":21.984000000000002},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.6619999999999999,"5min":2.1160000000000001,"15min":1.1919999999999999},"min":{"1min":0.40300000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":22.015999999999998,"5min":22.015999999999998,"15min":22.015999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":6.4500000000000002,"5min":1.8380000000000001,"15min":1.0700000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":20.934999999999999,"5min":20.934999999999999,"15min":20.934999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.859,"5min":1.9039999999999999,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":23.474,"5min":23.474,"15min":23.474},"last":0.58799999999999997},{"interface":"front","average":{"1min":7.242,"5min":2.069,"15min":1.2070000000000001},"min":{"1min":0.441,"5min":0.376,"15min":0.376},"max":{"1min":21.975999999999999,"5min":21.975999999999999,"15min":21.975999999999999},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.9580000000000002,"5min":2.1429999999999998,"15min":1.1739999999999999},"min":{"1min":0.45400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":20.898,"5min":20.898,"15min":20.898},"last":0.60299999999999998},{"interface":"front","average":{"1min":6.3879999999999999,"5min":1.8169999999999999,"15min":1.0549999999999999},"min":{"1min":0.48799999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":23.513000000000002,"5min":23.513000000000002,"15min":23.513000000000002},"last":0.46200000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.843,"5min":2.2029999999999998,"15min":1.2629999999999999},"min":{"1min":0.432,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":22.039999999999999,"5min":22.039999999999999,"15min":22.039999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":7.2370000000000001,"5min":2.0449999999999999,"15min":1.179},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.905000000000001,"5min":20.905000000000001,"15min":20.905000000000001},"last":0.63200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53216,"kb_used_data":26200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94318624,"statfs":{"total":96636764160,"available":96582270976,"internally_reserved":0,"allocated":26828800,"data_stored":26661460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.2069999999999999,"5min":1.657,"15min":0.89900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":17.920000000000002,"5min":17.920000000000002,"15min":17.920000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":6.46,"5min":1.7130000000000001,"15min":0.92200000000000004},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":20.904,"5min":20.904,"15min":20.904},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.3390000000000004,"5min":1.7170000000000001,"15min":0.94699999999999995},"min":{"1min":0.503,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":23.911000000000001,"5min":23.911000000000001,"15min":23.911000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":6.5750000000000002,"5min":1.756,"15min":0.95299999999999996},"min":{"1min":0.375,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":21.952999999999999,"5min":21.952999999999999,"15min":21.952999999999999},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.9210000000000003,"5min":1.833,"15min":0.98499999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":21.847999999999999,"5min":21.847999999999999,"15min":21.847999999999999},"last":0.502},{"interface":"front","average":{"1min":8.0950000000000006,"5min":2.0750000000000002,"15min":1.0720000000000001},"min":{"1min":0.504,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":33.182000000000002,"5min":33.182000000000002,"15min":33.182000000000002},"last":0.438}]},{"osd":3,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.1100000000000003,"5min":1.8660000000000001,"15min":0.99199999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":17.010999999999999,"5min":17.010999999999999,"15min":17.010999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":5.5220000000000002,"5min":1.575,"15min":0.91700000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":15.022,"5min":15.022,"15min":15.022},"last":0.44800000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":4.0679999999999996,"5min":1.1919999999999999,"15min":0.71299999999999997},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":5.1680000000000001,"5min":1.4570000000000001,"15min":0.83899999999999997},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":30.946999999999999,"5min":30.946999999999999,"15min":30.946999999999999},"last":0.34499999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":5.859,"5min":1.5800000000000001,"15min":0.86699999999999999},"min":{"1min":0.42399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":15.936999999999999,"5min":15.936999999999999,"15min":15.936999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":5.0999999999999996,"5min":1.464,"15min":0.85799999999999998},"min":{"1min":0.42399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":20.937000000000001,"5min":20.937000000000001,"15min":20.937000000000001},"last":0.371}]},{"osd":7,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":4.4710000000000001,"5min":1.339,"15min":0.81699999999999995},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":12.914,"5min":12.914,"15min":12.914},"last":0.31},{"interface":"front","average":{"1min":5.6820000000000004,"5min":1.6080000000000001,"15min":0.92900000000000005},"min":{"1min":0.48999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":15.045999999999999,"5min":15.045999999999999,"15min":15.045999999999999},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52028,"kb_used_data":12532,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319812,"statfs":{"total":96636764160,"available":96583487488,"internally_reserved":0,"allocated":12832768,"data_stored":12675435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.2850000000000001,"5min":1.877,"15min":0.97499999999999998},"min":{"1min":0.34699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":27.048999999999999,"5min":27.048999999999999,"15min":27.048999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":6.5140000000000002,"5min":1.7290000000000001,"15min":0.93100000000000005},"min":{"1min":0.40100000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":20.956,"5min":20.956,"15min":20.956},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.9500000000000002,"5min":1.8089999999999999,"15min":0.95199999999999996},"min":{"1min":0.307,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":20.923999999999999,"5min":20.923999999999999,"15min":20.923999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":6.6459999999999999,"5min":1.782,"15min":0.97199999999999998},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":24.927,"5min":24.927,"15min":24.927},"last":0.35799999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.6070000000000002,"5min":1.978,"15min":1.04},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":18.602,"5min":18.602,"15min":18.602},"last":0.48299999999999998},{"interface":"front","average":{"1min":6.1580000000000004,"5min":1.722,"15min":0.98199999999999998},"min":{"1min":0.42699999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":15.946999999999999,"5min":15.946999999999999,"15min":15.946999999999999},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.8200000000000003,"5min":2.008,"15min":1.0389999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":17.782,"5min":17.782,"15min":17.782},"last":0.57999999999999996},{"interface":"front","average":{"1min":7.7779999999999996,"5min":2.0699999999999998,"15min":1.119},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":27.077000000000002,"5min":27.077000000000002,"15min":27.077000000000002},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.1859999999999999,"5min":1.214,"15min":0.71799999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":19.172999999999998,"5min":19.172999999999998,"15min":19.172999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":5.2329999999999997,"5min":1.4810000000000001,"15min":0.85599999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.693999999999999,"5min":17.693999999999999,"15min":17.693999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.056,"5min":1.6140000000000001,"15min":0.874},"min":{"1min":0.33700000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":27.103000000000002,"5min":27.103000000000002,"15min":27.103000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":4.9829999999999997,"5min":1.4399999999999999,"15min":0.84999999999999998},"min":{"1min":0.35299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":22.154,"5min":22.154,"15min":22.154},"last":0.51700000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.0890000000000004,"5min":1.2849999999999999,"15min":0.81799999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":19.253,"5min":19.253,"15min":19.253},"last":0.46700000000000003},{"interface":"front","average":{"1min":4.0060000000000002,"5min":1.238,"15min":0.77700000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":27.001000000000001,"5min":27.001000000000001,"15min":27.001000000000001},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":7854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1421312,"data_stored":1403765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1421312,"data_stored":1396653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50331648,"data_stored":50331648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37748736,"data_stored":37748736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:45:45.548 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-25T04:45:45.548 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:45:45.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.701+0000 7f1b6cdbd700 1 Processor -- start 2023-08-25T04:45:45.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.701+0000 7f1b6cdbd700 1 -- start start 2023-08-25T04:45:45.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.702+0000 7f1b6cdbd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1b6815d510 0x7f1b6806cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.702+0000 7f1b6cdbd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b680cf7c0 0x7f1b681611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.702+0000 7f1b6cdbd700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6806bac0 con 0x7f1b680cfc20 2023-08-25T04:45:45.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.702+0000 7f1b6cdbd700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6806c900 con 0x7f1b6815d510 2023-08-25T04:45:45.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.702+0000 7f1b6cdbd700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6806bcf0 con 0x7f1b680cf7c0 2023-08-25T04:45:45.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b66d9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1b680cfc20 0x7f1b680cb500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40686/0 (socket says 172.21.15.16:40686) 2023-08-25T04:45:45.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b66d9d700 1 -- 172.21.15.16:0/2703231671 learned_addr learned my addr 172.21.15.16:0/2703231671 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:45.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6659c700 1 --2- 172.21.15.16:0/2703231671 >> v2:172.21.15.117:3300/0 conn(0x7f1b6815d510 0x7f1b6806cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b65d9b700 1 --2- 172.21.15.16:0/2703231671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b680cf7c0 0x7f1b681611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 -- 172.21.15.16:0/2703231671 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993550084 0 0) 0x7f1b6806bac0 con 0x7f1b680cfc20 2023-08-25T04:45:45.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 -- 172.21.15.16:0/2703231671 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b540035b0 con 0x7f1b680cfc20 2023-08-25T04:45:45.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 -- 172.21.15.16:0/2703231671 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3570995814 0 0) 0x7f1b540035b0 con 0x7f1b680cfc20 2023-08-25T04:45:45.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 -- 172.21.15.16:0/2703231671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b680cf7c0 msgr2=0x7f1b681611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:45.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 --2- 172.21.15.16:0/2703231671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b680cf7c0 0x7f1b681611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 -- 172.21.15.16:0/2703231671 >> v2:172.21.15.117:3300/0 conn(0x7f1b6815d510 msgr2=0x7f1b6806cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:45.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 --2- 172.21.15.16:0/2703231671 >> v2:172.21.15.117:3300/0 conn(0x7f1b6815d510 0x7f1b6806cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 -- 172.21.15.16:0/2703231671 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6806bfd0 con 0x7f1b680cfc20 2023-08-25T04:45:45.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 -- 172.21.15.16:0/2703231671 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f1b600019f0 con 0x7f1b680cfc20 2023-08-25T04:45:45.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 -- 172.21.15.16:0/2703231671 >> v1:172.21.15.16:6789/0 conn(0x7f1b680cfc20 legacy=0x7f1b680cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:45.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 --2- 172.21.15.16:0/2703231671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b680cf7c0 0x7f1b54003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 --2- 172.21.15.16:0/2703231671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b54003ff0 0x7f1b54004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 --2- 172.21.15.16:0/2703231671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b54004d90 0x7f1b54005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 -- 172.21.15.16:0/2703231671 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6806c900 con 0x7f1b54003ff0 2023-08-25T04:45:45.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 -- 172.21.15.16:0/2703231671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6806bcf0 con 0x7f1b54004d90 2023-08-25T04:45:45.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6559a700 1 -- 172.21.15.16:0/2703231671 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5400ba40 con 0x7f1b680cf7c0 2023-08-25T04:45:45.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b65d9b700 1 --2- 172.21.15.16:0/2703231671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b54003ff0 0x7f1b54004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.703+0000 7f1b6659c700 1 --2- 172.21.15.16:0/2703231671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b680cf7c0 0x7f1b54003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.704+0000 7f1b66d9d700 1 --2- 172.21.15.16:0/2703231671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b54004d90 0x7f1b54005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.704+0000 7f1b65d9b700 1 -- 172.21.15.16:0/2703231671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b680cf7c0 msgr2=0x7f1b54003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:45.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.704+0000 7f1b65d9b700 1 --2- 172.21.15.16:0/2703231671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b680cf7c0 0x7f1b54003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.704+0000 7f1b65d9b700 1 -- 172.21.15.16:0/2703231671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b54004d90 msgr2=0x7f1b54005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:45.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.704+0000 7f1b65d9b700 1 --2- 172.21.15.16:0/2703231671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b54004d90 0x7f1b54005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.704+0000 7f1b65d9b700 1 -- 172.21.15.16:0/2703231671 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b540035b0 con 0x7f1b54003ff0 2023-08-25T04:45:45.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.704+0000 7f1b66d9d700 1 --2- 172.21.15.16:0/2703231671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b54004d90 0x7f1b54005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:45.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.704+0000 7f1b65d9b700 1 --2- 172.21.15.16:0/2703231671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b54003ff0 0x7f1b54004850 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009b60 tx=0x7f1b54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74368e7582d4088 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:45.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.704+0000 7f1b6559a700 1 -- 172.21.15.16:0/2703231671 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5000e6c0 con 0x7f1b54003ff0 2023-08-25T04:45:45.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.704+0000 7f1b6559a700 1 -- 172.21.15.16:0/2703231671 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5000e820 con 0x7f1b54003ff0 2023-08-25T04:45:45.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.704+0000 7f1b6559a700 1 -- 172.21.15.16:0/2703231671 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5000eb90 con 0x7f1b54003ff0 2023-08-25T04:45:45.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.704+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/2703231671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b54003ff0 msgr2=0x7f1b54004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:45.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.704+0000 7f1b6cdbd700 1 --2- 172.21.15.16:0/2703231671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b54003ff0 0x7f1b54004850 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009b60 tx=0x7f1b54005880 comp rx=0 tx=0).stop 2023-08-25T04:45:45.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.704+0000 7f1b66d9d700 1 -- 172.21.15.16:0/2703231671 reap_dead start 2023-08-25T04:45:45.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.705+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/2703231671 shutdown_connections 2023-08-25T04:45:45.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.705+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/2703231671 >> 172.21.15.16:0/2703231671 conn(0x7f1b6809a1e0 msgr2=0x7f1b680d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:45.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.705+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/2703231671 shutdown_connections 2023-08-25T04:45:45.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.705+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/2703231671 wait complete. 2023-08-25T04:45:45.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.706+0000 7f1b6cdbd700 1 Processor -- start 2023-08-25T04:45:45.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.706+0000 7f1b6cdbd700 1 -- start start 2023-08-25T04:45:45.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6cdbd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b54003ff0 0x7f1b681f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6cdbd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b6815d8f0 0x7f1b680b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6cdbd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b680c5260 0x7f1b6814df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6cdbd700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b681f3540 con 0x7f1b54003ff0 2023-08-25T04:45:45.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6cdbd700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b681f3820 con 0x7f1b6815d8f0 2023-08-25T04:45:45.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6cdbd700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b681f3b00 con 0x7f1b680c5260 2023-08-25T04:45:45.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6659c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b54003ff0 0x7f1b681f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6659c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b54003ff0 0x7f1b681f2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50280/0 (socket says 172.21.15.16:50280) 2023-08-25T04:45:45.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6659c700 1 -- 172.21.15.16:0/1252653649 learned_addr learned my addr 172.21.15.16:0/1252653649 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:45.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b65d9b700 1 --2- 172.21.15.16:0/1252653649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b6815d8f0 0x7f1b680b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b66d9d700 1 --2- 172.21.15.16:0/1252653649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b680c5260 0x7f1b6814df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6659c700 1 -- 172.21.15.16:0/1252653649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b680c5260 msgr2=0x7f1b6814df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:45.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6659c700 1 --2- 172.21.15.16:0/1252653649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b680c5260 0x7f1b6814df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6659c700 1 -- 172.21.15.16:0/1252653649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b6815d8f0 msgr2=0x7f1b680b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:45.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6659c700 1 --2- 172.21.15.16:0/1252653649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b6815d8f0 0x7f1b680b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6659c700 1 -- 172.21.15.16:0/1252653649 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b680c4a60 con 0x7f1b54003ff0 2023-08-25T04:45:45.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6659c700 1 --2- 172.21.15.16:0/1252653649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b54003ff0 0x7f1b681f2c50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1b58011aa0 tx=0x7f1b58011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:45.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b5effd700 1 -- 172.21.15.16:0/1252653649 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5800f9e0 con 0x7f1b54003ff0 2023-08-25T04:45:45.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b5effd700 1 -- 172.21.15.16:0/1252653649 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5800fb40 con 0x7f1b54003ff0 2023-08-25T04:45:45.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/1252653649 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b680c4d40 con 0x7f1b54003ff0 2023-08-25T04:45:45.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b5effd700 1 -- 172.21.15.16:0/1252653649 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58014440 con 0x7f1b54003ff0 2023-08-25T04:45:45.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.707+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/1252653649 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b680b2e40 con 0x7f1b54003ff0 2023-08-25T04:45:45.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.708+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/1252653649 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6804ee70 con 0x7f1b54003ff0 2023-08-25T04:45:45.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.709+0000 7f1b5effd700 1 -- 172.21.15.16:0/1252653649 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1b580145a0 con 0x7f1b54003ff0 2023-08-25T04:45:45.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.709+0000 7f1b5effd700 1 --2- 172.21.15.16:0/1252653649 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1b4806a0e0 0x7f1b4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:45.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.710+0000 7f1b5effd700 1 -- 172.21.15.16:0/1252653649 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1b58088e20 con 0x7f1b54003ff0 2023-08-25T04:45:45.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.710+0000 7f1b65d9b700 1 --2- 172.21.15.16:0/1252653649 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1b4806a0e0 0x7f1b4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:45.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.710+0000 7f1b65d9b700 1 --2- 172.21.15.16:0/1252653649 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1b4806a0e0 0x7f1b4806c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1b50000c00 tx=0x7f1b50008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:45.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.714+0000 7f1b5effd700 1 -- 172.21.15.16:0/1252653649 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1b58054430 con 0x7f1b54003ff0 2023-08-25T04:45:45.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.915+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/1252653649 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b6806c590 con 0x7f1b4806a0e0 2023-08-25T04:45:45.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.924+0000 7f1b5effd700 1 -- 172.21.15.16:0/1252653649 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311167 (secure 0 0 0) 0x7f1b5000e990 con 0x7f1b4806a0e0 2023-08-25T04:45:45.930 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:45:45.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.927+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/1252653649 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1b4806a0e0 msgr2=0x7f1b4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:45.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.927+0000 7f1b6cdbd700 1 --2- 172.21.15.16:0/1252653649 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1b4806a0e0 0x7f1b4806c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1b50000c00 tx=0x7f1b50008030 comp rx=0 tx=0).stop 2023-08-25T04:45:45.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.927+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/1252653649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b54003ff0 msgr2=0x7f1b681f2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:45.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.927+0000 7f1b6cdbd700 1 --2- 172.21.15.16:0/1252653649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b54003ff0 0x7f1b681f2c50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1b58011aa0 tx=0x7f1b58011e60 comp rx=0 tx=0).stop 2023-08-25T04:45:45.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.928+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/1252653649 shutdown_connections 2023-08-25T04:45:45.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.928+0000 7f1b6cdbd700 1 --2- 172.21.15.16:0/1252653649 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1b4806a0e0 0x7f1b4806c5a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.928+0000 7f1b6cdbd700 1 --2- 172.21.15.16:0/1252653649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b680c5260 0x7f1b6814df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.928+0000 7f1b6cdbd700 1 --2- 172.21.15.16:0/1252653649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b54003ff0 0x7f1b681f2c50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.928+0000 7f1b6cdbd700 1 --2- 172.21.15.16:0/1252653649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b6815d8f0 0x7f1b680b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:45.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.928+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/1252653649 >> 172.21.15.16:0/1252653649 conn(0x7f1b6809a1e0 msgr2=0x7f1b680b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:45.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.928+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/1252653649 shutdown_connections 2023-08-25T04:45:45.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:45.928+0000 7f1b6cdbd700 1 -- 172.21.15.16:0/1252653649 wait complete. 2023-08-25T04:45:45.936 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-08-25T04:45:45.941 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-08-25T04:45:45.405378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102658171,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":129,"num_read_kb":115,"num_write":1099,"num_write_kb":1105890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17497,"ondisk_log_size":17497,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":593620,"kb_used_data":315092,"kb_used_omap":13,"kb_used_meta":278450,"kb_avail":754381100,"statfs":{"total":773094113280,"available":772486246400,"internally_reserved":0,"allocated":322654208,"data_stored":321393103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":285132888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":62,"apply_latency_ms":62,"commit_latency_ns":62000000,"apply_latency_ns":62000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-116414874,"num_objects":-29,"num_object_clones":0,"num_object_copies":-58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-29,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":729,"num_write_kb":890020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002622"},"pg_stats":[{"pgid":"4.3f","version":"23'232","reported_seq":247,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.942176+0000","last_change":"2023-08-25T04:43:42.895145+0000","last_active":"2023-08-25T04:45:43.942176+0000","last_peered":"2023-08-25T04:45:43.942176+0000","last_clean":"2023-08-25T04:45:43.942176+0000","last_became_active":"2023-08-25T04:43:42.894831+0000","last_became_peered":"2023-08-25T04:43:42.894831+0000","last_unstale":"2023-08-25T04:45:43.942176+0000","last_undegraded":"2023-08-25T04:45:43.942176+0000","last_fullsized":"2023-08-25T04:45:43.942176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:16.917741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'220","reported_seq":235,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.950118+0000","last_change":"2023-08-25T04:43:42.895503+0000","last_active":"2023-08-25T04:45:43.950118+0000","last_peered":"2023-08-25T04:45:43.950118+0000","last_clean":"2023-08-25T04:45:43.950118+0000","last_became_active":"2023-08-25T04:43:42.895245+0000","last_became_peered":"2023-08-25T04:43:42.895245+0000","last_unstale":"2023-08-25T04:45:43.950118+0000","last_undegraded":"2023-08-25T04:45:43.950118+0000","last_fullsized":"2023-08-25T04:45:43.950118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:39:50.519838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"23'276","reported_seq":291,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.955588+0000","last_change":"2023-08-25T04:43:42.888920+0000","last_active":"2023-08-25T04:45:43.955588+0000","last_peered":"2023-08-25T04:45:43.955588+0000","last_clean":"2023-08-25T04:45:43.955588+0000","last_became_active":"2023-08-25T04:43:42.888568+0000","last_became_peered":"2023-08-25T04:43:42.888568+0000","last_unstale":"2023-08-25T04:45:43.955588+0000","last_undegraded":"2023-08-25T04:45:43.955588+0000","last_fullsized":"2023-08-25T04:45:43.955588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:55:39.359039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"23'253","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.950989+0000","last_change":"2023-08-25T04:43:42.893868+0000","last_active":"2023-08-25T04:45:43.950989+0000","last_peered":"2023-08-25T04:45:43.950989+0000","last_clean":"2023-08-25T04:45:43.950989+0000","last_became_active":"2023-08-25T04:43:42.893534+0000","last_became_peered":"2023-08-25T04:43:42.893534+0000","last_unstale":"2023-08-25T04:45:43.950989+0000","last_undegraded":"2023-08-25T04:45:43.950989+0000","last_fullsized":"2023-08-25T04:45:43.950989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:20.295263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"23'256","reported_seq":271,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.951061+0000","last_change":"2023-08-25T04:43:42.902297+0000","last_active":"2023-08-25T04:45:43.951061+0000","last_peered":"2023-08-25T04:45:43.951061+0000","last_clean":"2023-08-25T04:45:43.951061+0000","last_became_active":"2023-08-25T04:43:42.901963+0000","last_became_peered":"2023-08-25T04:43:42.901963+0000","last_unstale":"2023-08-25T04:45:43.951061+0000","last_undegraded":"2023-08-25T04:45:43.951061+0000","last_fullsized":"2023-08-25T04:45:43.951061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:30:27.322745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'278","reported_seq":293,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.954382+0000","last_change":"2023-08-25T04:43:42.888877+0000","last_active":"2023-08-25T04:45:43.954382+0000","last_peered":"2023-08-25T04:45:43.954382+0000","last_clean":"2023-08-25T04:45:43.954382+0000","last_became_active":"2023-08-25T04:43:42.888567+0000","last_became_peered":"2023-08-25T04:43:42.888567+0000","last_unstale":"2023-08-25T04:45:43.954382+0000","last_undegraded":"2023-08-25T04:45:43.954382+0000","last_fullsized":"2023-08-25T04:45:43.954382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:15:07.375032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"23'293","reported_seq":308,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.949275+0000","last_change":"2023-08-25T04:43:42.902469+0000","last_active":"2023-08-25T04:45:43.949275+0000","last_peered":"2023-08-25T04:45:43.949275+0000","last_clean":"2023-08-25T04:45:43.949275+0000","last_became_active":"2023-08-25T04:43:42.902156+0000","last_became_peered":"2023-08-25T04:43:42.902156+0000","last_unstale":"2023-08-25T04:45:43.949275+0000","last_undegraded":"2023-08-25T04:45:43.949275+0000","last_fullsized":"2023-08-25T04:45:43.949275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:59.175818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"23'270","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.074470+0000","last_change":"2023-08-25T04:43:42.895697+0000","last_active":"2023-08-25T04:45:44.074470+0000","last_peered":"2023-08-25T04:45:44.074470+0000","last_clean":"2023-08-25T04:45:44.074470+0000","last_became_active":"2023-08-25T04:43:42.895410+0000","last_became_peered":"2023-08-25T04:43:42.895410+0000","last_unstale":"2023-08-25T04:45:44.074470+0000","last_undegraded":"2023-08-25T04:45:44.074470+0000","last_fullsized":"2023-08-25T04:45:44.074470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:17:01.748486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"23'248","reported_seq":263,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947053+0000","last_change":"2023-08-25T04:43:42.897483+0000","last_active":"2023-08-25T04:45:43.947053+0000","last_peered":"2023-08-25T04:45:43.947053+0000","last_clean":"2023-08-25T04:45:43.947053+0000","last_became_active":"2023-08-25T04:43:42.896949+0000","last_became_peered":"2023-08-25T04:43:42.896949+0000","last_unstale":"2023-08-25T04:45:43.947053+0000","last_undegraded":"2023-08-25T04:45:43.947053+0000","last_fullsized":"2023-08-25T04:45:43.947053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:20.889807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'282","reported_seq":297,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.088318+0000","last_change":"2023-08-25T04:43:42.895115+0000","last_active":"2023-08-25T04:45:44.088318+0000","last_peered":"2023-08-25T04:45:44.088318+0000","last_clean":"2023-08-25T04:45:44.088318+0000","last_became_active":"2023-08-25T04:43:42.894786+0000","last_became_peered":"2023-08-25T04:43:42.894786+0000","last_unstale":"2023-08-25T04:45:44.088318+0000","last_undegraded":"2023-08-25T04:45:44.088318+0000","last_fullsized":"2023-08-25T04:45:44.088318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:04:31.758204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"23'244","reported_seq":259,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.955622+0000","last_change":"2023-08-25T04:43:42.892793+0000","last_active":"2023-08-25T04:45:43.955622+0000","last_peered":"2023-08-25T04:45:43.955622+0000","last_clean":"2023-08-25T04:45:43.955622+0000","last_became_active":"2023-08-25T04:43:42.892558+0000","last_became_peered":"2023-08-25T04:43:42.892558+0000","last_unstale":"2023-08-25T04:45:43.955622+0000","last_undegraded":"2023-08-25T04:45:43.955622+0000","last_fullsized":"2023-08-25T04:45:43.955622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:35:57.269293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"23'260","reported_seq":275,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.950039+0000","last_change":"2023-08-25T04:43:42.892113+0000","last_active":"2023-08-25T04:45:43.950039+0000","last_peered":"2023-08-25T04:45:43.950039+0000","last_clean":"2023-08-25T04:45:43.950039+0000","last_became_active":"2023-08-25T04:43:42.891782+0000","last_became_peered":"2023-08-25T04:43:42.891782+0000","last_unstale":"2023-08-25T04:45:43.950039+0000","last_undegraded":"2023-08-25T04:45:43.950039+0000","last_fullsized":"2023-08-25T04:45:43.950039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:15:53.162927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'253","reported_seq":268,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.937601+0000","last_change":"2023-08-25T04:43:42.896635+0000","last_active":"2023-08-25T04:45:43.937601+0000","last_peered":"2023-08-25T04:45:43.937601+0000","last_clean":"2023-08-25T04:45:43.937601+0000","last_became_active":"2023-08-25T04:43:42.896334+0000","last_became_peered":"2023-08-25T04:43:42.896334+0000","last_unstale":"2023-08-25T04:45:43.937601+0000","last_undegraded":"2023-08-25T04:45:43.937601+0000","last_fullsized":"2023-08-25T04:45:43.937601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:55:06.974267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'273","reported_seq":288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947016+0000","last_change":"2023-08-25T04:43:42.894765+0000","last_active":"2023-08-25T04:45:43.947016+0000","last_peered":"2023-08-25T04:45:43.947016+0000","last_clean":"2023-08-25T04:45:43.947016+0000","last_became_active":"2023-08-25T04:43:42.894472+0000","last_became_peered":"2023-08-25T04:43:42.894472+0000","last_unstale":"2023-08-25T04:45:43.947016+0000","last_undegraded":"2023-08-25T04:45:43.947016+0000","last_fullsized":"2023-08-25T04:45:43.947016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:30:27.322745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"23'267","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.948843+0000","last_change":"2023-08-25T04:43:42.902458+0000","last_active":"2023-08-25T04:45:43.948843+0000","last_peered":"2023-08-25T04:45:43.948843+0000","last_clean":"2023-08-25T04:45:43.948843+0000","last_became_active":"2023-08-25T04:43:42.902184+0000","last_became_peered":"2023-08-25T04:43:42.902184+0000","last_unstale":"2023-08-25T04:45:43.948843+0000","last_undegraded":"2023-08-25T04:45:43.948843+0000","last_fullsized":"2023-08-25T04:45:43.948843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:07.315621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"23'258","reported_seq":273,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.093285+0000","last_change":"2023-08-25T04:43:42.889087+0000","last_active":"2023-08-25T04:45:44.093285+0000","last_peered":"2023-08-25T04:45:44.093285+0000","last_clean":"2023-08-25T04:45:44.093285+0000","last_became_active":"2023-08-25T04:43:42.888730+0000","last_became_peered":"2023-08-25T04:43:42.888730+0000","last_unstale":"2023-08-25T04:45:44.093285+0000","last_undegraded":"2023-08-25T04:45:44.093285+0000","last_fullsized":"2023-08-25T04:45:44.093285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:56.162169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"23'266","reported_seq":281,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.097052+0000","last_change":"2023-08-25T04:43:42.898466+0000","last_active":"2023-08-25T04:45:44.097052+0000","last_peered":"2023-08-25T04:45:44.097052+0000","last_clean":"2023-08-25T04:45:44.097052+0000","last_became_active":"2023-08-25T04:43:42.898103+0000","last_became_peered":"2023-08-25T04:43:42.898103+0000","last_unstale":"2023-08-25T04:45:44.097052+0000","last_undegraded":"2023-08-25T04:45:44.097052+0000","last_fullsized":"2023-08-25T04:45:44.097052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:34.861062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'250","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947372+0000","last_change":"2023-08-25T04:43:42.892153+0000","last_active":"2023-08-25T04:45:43.947372+0000","last_peered":"2023-08-25T04:45:43.947372+0000","last_clean":"2023-08-25T04:45:43.947372+0000","last_became_active":"2023-08-25T04:43:42.891874+0000","last_became_peered":"2023-08-25T04:43:42.891874+0000","last_unstale":"2023-08-25T04:45:43.947372+0000","last_undegraded":"2023-08-25T04:45:43.947372+0000","last_fullsized":"2023-08-25T04:45:43.947372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:08:00.896369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"23'237","reported_seq":252,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.945354+0000","last_change":"2023-08-25T04:43:42.895594+0000","last_active":"2023-08-25T04:45:43.945354+0000","last_peered":"2023-08-25T04:45:43.945354+0000","last_clean":"2023-08-25T04:45:43.945354+0000","last_became_active":"2023-08-25T04:43:42.895114+0000","last_became_peered":"2023-08-25T04:43:42.895114+0000","last_unstale":"2023-08-25T04:45:43.945354+0000","last_undegraded":"2023-08-25T04:45:43.945354+0000","last_fullsized":"2023-08-25T04:45:43.945354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:15.328992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'267","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.952396+0000","last_change":"2023-08-25T04:43:42.896149+0000","last_active":"2023-08-25T04:45:43.952396+0000","last_peered":"2023-08-25T04:45:43.952396+0000","last_clean":"2023-08-25T04:45:43.952396+0000","last_became_active":"2023-08-25T04:43:42.895893+0000","last_became_peered":"2023-08-25T04:43:42.895893+0000","last_unstale":"2023-08-25T04:45:43.952396+0000","last_undegraded":"2023-08-25T04:45:43.952396+0000","last_fullsized":"2023-08-25T04:45:43.952396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:26:47.525605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"23'266","reported_seq":281,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.943626+0000","last_change":"2023-08-25T04:43:42.905467+0000","last_active":"2023-08-25T04:45:43.943626+0000","last_peered":"2023-08-25T04:45:43.943626+0000","last_clean":"2023-08-25T04:45:43.943626+0000","last_became_active":"2023-08-25T04:43:42.905157+0000","last_became_peered":"2023-08-25T04:43:42.905157+0000","last_unstale":"2023-08-25T04:45:43.943626+0000","last_undegraded":"2023-08-25T04:45:43.943626+0000","last_fullsized":"2023-08-25T04:45:43.943626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:35.214306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"23'278","reported_seq":293,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.951055+0000","last_change":"2023-08-25T04:43:42.881107+0000","last_active":"2023-08-25T04:45:43.951055+0000","last_peered":"2023-08-25T04:45:43.951055+0000","last_clean":"2023-08-25T04:45:43.951055+0000","last_became_active":"2023-08-25T04:43:42.879881+0000","last_became_peered":"2023-08-25T04:43:42.879881+0000","last_unstale":"2023-08-25T04:45:43.951055+0000","last_undegraded":"2023-08-25T04:45:43.951055+0000","last_fullsized":"2023-08-25T04:45:43.951055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:12.206120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'246","reported_seq":256,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.941083+0000","last_change":"2023-08-25T04:44:30.818677+0000","last_active":"2023-08-25T04:45:43.941083+0000","last_peered":"2023-08-25T04:45:43.941083+0000","last_clean":"2023-08-25T04:45:43.941083+0000","last_became_active":"2023-08-25T04:44:30.818308+0000","last_became_peered":"2023-08-25T04:44:30.818308+0000","last_unstale":"2023-08-25T04:45:43.941083+0000","last_undegraded":"2023-08-25T04:45:43.941083+0000","last_fullsized":"2023-08-25T04:45:43.941083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:43.562022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"23'239","reported_seq":254,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.943417+0000","last_change":"2023-08-25T04:43:42.897136+0000","last_active":"2023-08-25T04:45:43.943417+0000","last_peered":"2023-08-25T04:45:43.943417+0000","last_clean":"2023-08-25T04:45:43.943417+0000","last_became_active":"2023-08-25T04:43:42.896869+0000","last_became_peered":"2023-08-25T04:43:42.896869+0000","last_unstale":"2023-08-25T04:45:43.943417+0000","last_undegraded":"2023-08-25T04:45:43.943417+0000","last_fullsized":"2023-08-25T04:45:43.943417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:04.986803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"23'255","reported_seq":270,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.950889+0000","last_change":"2023-08-25T04:43:42.893954+0000","last_active":"2023-08-25T04:45:43.950889+0000","last_peered":"2023-08-25T04:45:43.950889+0000","last_clean":"2023-08-25T04:45:43.950889+0000","last_became_active":"2023-08-25T04:43:42.893673+0000","last_became_peered":"2023-08-25T04:43:42.893673+0000","last_unstale":"2023-08-25T04:45:43.950889+0000","last_undegraded":"2023-08-25T04:45:43.950889+0000","last_fullsized":"2023-08-25T04:45:43.950889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:17:01.748486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'273","reported_seq":288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.950944+0000","last_change":"2023-08-25T04:43:42.888116+0000","last_active":"2023-08-25T04:45:43.950944+0000","last_peered":"2023-08-25T04:45:43.950944+0000","last_clean":"2023-08-25T04:45:43.950944+0000","last_became_active":"2023-08-25T04:43:42.887831+0000","last_became_peered":"2023-08-25T04:43:42.887831+0000","last_unstale":"2023-08-25T04:45:43.950944+0000","last_undegraded":"2023-08-25T04:45:43.950944+0000","last_fullsized":"2023-08-25T04:45:43.950944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:39:50.519838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'237","reported_seq":252,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.072546+0000","last_change":"2023-08-25T04:43:42.894954+0000","last_active":"2023-08-25T04:45:44.072546+0000","last_peered":"2023-08-25T04:45:44.072546+0000","last_clean":"2023-08-25T04:45:44.072546+0000","last_became_active":"2023-08-25T04:43:42.894302+0000","last_became_peered":"2023-08-25T04:43:42.894302+0000","last_unstale":"2023-08-25T04:45:44.072546+0000","last_undegraded":"2023-08-25T04:45:44.072546+0000","last_fullsized":"2023-08-25T04:45:44.072546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:05:02.005895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282331+0000","last_change":"2023-08-25T04:43:41.888584+0000","last_active":"2023-08-25T04:44:31.282331+0000","last_peered":"2023-08-25T04:44:31.282331+0000","last_clean":"2023-08-25T04:44:31.282331+0000","last_became_active":"2023-08-25T04:43:41.888339+0000","last_became_peered":"2023-08-25T04:43:41.888339+0000","last_unstale":"2023-08-25T04:44:31.282331+0000","last_undegraded":"2023-08-25T04:44:31.282331+0000","last_fullsized":"2023-08-25T04:44:31.282331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:37.980335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'271","reported_seq":286,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947167+0000","last_change":"2023-08-25T04:43:42.897739+0000","last_active":"2023-08-25T04:45:43.947167+0000","last_peered":"2023-08-25T04:45:43.947167+0000","last_clean":"2023-08-25T04:45:43.947167+0000","last_became_active":"2023-08-25T04:43:42.897425+0000","last_became_peered":"2023-08-25T04:43:42.897425+0000","last_unstale":"2023-08-25T04:45:43.947167+0000","last_undegraded":"2023-08-25T04:45:43.947167+0000","last_fullsized":"2023-08-25T04:45:43.947167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:46:26.445143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475661+0000","last_change":"2023-08-25T04:43:41.886122+0000","last_active":"2023-08-25T04:44:30.475661+0000","last_peered":"2023-08-25T04:44:30.475661+0000","last_clean":"2023-08-25T04:44:30.475661+0000","last_became_active":"2023-08-25T04:43:41.885184+0000","last_became_peered":"2023-08-25T04:43:41.885184+0000","last_unstale":"2023-08-25T04:44:30.475661+0000","last_undegraded":"2023-08-25T04:44:30.475661+0000","last_fullsized":"2023-08-25T04:44:30.475661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:33.855942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'291","reported_seq":307,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.067644+0000","last_change":"2023-08-25T04:43:42.890854+0000","last_active":"2023-08-25T04:45:44.067644+0000","last_peered":"2023-08-25T04:45:44.067644+0000","last_clean":"2023-08-25T04:45:44.067644+0000","last_became_active":"2023-08-25T04:43:42.890575+0000","last_became_peered":"2023-08-25T04:43:42.890575+0000","last_unstale":"2023-08-25T04:45:44.067644+0000","last_undegraded":"2023-08-25T04:45:44.067644+0000","last_fullsized":"2023-08-25T04:45:44.067644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:59.175818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.477781+0000","last_change":"2023-08-25T04:43:41.885567+0000","last_active":"2023-08-25T04:44:30.477781+0000","last_peered":"2023-08-25T04:44:30.477781+0000","last_clean":"2023-08-25T04:44:30.477781+0000","last_became_active":"2023-08-25T04:43:41.885299+0000","last_became_peered":"2023-08-25T04:43:41.885299+0000","last_unstale":"2023-08-25T04:44:30.477781+0000","last_undegraded":"2023-08-25T04:44:30.477781+0000","last_fullsized":"2023-08-25T04:44:30.477781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:14:12.640506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'269","reported_seq":284,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.934097+0000","last_change":"2023-08-25T04:43:42.899190+0000","last_active":"2023-08-25T04:45:43.934097+0000","last_peered":"2023-08-25T04:45:43.934097+0000","last_clean":"2023-08-25T04:45:43.934097+0000","last_became_active":"2023-08-25T04:43:42.898874+0000","last_became_peered":"2023-08-25T04:43:42.898874+0000","last_unstale":"2023-08-25T04:45:43.934097+0000","last_undegraded":"2023-08-25T04:45:43.934097+0000","last_fullsized":"2023-08-25T04:45:43.934097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:07.786286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.817699+0000","last_change":"2023-08-25T04:43:41.883055+0000","last_active":"2023-08-25T04:44:30.817699+0000","last_peered":"2023-08-25T04:44:30.817699+0000","last_clean":"2023-08-25T04:44:30.817699+0000","last_became_active":"2023-08-25T04:43:41.882381+0000","last_became_peered":"2023-08-25T04:43:41.882381+0000","last_unstale":"2023-08-25T04:44:30.817699+0000","last_undegraded":"2023-08-25T04:44:30.817699+0000","last_fullsized":"2023-08-25T04:44:30.817699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:46:41.140536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'261","reported_seq":281,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.074319+0000","last_change":"2023-08-25T04:44:30.481564+0000","last_active":"2023-08-25T04:45:44.074319+0000","last_peered":"2023-08-25T04:45:44.074319+0000","last_clean":"2023-08-25T04:45:44.074319+0000","last_became_active":"2023-08-25T04:44:30.481273+0000","last_became_peered":"2023-08-25T04:44:30.481273+0000","last_unstale":"2023-08-25T04:45:44.074319+0000","last_undegraded":"2023-08-25T04:45:44.074319+0000","last_fullsized":"2023-08-25T04:45:44.074319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:35.214306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475622+0000","last_change":"2023-08-25T04:43:41.882339+0000","last_active":"2023-08-25T04:44:30.475622+0000","last_peered":"2023-08-25T04:44:30.475622+0000","last_clean":"2023-08-25T04:44:30.475622+0000","last_became_active":"2023-08-25T04:43:41.882055+0000","last_became_peered":"2023-08-25T04:43:41.882055+0000","last_unstale":"2023-08-25T04:44:30.475622+0000","last_undegraded":"2023-08-25T04:44:30.475622+0000","last_fullsized":"2023-08-25T04:44:30.475622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:19.884687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"23'268","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.090214+0000","last_change":"2023-08-25T04:43:42.891741+0000","last_active":"2023-08-25T04:45:44.090214+0000","last_peered":"2023-08-25T04:45:44.090214+0000","last_clean":"2023-08-25T04:45:44.090214+0000","last_became_active":"2023-08-25T04:43:42.890100+0000","last_became_peered":"2023-08-25T04:43:42.890100+0000","last_unstale":"2023-08-25T04:45:44.090214+0000","last_undegraded":"2023-08-25T04:45:44.090214+0000","last_fullsized":"2023-08-25T04:45:44.090214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:09.859531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'12","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:42.091016+0000","last_change":"2023-08-25T04:43:41.887924+0000","last_active":"2023-08-25T04:45:42.091016+0000","last_peered":"2023-08-25T04:45:42.091016+0000","last_clean":"2023-08-25T04:45:42.091016+0000","last_became_active":"2023-08-25T04:43:41.887622+0000","last_became_peered":"2023-08-25T04:43:41.887622+0000","last_unstale":"2023-08-25T04:45:42.091016+0000","last_undegraded":"2023-08-25T04:45:42.091016+0000","last_fullsized":"2023-08-25T04:45:42.091016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:37:55.965513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"23'273","reported_seq":288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.094435+0000","last_change":"2023-08-25T04:43:42.891006+0000","last_active":"2023-08-25T04:45:44.094435+0000","last_peered":"2023-08-25T04:45:44.094435+0000","last_clean":"2023-08-25T04:45:44.094435+0000","last_became_active":"2023-08-25T04:43:42.890648+0000","last_became_peered":"2023-08-25T04:43:42.890648+0000","last_unstale":"2023-08-25T04:45:44.094435+0000","last_undegraded":"2023-08-25T04:45:44.094435+0000","last_fullsized":"2023-08-25T04:45:44.094435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:39:11.580949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'341","reported_seq":358,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.909488+0000","last_change":"2023-08-25T04:43:41.887033+0000","last_active":"2023-08-25T04:45:43.909488+0000","last_peered":"2023-08-25T04:45:43.909488+0000","last_clean":"2023-08-25T04:45:43.909488+0000","last_became_active":"2023-08-25T04:43:41.886491+0000","last_became_peered":"2023-08-25T04:43:41.886491+0000","last_unstale":"2023-08-25T04:45:43.909488+0000","last_undegraded":"2023-08-25T04:45:43.909488+0000","last_fullsized":"2023-08-25T04:45:43.909488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:55.292210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396437,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":1603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"23'297","reported_seq":312,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.954956+0000","last_change":"2023-08-25T04:43:42.893709+0000","last_active":"2023-08-25T04:45:43.954956+0000","last_peered":"2023-08-25T04:45:43.954956+0000","last_clean":"2023-08-25T04:45:43.954956+0000","last_became_active":"2023-08-25T04:43:42.893525+0000","last_became_peered":"2023-08-25T04:43:42.893525+0000","last_unstale":"2023-08-25T04:45:43.954956+0000","last_undegraded":"2023-08-25T04:45:43.954956+0000","last_fullsized":"2023-08-25T04:45:43.954956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:36:05.985843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138242+0000","last_change":"2023-08-25T04:43:41.890946+0000","last_active":"2023-08-25T04:44:31.138242+0000","last_peered":"2023-08-25T04:44:31.138242+0000","last_clean":"2023-08-25T04:44:31.138242+0000","last_became_active":"2023-08-25T04:43:41.890673+0000","last_became_peered":"2023-08-25T04:43:41.890673+0000","last_unstale":"2023-08-25T04:44:31.138242+0000","last_undegraded":"2023-08-25T04:44:31.138242+0000","last_fullsized":"2023-08-25T04:44:31.138242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:21:24.093061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"23'269","reported_seq":284,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.097987+0000","last_change":"2023-08-25T04:43:42.897809+0000","last_active":"2023-08-25T04:45:44.097987+0000","last_peered":"2023-08-25T04:45:44.097987+0000","last_clean":"2023-08-25T04:45:44.097987+0000","last_became_active":"2023-08-25T04:43:42.897204+0000","last_became_peered":"2023-08-25T04:43:42.897204+0000","last_unstale":"2023-08-25T04:45:44.097987+0000","last_undegraded":"2023-08-25T04:45:44.097987+0000","last_fullsized":"2023-08-25T04:45:44.097987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:25:20.195553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.817198+0000","last_change":"2023-08-25T04:43:41.881387+0000","last_active":"2023-08-25T04:44:30.817198+0000","last_peered":"2023-08-25T04:44:30.817198+0000","last_clean":"2023-08-25T04:44:30.817198+0000","last_became_active":"2023-08-25T04:43:41.881067+0000","last_became_peered":"2023-08-25T04:43:41.881067+0000","last_unstale":"2023-08-25T04:44:30.817198+0000","last_undegraded":"2023-08-25T04:44:30.817198+0000","last_fullsized":"2023-08-25T04:44:30.817198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:05.439371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'253","reported_seq":268,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.937984+0000","last_change":"2023-08-25T04:43:42.895088+0000","last_active":"2023-08-25T04:45:43.937984+0000","last_peered":"2023-08-25T04:45:43.937984+0000","last_clean":"2023-08-25T04:45:43.937984+0000","last_became_active":"2023-08-25T04:43:42.894807+0000","last_became_peered":"2023-08-25T04:43:42.894807+0000","last_unstale":"2023-08-25T04:45:43.937984+0000","last_undegraded":"2023-08-25T04:45:43.937984+0000","last_fullsized":"2023-08-25T04:45:43.937984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:46:42.145657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138466+0000","last_change":"2023-08-25T04:43:41.890995+0000","last_active":"2023-08-25T04:44:31.138466+0000","last_peered":"2023-08-25T04:44:31.138466+0000","last_clean":"2023-08-25T04:44:31.138466+0000","last_became_active":"2023-08-25T04:43:41.890706+0000","last_became_peered":"2023-08-25T04:43:41.890706+0000","last_unstale":"2023-08-25T04:44:31.138466+0000","last_undegraded":"2023-08-25T04:44:31.138466+0000","last_fullsized":"2023-08-25T04:44:31.138466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:08.854411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"23'288","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.091649+0000","last_change":"2023-08-25T04:43:42.897775+0000","last_active":"2023-08-25T04:45:44.091649+0000","last_peered":"2023-08-25T04:45:44.091649+0000","last_clean":"2023-08-25T04:45:44.091649+0000","last_became_active":"2023-08-25T04:43:42.897476+0000","last_became_peered":"2023-08-25T04:43:42.897476+0000","last_unstale":"2023-08-25T04:45:44.091649+0000","last_undegraded":"2023-08-25T04:45:44.091649+0000","last_fullsized":"2023-08-25T04:45:44.091649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:39:50.519838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500563+0000","last_change":"2023-08-25T04:43:41.892829+0000","last_active":"2023-08-25T04:44:31.500563+0000","last_peered":"2023-08-25T04:44:31.500563+0000","last_clean":"2023-08-25T04:44:31.500563+0000","last_became_active":"2023-08-25T04:43:41.892517+0000","last_became_peered":"2023-08-25T04:43:41.892517+0000","last_unstale":"2023-08-25T04:44:31.500563+0000","last_undegraded":"2023-08-25T04:44:31.500563+0000","last_fullsized":"2023-08-25T04:44:31.500563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:57:37.072728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"23'268","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.939447+0000","last_change":"2023-08-25T04:43:42.905276+0000","last_active":"2023-08-25T04:45:43.939447+0000","last_peered":"2023-08-25T04:45:43.939447+0000","last_clean":"2023-08-25T04:45:43.939447+0000","last_became_active":"2023-08-25T04:43:42.904736+0000","last_became_peered":"2023-08-25T04:43:42.904736+0000","last_unstale":"2023-08-25T04:45:43.939447+0000","last_undegraded":"2023-08-25T04:45:43.939447+0000","last_fullsized":"2023-08-25T04:45:43.939447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:38.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138672+0000","last_change":"2023-08-25T04:43:41.891246+0000","last_active":"2023-08-25T04:44:31.138672+0000","last_peered":"2023-08-25T04:44:31.138672+0000","last_clean":"2023-08-25T04:44:31.138672+0000","last_became_active":"2023-08-25T04:43:41.890942+0000","last_became_peered":"2023-08-25T04:43:41.890942+0000","last_unstale":"2023-08-25T04:44:31.138672+0000","last_undegraded":"2023-08-25T04:44:31.138672+0000","last_fullsized":"2023-08-25T04:44:31.138672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:33:59.579978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"23'238","reported_seq":253,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.068264+0000","last_change":"2023-08-25T04:43:42.895071+0000","last_active":"2023-08-25T04:45:44.068264+0000","last_peered":"2023-08-25T04:45:44.068264+0000","last_clean":"2023-08-25T04:45:44.068264+0000","last_became_active":"2023-08-25T04:43:42.894285+0000","last_became_peered":"2023-08-25T04:43:42.894285+0000","last_unstale":"2023-08-25T04:45:44.068264+0000","last_undegraded":"2023-08-25T04:45:44.068264+0000","last_fullsized":"2023-08-25T04:45:44.068264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:12.206120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138636+0000","last_change":"2023-08-25T04:43:41.891175+0000","last_active":"2023-08-25T04:44:31.138636+0000","last_peered":"2023-08-25T04:44:31.138636+0000","last_clean":"2023-08-25T04:44:31.138636+0000","last_became_active":"2023-08-25T04:43:41.890883+0000","last_became_peered":"2023-08-25T04:43:41.890883+0000","last_unstale":"2023-08-25T04:44:31.138636+0000","last_undegraded":"2023-08-25T04:44:31.138636+0000","last_fullsized":"2023-08-25T04:44:31.138636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:38.632609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"23'265","reported_seq":280,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.955269+0000","last_change":"2023-08-25T04:43:42.891686+0000","last_active":"2023-08-25T04:45:43.955269+0000","last_peered":"2023-08-25T04:45:43.955269+0000","last_clean":"2023-08-25T04:45:43.955269+0000","last_became_active":"2023-08-25T04:43:42.891443+0000","last_became_peered":"2023-08-25T04:43:42.891443+0000","last_unstale":"2023-08-25T04:45:43.955269+0000","last_undegraded":"2023-08-25T04:45:43.955269+0000","last_fullsized":"2023-08-25T04:45:43.955269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:18:58.719117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138361+0000","last_change":"2023-08-25T04:43:41.888723+0000","last_active":"2023-08-25T04:44:31.138361+0000","last_peered":"2023-08-25T04:44:31.138361+0000","last_clean":"2023-08-25T04:44:31.138361+0000","last_became_active":"2023-08-25T04:43:41.888447+0000","last_became_peered":"2023-08-25T04:43:41.888447+0000","last_unstale":"2023-08-25T04:44:31.138361+0000","last_undegraded":"2023-08-25T04:44:31.138361+0000","last_fullsized":"2023-08-25T04:44:31.138361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:42.712431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"23'270","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.086705+0000","last_change":"2023-08-25T04:43:42.892447+0000","last_active":"2023-08-25T04:45:44.086705+0000","last_peered":"2023-08-25T04:45:44.086705+0000","last_clean":"2023-08-25T04:45:44.086705+0000","last_became_active":"2023-08-25T04:43:42.892191+0000","last_became_peered":"2023-08-25T04:43:42.892191+0000","last_unstale":"2023-08-25T04:45:44.086705+0000","last_undegraded":"2023-08-25T04:45:44.086705+0000","last_fullsized":"2023-08-25T04:45:44.086705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:18.265853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475964+0000","last_change":"2023-08-25T04:43:41.884395+0000","last_active":"2023-08-25T04:44:30.475964+0000","last_peered":"2023-08-25T04:44:30.475964+0000","last_clean":"2023-08-25T04:44:30.475964+0000","last_became_active":"2023-08-25T04:43:41.884098+0000","last_became_peered":"2023-08-25T04:43:41.884098+0000","last_unstale":"2023-08-25T04:44:30.475964+0000","last_undegraded":"2023-08-25T04:44:30.475964+0000","last_fullsized":"2023-08-25T04:44:30.475964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:20.449241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"23'269","reported_seq":284,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.952454+0000","last_change":"2023-08-25T04:43:42.881050+0000","last_active":"2023-08-25T04:45:43.952454+0000","last_peered":"2023-08-25T04:45:43.952454+0000","last_clean":"2023-08-25T04:45:43.952454+0000","last_became_active":"2023-08-25T04:43:42.880104+0000","last_became_peered":"2023-08-25T04:43:42.880104+0000","last_unstale":"2023-08-25T04:45:43.952454+0000","last_undegraded":"2023-08-25T04:45:43.952454+0000","last_fullsized":"2023-08-25T04:45:43.952454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:21.454361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:30.051992+0000","last_change":"2023-08-25T04:43:41.885729+0000","last_active":"2023-08-25T04:45:30.051992+0000","last_peered":"2023-08-25T04:45:30.051992+0000","last_clean":"2023-08-25T04:45:30.051992+0000","last_became_active":"2023-08-25T04:43:41.885433+0000","last_became_peered":"2023-08-25T04:43:41.885433+0000","last_unstale":"2023-08-25T04:45:30.051992+0000","last_undegraded":"2023-08-25T04:45:30.051992+0000","last_fullsized":"2023-08-25T04:45:30.051992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:38.632609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'243","reported_seq":258,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.090177+0000","last_change":"2023-08-25T04:43:42.896701+0000","last_active":"2023-08-25T04:45:44.090177+0000","last_peered":"2023-08-25T04:45:44.090177+0000","last_clean":"2023-08-25T04:45:44.090177+0000","last_became_active":"2023-08-25T04:43:42.896440+0000","last_became_peered":"2023-08-25T04:43:42.896440+0000","last_unstale":"2023-08-25T04:45:44.090177+0000","last_undegraded":"2023-08-25T04:45:44.090177+0000","last_fullsized":"2023-08-25T04:45:44.090177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:15.437547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500655+0000","last_change":"2023-08-25T04:43:41.891087+0000","last_active":"2023-08-25T04:44:31.500655+0000","last_peered":"2023-08-25T04:44:31.500655+0000","last_clean":"2023-08-25T04:44:31.500655+0000","last_became_active":"2023-08-25T04:43:41.890827+0000","last_became_peered":"2023-08-25T04:43:41.890827+0000","last_unstale":"2023-08-25T04:44:31.500655+0000","last_undegraded":"2023-08-25T04:44:31.500655+0000","last_fullsized":"2023-08-25T04:44:31.500655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:00:12.731255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"23'288","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.955555+0000","last_change":"2023-08-25T04:43:42.897377+0000","last_active":"2023-08-25T04:45:43.955555+0000","last_peered":"2023-08-25T04:45:43.955555+0000","last_clean":"2023-08-25T04:45:43.955555+0000","last_became_active":"2023-08-25T04:43:42.897108+0000","last_became_peered":"2023-08-25T04:43:42.897108+0000","last_unstale":"2023-08-25T04:45:43.955555+0000","last_undegraded":"2023-08-25T04:45:43.955555+0000","last_fullsized":"2023-08-25T04:45:43.955555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:59.768622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282280+0000","last_change":"2023-08-25T04:43:41.888568+0000","last_active":"2023-08-25T04:44:31.282280+0000","last_peered":"2023-08-25T04:44:31.282280+0000","last_clean":"2023-08-25T04:44:31.282280+0000","last_became_active":"2023-08-25T04:43:41.888323+0000","last_became_peered":"2023-08-25T04:43:41.888323+0000","last_unstale":"2023-08-25T04:44:31.282280+0000","last_undegraded":"2023-08-25T04:44:31.282280+0000","last_fullsized":"2023-08-25T04:44:31.282280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:53:53.170122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"23'285","reported_seq":300,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.954940+0000","last_change":"2023-08-25T04:43:42.897222+0000","last_active":"2023-08-25T04:45:43.954940+0000","last_peered":"2023-08-25T04:45:43.954940+0000","last_clean":"2023-08-25T04:45:43.954940+0000","last_became_active":"2023-08-25T04:43:42.896943+0000","last_became_peered":"2023-08-25T04:43:42.896943+0000","last_unstale":"2023-08-25T04:45:43.954940+0000","last_undegraded":"2023-08-25T04:45:43.954940+0000","last_fullsized":"2023-08-25T04:45:43.954940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:39.531589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.477627+0000","last_change":"2023-08-25T04:43:41.887489+0000","last_active":"2023-08-25T04:44:30.477627+0000","last_peered":"2023-08-25T04:44:30.477627+0000","last_clean":"2023-08-25T04:44:30.477627+0000","last_became_active":"2023-08-25T04:43:41.886846+0000","last_became_peered":"2023-08-25T04:43:41.886846+0000","last_unstale":"2023-08-25T04:44:30.477627+0000","last_undegraded":"2023-08-25T04:44:30.477627+0000","last_fullsized":"2023-08-25T04:44:30.477627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:06.310501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'280","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.951699+0000","last_change":"2023-08-25T04:43:42.903030+0000","last_active":"2023-08-25T04:45:43.951699+0000","last_peered":"2023-08-25T04:45:43.951699+0000","last_clean":"2023-08-25T04:45:43.951699+0000","last_became_active":"2023-08-25T04:43:42.902123+0000","last_became_peered":"2023-08-25T04:43:42.902123+0000","last_unstale":"2023-08-25T04:45:43.951699+0000","last_undegraded":"2023-08-25T04:45:43.951699+0000","last_fullsized":"2023-08-25T04:45:43.951699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:04:31.758204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478851+0000","last_change":"2023-08-25T04:43:41.883173+0000","last_active":"2023-08-25T04:44:30.478851+0000","last_peered":"2023-08-25T04:44:30.478851+0000","last_clean":"2023-08-25T04:44:30.478851+0000","last_became_active":"2023-08-25T04:43:41.882776+0000","last_became_peered":"2023-08-25T04:43:41.882776+0000","last_unstale":"2023-08-25T04:44:30.478851+0000","last_undegraded":"2023-08-25T04:44:30.478851+0000","last_fullsized":"2023-08-25T04:44:30.478851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:43.055214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282709+0000","last_change":"2023-08-25T04:43:36.786045+0000","last_active":"2023-08-25T04:44:31.282709+0000","last_peered":"2023-08-25T04:44:31.282709+0000","last_clean":"2023-08-25T04:44:31.282709+0000","last_became_active":"2023-08-25T04:43:36.785725+0000","last_became_peered":"2023-08-25T04:43:36.785725+0000","last_unstale":"2023-08-25T04:44:31.282709+0000","last_undegraded":"2023-08-25T04:44:31.282709+0000","last_fullsized":"2023-08-25T04:44:31.282709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:13.214839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"23'253","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.095457+0000","last_change":"2023-08-25T04:43:42.890044+0000","last_active":"2023-08-25T04:45:44.095457+0000","last_peered":"2023-08-25T04:45:44.095457+0000","last_clean":"2023-08-25T04:45:44.095457+0000","last_became_active":"2023-08-25T04:43:42.889721+0000","last_became_peered":"2023-08-25T04:43:42.889721+0000","last_unstale":"2023-08-25T04:45:44.095457+0000","last_undegraded":"2023-08-25T04:45:44.095457+0000","last_fullsized":"2023-08-25T04:45:44.095457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:59.175818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478654+0000","last_change":"2023-08-25T04:43:36.782928+0000","last_active":"2023-08-25T04:44:30.478654+0000","last_peered":"2023-08-25T04:44:30.478654+0000","last_clean":"2023-08-25T04:44:30.478654+0000","last_became_active":"2023-08-25T04:43:36.782680+0000","last_became_peered":"2023-08-25T04:43:36.782680+0000","last_unstale":"2023-08-25T04:44:30.478654+0000","last_undegraded":"2023-08-25T04:44:30.478654+0000","last_fullsized":"2023-08-25T04:44:30.478654+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:33:54.492649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'9","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:36.931752+0000","last_change":"2023-08-25T04:43:41.888878+0000","last_active":"2023-08-25T04:45:36.931752+0000","last_peered":"2023-08-25T04:45:36.931752+0000","last_clean":"2023-08-25T04:45:36.931752+0000","last_became_active":"2023-08-25T04:43:41.885363+0000","last_became_peered":"2023-08-25T04:43:41.885363+0000","last_unstale":"2023-08-25T04:45:36.931752+0000","last_undegraded":"2023-08-25T04:45:36.931752+0000","last_fullsized":"2023-08-25T04:45:36.931752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:06.310501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'246","reported_seq":261,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.954730+0000","last_change":"2023-08-25T04:43:42.899201+0000","last_active":"2023-08-25T04:45:43.954730+0000","last_peered":"2023-08-25T04:45:43.954730+0000","last_clean":"2023-08-25T04:45:43.954730+0000","last_became_active":"2023-08-25T04:43:42.898942+0000","last_became_peered":"2023-08-25T04:43:42.898942+0000","last_unstale":"2023-08-25T04:45:43.954730+0000","last_undegraded":"2023-08-25T04:45:43.954730+0000","last_fullsized":"2023-08-25T04:45:43.954730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:57:45.095370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.474997+0000","last_change":"2023-08-25T04:43:36.785266+0000","last_active":"2023-08-25T04:44:30.474997+0000","last_peered":"2023-08-25T04:44:30.474997+0000","last_clean":"2023-08-25T04:44:30.474997+0000","last_became_active":"2023-08-25T04:43:36.784937+0000","last_became_peered":"2023-08-25T04:43:36.784937+0000","last_unstale":"2023-08-25T04:44:30.474997+0000","last_undegraded":"2023-08-25T04:44:30.474997+0000","last_fullsized":"2023-08-25T04:44:30.474997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:05:30.545713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138986+0000","last_change":"2023-08-25T04:43:36.785867+0000","last_active":"2023-08-25T04:44:31.138986+0000","last_peered":"2023-08-25T04:44:31.138986+0000","last_clean":"2023-08-25T04:44:31.138986+0000","last_became_active":"2023-08-25T04:43:36.785451+0000","last_became_peered":"2023-08-25T04:43:36.785451+0000","last_unstale":"2023-08-25T04:44:31.138986+0000","last_undegraded":"2023-08-25T04:44:31.138986+0000","last_fullsized":"2023-08-25T04:44:31.138986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:10.216462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'14","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.062429+0000","last_change":"2023-08-25T04:43:41.886451+0000","last_active":"2023-08-25T04:45:44.062429+0000","last_peered":"2023-08-25T04:45:44.062429+0000","last_clean":"2023-08-25T04:45:44.062429+0000","last_became_active":"2023-08-25T04:43:41.885029+0000","last_became_peered":"2023-08-25T04:43:41.885029+0000","last_unstale":"2023-08-25T04:45:44.062429+0000","last_undegraded":"2023-08-25T04:45:44.062429+0000","last_fullsized":"2023-08-25T04:45:44.062429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:05:01.000775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7272,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":13,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'275","reported_seq":290,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.069940+0000","last_change":"2023-08-25T04:43:42.881048+0000","last_active":"2023-08-25T04:45:44.069940+0000","last_peered":"2023-08-25T04:45:44.069940+0000","last_clean":"2023-08-25T04:45:44.069940+0000","last_became_active":"2023-08-25T04:43:42.880591+0000","last_became_peered":"2023-08-25T04:43:42.880591+0000","last_unstale":"2023-08-25T04:45:44.069940+0000","last_undegraded":"2023-08-25T04:45:44.069940+0000","last_fullsized":"2023-08-25T04:45:44.069940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:35.214306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138202+0000","last_change":"2023-08-25T04:43:37.192872+0000","last_active":"2023-08-25T04:44:31.138202+0000","last_peered":"2023-08-25T04:44:31.138202+0000","last_clean":"2023-08-25T04:44:31.138202+0000","last_became_active":"2023-08-25T04:43:37.192594+0000","last_became_peered":"2023-08-25T04:43:37.192594+0000","last_unstale":"2023-08-25T04:44:31.138202+0000","last_undegraded":"2023-08-25T04:44:31.138202+0000","last_fullsized":"2023-08-25T04:44:31.138202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:14:07.553177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.474916+0000","last_change":"2023-08-25T04:43:41.888507+0000","last_active":"2023-08-25T04:44:30.474916+0000","last_peered":"2023-08-25T04:44:30.474916+0000","last_clean":"2023-08-25T04:44:30.474916+0000","last_became_active":"2023-08-25T04:43:41.888158+0000","last_became_peered":"2023-08-25T04:43:41.888158+0000","last_unstale":"2023-08-25T04:44:30.474916+0000","last_undegraded":"2023-08-25T04:44:30.474916+0000","last_fullsized":"2023-08-25T04:44:30.474916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:46:50.995055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'249","reported_seq":264,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.087271+0000","last_change":"2023-08-25T04:43:42.902440+0000","last_active":"2023-08-25T04:45:44.087271+0000","last_peered":"2023-08-25T04:45:44.087271+0000","last_clean":"2023-08-25T04:45:44.087271+0000","last_became_active":"2023-08-25T04:43:42.901657+0000","last_became_peered":"2023-08-25T04:43:42.901657+0000","last_unstale":"2023-08-25T04:45:44.087271+0000","last_undegraded":"2023-08-25T04:45:44.087271+0000","last_fullsized":"2023-08-25T04:45:44.087271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:30:27.322745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138904+0000","last_change":"2023-08-25T04:43:37.192977+0000","last_active":"2023-08-25T04:44:31.138904+0000","last_peered":"2023-08-25T04:44:31.138904+0000","last_clean":"2023-08-25T04:44:31.138904+0000","last_became_active":"2023-08-25T04:43:37.192427+0000","last_became_peered":"2023-08-25T04:43:37.192427+0000","last_unstale":"2023-08-25T04:44:31.138904+0000","last_undegraded":"2023-08-25T04:44:31.138904+0000","last_fullsized":"2023-08-25T04:44:31.138904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:25:14.103104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478272+0000","last_change":"2023-08-25T04:43:41.883960+0000","last_active":"2023-08-25T04:44:30.478272+0000","last_peered":"2023-08-25T04:44:30.478272+0000","last_clean":"2023-08-25T04:44:30.478272+0000","last_became_active":"2023-08-25T04:43:41.883621+0000","last_became_peered":"2023-08-25T04:43:41.883621+0000","last_unstale":"2023-08-25T04:44:30.478272+0000","last_undegraded":"2023-08-25T04:44:30.478272+0000","last_fullsized":"2023-08-25T04:44:30.478272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:37:55.965513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'267","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.955335+0000","last_change":"2023-08-25T04:43:42.893639+0000","last_active":"2023-08-25T04:45:43.955335+0000","last_peered":"2023-08-25T04:45:43.955335+0000","last_clean":"2023-08-25T04:45:43.955335+0000","last_became_active":"2023-08-25T04:43:42.893333+0000","last_became_peered":"2023-08-25T04:43:42.893333+0000","last_unstale":"2023-08-25T04:45:43.955335+0000","last_undegraded":"2023-08-25T04:45:43.955335+0000","last_fullsized":"2023-08-25T04:45:43.955335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:37.784121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475519+0000","last_change":"2023-08-25T04:43:37.192780+0000","last_active":"2023-08-25T04:44:30.475519+0000","last_peered":"2023-08-25T04:44:30.475519+0000","last_clean":"2023-08-25T04:44:30.475519+0000","last_became_active":"2023-08-25T04:43:37.192432+0000","last_became_peered":"2023-08-25T04:43:37.192432+0000","last_unstale":"2023-08-25T04:44:30.475519+0000","last_undegraded":"2023-08-25T04:44:30.475519+0000","last_fullsized":"2023-08-25T04:44:30.475519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:00.352042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282455+0000","last_change":"2023-08-25T04:43:41.889966+0000","last_active":"2023-08-25T04:44:31.282455+0000","last_peered":"2023-08-25T04:44:31.282455+0000","last_clean":"2023-08-25T04:44:31.282455+0000","last_became_active":"2023-08-25T04:43:41.889717+0000","last_became_peered":"2023-08-25T04:43:41.889717+0000","last_unstale":"2023-08-25T04:44:31.282455+0000","last_undegraded":"2023-08-25T04:44:31.282455+0000","last_fullsized":"2023-08-25T04:44:31.282455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:46:39.529025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"23'260","reported_seq":275,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.950517+0000","last_change":"2023-08-25T04:43:42.885970+0000","last_active":"2023-08-25T04:45:43.950517+0000","last_peered":"2023-08-25T04:45:43.950517+0000","last_clean":"2023-08-25T04:45:43.950517+0000","last_became_active":"2023-08-25T04:43:42.885671+0000","last_became_peered":"2023-08-25T04:43:42.885671+0000","last_unstale":"2023-08-25T04:45:43.950517+0000","last_undegraded":"2023-08-25T04:45:43.950517+0000","last_fullsized":"2023-08-25T04:45:43.950517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:20.889807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500828+0000","last_change":"2023-08-25T04:43:37.192768+0000","last_active":"2023-08-25T04:44:31.500828+0000","last_peered":"2023-08-25T04:44:31.500828+0000","last_clean":"2023-08-25T04:44:31.500828+0000","last_became_active":"2023-08-25T04:43:37.192429+0000","last_became_peered":"2023-08-25T04:43:37.192429+0000","last_unstale":"2023-08-25T04:44:31.500828+0000","last_undegraded":"2023-08-25T04:44:31.500828+0000","last_fullsized":"2023-08-25T04:44:31.500828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:26.497020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"23'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:36.180533+0000","last_change":"2023-08-25T04:43:41.888493+0000","last_active":"2023-08-25T04:45:36.180533+0000","last_peered":"2023-08-25T04:45:36.180533+0000","last_clean":"2023-08-25T04:45:36.180533+0000","last_became_active":"2023-08-25T04:43:41.888207+0000","last_became_peered":"2023-08-25T04:43:41.888207+0000","last_unstale":"2023-08-25T04:45:36.180533+0000","last_undegraded":"2023-08-25T04:45:36.180533+0000","last_fullsized":"2023-08-25T04:45:36.180533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:11.200999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'310","reported_seq":325,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.067670+0000","last_change":"2023-08-25T04:43:42.900866+0000","last_active":"2023-08-25T04:45:44.067670+0000","last_peered":"2023-08-25T04:45:44.067670+0000","last_clean":"2023-08-25T04:45:44.067670+0000","last_became_active":"2023-08-25T04:43:42.900470+0000","last_became_peered":"2023-08-25T04:43:42.900470+0000","last_unstale":"2023-08-25T04:45:44.067670+0000","last_undegraded":"2023-08-25T04:45:44.067670+0000","last_fullsized":"2023-08-25T04:45:44.067670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:04:31.758204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500882+0000","last_change":"2023-08-25T04:43:36.785280+0000","last_active":"2023-08-25T04:44:31.500882+0000","last_peered":"2023-08-25T04:44:31.500882+0000","last_clean":"2023-08-25T04:44:31.500882+0000","last_became_active":"2023-08-25T04:43:36.784943+0000","last_became_peered":"2023-08-25T04:43:36.784943+0000","last_unstale":"2023-08-25T04:44:31.500882+0000","last_undegraded":"2023-08-25T04:44:31.500882+0000","last_fullsized":"2023-08-25T04:44:31.500882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.996393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.476180+0000","last_change":"2023-08-25T04:43:41.884839+0000","last_active":"2023-08-25T04:44:30.476180+0000","last_peered":"2023-08-25T04:44:30.476180+0000","last_clean":"2023-08-25T04:44:30.476180+0000","last_became_active":"2023-08-25T04:43:41.884535+0000","last_became_peered":"2023-08-25T04:43:41.884535+0000","last_unstale":"2023-08-25T04:44:30.476180+0000","last_undegraded":"2023-08-25T04:44:30.476180+0000","last_fullsized":"2023-08-25T04:44:30.476180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:57:40.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"23'272","reported_seq":287,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.948309+0000","last_change":"2023-08-25T04:43:42.903007+0000","last_active":"2023-08-25T04:45:43.948309+0000","last_peered":"2023-08-25T04:45:43.948309+0000","last_clean":"2023-08-25T04:45:43.948309+0000","last_became_active":"2023-08-25T04:43:42.902721+0000","last_became_peered":"2023-08-25T04:43:42.902721+0000","last_unstale":"2023-08-25T04:45:43.948309+0000","last_undegraded":"2023-08-25T04:45:43.948309+0000","last_fullsized":"2023-08-25T04:45:43.948309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:06.444491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.817827+0000","last_change":"2023-08-25T04:43:41.889969+0000","last_active":"2023-08-25T04:44:30.817827+0000","last_peered":"2023-08-25T04:44:30.817827+0000","last_clean":"2023-08-25T04:44:30.817827+0000","last_became_active":"2023-08-25T04:43:41.889659+0000","last_became_peered":"2023-08-25T04:43:41.889659+0000","last_unstale":"2023-08-25T04:44:30.817827+0000","last_undegraded":"2023-08-25T04:44:30.817827+0000","last_fullsized":"2023-08-25T04:44:30.817827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:03.981683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'274","reported_seq":289,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.948984+0000","last_change":"2023-08-25T04:43:42.894953+0000","last_active":"2023-08-25T04:45:43.948984+0000","last_peered":"2023-08-25T04:45:43.948984+0000","last_clean":"2023-08-25T04:45:43.948984+0000","last_became_active":"2023-08-25T04:43:42.894618+0000","last_became_peered":"2023-08-25T04:43:42.894618+0000","last_unstale":"2023-08-25T04:45:43.948984+0000","last_undegraded":"2023-08-25T04:45:43.948984+0000","last_fullsized":"2023-08-25T04:45:43.948984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:01.444718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475832+0000","last_change":"2023-08-25T04:43:41.886470+0000","last_active":"2023-08-25T04:44:30.475832+0000","last_peered":"2023-08-25T04:44:30.475832+0000","last_clean":"2023-08-25T04:44:30.475832+0000","last_became_active":"2023-08-25T04:43:41.886063+0000","last_became_peered":"2023-08-25T04:43:41.886063+0000","last_unstale":"2023-08-25T04:44:30.475832+0000","last_undegraded":"2023-08-25T04:44:30.475832+0000","last_fullsized":"2023-08-25T04:44:30.475832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:33.855942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'263","reported_seq":278,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.952687+0000","last_change":"2023-08-25T04:43:42.900475+0000","last_active":"2023-08-25T04:45:43.952687+0000","last_peered":"2023-08-25T04:45:43.952687+0000","last_clean":"2023-08-25T04:45:43.952687+0000","last_became_active":"2023-08-25T04:43:42.900135+0000","last_became_peered":"2023-08-25T04:43:42.900135+0000","last_unstale":"2023-08-25T04:45:43.952687+0000","last_undegraded":"2023-08-25T04:45:43.952687+0000","last_fullsized":"2023-08-25T04:45:43.952687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:38.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.476228+0000","last_change":"2023-08-25T04:43:41.891609+0000","last_active":"2023-08-25T04:44:30.476228+0000","last_peered":"2023-08-25T04:44:30.476228+0000","last_clean":"2023-08-25T04:44:30.476228+0000","last_became_active":"2023-08-25T04:43:41.891306+0000","last_became_peered":"2023-08-25T04:43:41.891306+0000","last_unstale":"2023-08-25T04:44:30.476228+0000","last_undegraded":"2023-08-25T04:44:30.476228+0000","last_fullsized":"2023-08-25T04:44:30.476228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:03.981683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'257","reported_seq":272,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.953493+0000","last_change":"2023-08-25T04:43:42.894647+0000","last_active":"2023-08-25T04:45:43.953493+0000","last_peered":"2023-08-25T04:45:43.953493+0000","last_clean":"2023-08-25T04:45:43.953493+0000","last_became_active":"2023-08-25T04:43:42.894386+0000","last_became_peered":"2023-08-25T04:43:42.894386+0000","last_unstale":"2023-08-25T04:45:43.953493+0000","last_undegraded":"2023-08-25T04:45:43.953493+0000","last_fullsized":"2023-08-25T04:45:43.953493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:41:20.742718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478873+0000","last_change":"2023-08-25T04:43:41.893331+0000","last_active":"2023-08-25T04:44:30.478873+0000","last_peered":"2023-08-25T04:44:30.478873+0000","last_clean":"2023-08-25T04:44:30.478873+0000","last_became_active":"2023-08-25T04:43:41.892929+0000","last_became_peered":"2023-08-25T04:43:41.892929+0000","last_unstale":"2023-08-25T04:44:30.478873+0000","last_undegraded":"2023-08-25T04:44:30.478873+0000","last_fullsized":"2023-08-25T04:44:30.478873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:58:44.113433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'252","reported_seq":267,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.948860+0000","last_change":"2023-08-25T04:43:42.894553+0000","last_active":"2023-08-25T04:45:43.948860+0000","last_peered":"2023-08-25T04:45:43.948860+0000","last_clean":"2023-08-25T04:45:43.948860+0000","last_became_active":"2023-08-25T04:43:42.894239+0000","last_became_peered":"2023-08-25T04:43:42.894239+0000","last_unstale":"2023-08-25T04:45:43.948860+0000","last_undegraded":"2023-08-25T04:45:43.948860+0000","last_fullsized":"2023-08-25T04:45:43.948860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:43.717551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.817799+0000","last_change":"2023-08-25T04:43:41.883254+0000","last_active":"2023-08-25T04:44:30.817799+0000","last_peered":"2023-08-25T04:44:30.817799+0000","last_clean":"2023-08-25T04:44:30.817799+0000","last_became_active":"2023-08-25T04:43:41.882756+0000","last_became_peered":"2023-08-25T04:43:41.882756+0000","last_unstale":"2023-08-25T04:44:30.817799+0000","last_undegraded":"2023-08-25T04:44:30.817799+0000","last_fullsized":"2023-08-25T04:44:30.817799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:57:40.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'285","reported_seq":300,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.953917+0000","last_change":"2023-08-25T04:43:42.895154+0000","last_active":"2023-08-25T04:45:43.953917+0000","last_peered":"2023-08-25T04:45:43.953917+0000","last_clean":"2023-08-25T04:45:43.953917+0000","last_became_active":"2023-08-25T04:43:42.894912+0000","last_became_peered":"2023-08-25T04:43:42.894912+0000","last_unstale":"2023-08-25T04:45:43.953917+0000","last_undegraded":"2023-08-25T04:45:43.953917+0000","last_fullsized":"2023-08-25T04:45:43.953917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:53.893508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"23'260","reported_seq":275,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947078+0000","last_change":"2023-08-25T04:43:42.893541+0000","last_active":"2023-08-25T04:45:43.947078+0000","last_peered":"2023-08-25T04:45:43.947078+0000","last_clean":"2023-08-25T04:45:43.947078+0000","last_became_active":"2023-08-25T04:43:42.893255+0000","last_became_peered":"2023-08-25T04:43:42.893255+0000","last_unstale":"2023-08-25T04:45:43.947078+0000","last_undegraded":"2023-08-25T04:45:43.947078+0000","last_fullsized":"2023-08-25T04:45:43.947078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:43:44.192741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"23'306","reported_seq":321,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.087688+0000","last_change":"2023-08-25T04:43:42.897868+0000","last_active":"2023-08-25T04:45:44.087688+0000","last_peered":"2023-08-25T04:45:44.087688+0000","last_clean":"2023-08-25T04:45:44.087688+0000","last_became_active":"2023-08-25T04:43:42.897394+0000","last_became_peered":"2023-08-25T04:43:42.897394+0000","last_unstale":"2023-08-25T04:45:44.087688+0000","last_undegraded":"2023-08-25T04:45:44.087688+0000","last_fullsized":"2023-08-25T04:45:44.087688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:21:25.098181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'286","reported_seq":301,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.946337+0000","last_change":"2023-08-25T04:43:42.894698+0000","last_active":"2023-08-25T04:45:43.946337+0000","last_peered":"2023-08-25T04:45:43.946337+0000","last_clean":"2023-08-25T04:45:43.946337+0000","last_became_active":"2023-08-25T04:43:42.894176+0000","last_became_peered":"2023-08-25T04:43:42.894176+0000","last_unstale":"2023-08-25T04:45:43.946337+0000","last_undegraded":"2023-08-25T04:45:43.946337+0000","last_fullsized":"2023-08-25T04:45:43.946337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:57:17.411245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"23'256","reported_seq":271,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.076659+0000","last_change":"2023-08-25T04:43:42.899435+0000","last_active":"2023-08-25T04:45:44.076659+0000","last_peered":"2023-08-25T04:45:44.076659+0000","last_clean":"2023-08-25T04:45:44.076659+0000","last_became_active":"2023-08-25T04:43:42.898842+0000","last_became_peered":"2023-08-25T04:43:42.898842+0000","last_unstale":"2023-08-25T04:45:44.076659+0000","last_undegraded":"2023-08-25T04:45:44.076659+0000","last_fullsized":"2023-08-25T04:45:44.076659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:16.308912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'267","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.942433+0000","last_change":"2023-08-25T04:43:42.890136+0000","last_active":"2023-08-25T04:45:43.942433+0000","last_peered":"2023-08-25T04:45:43.942433+0000","last_clean":"2023-08-25T04:45:43.942433+0000","last_became_active":"2023-08-25T04:43:42.889849+0000","last_became_peered":"2023-08-25T04:43:42.889849+0000","last_unstale":"2023-08-25T04:45:43.942433+0000","last_undegraded":"2023-08-25T04:45:43.942433+0000","last_fullsized":"2023-08-25T04:45:43.942433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:42:41.840740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":524,"num_write_kb":1101824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16961,"ondisk_log_size":16961,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1404507,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":416,"num_write_kb":1650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2867200,"data_stored":2809014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":419,"ondisk_log_size":419,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66276,"kb_used_data":26780,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94305564,"statfs":{"total":96636764160,"available":96568897536,"internally_reserved":0,"allocated":27422720,"data_stored":27244716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.9349999999999996,"5min":1.8160000000000001,"15min":0.96299999999999997},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":18.02,"5min":18.02,"15min":18.02},"last":0.29399999999999998},{"interface":"front","average":{"1min":7.6100000000000003,"5min":1.954,"15min":1.012},"min":{"1min":0.48299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":22.920999999999999,"5min":22.920999999999999,"15min":22.920999999999999},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.5759999999999996,"5min":2.0209999999999999,"15min":1.095},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":21.199999999999999,"5min":21.199999999999999,"15min":21.199999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":7.585,"5min":1.968,"15min":1.032},"min":{"1min":0.46600000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":22.437999999999999,"5min":22.437999999999999,"15min":22.437999999999999},"last":0.57899999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.3620000000000001,"5min":1.806,"15min":1.0469999999999999},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":17.844000000000001,"5min":17.844000000000001,"15min":17.844000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":7.2610000000000001,"5min":2.0910000000000002,"15min":1.2290000000000001},"min":{"1min":0.42699999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":19.690999999999999,"5min":19.690999999999999,"15min":19.690999999999999},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.7789999999999999,"5min":1.823,"15min":0.997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":17.731000000000002,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":7.0229999999999997,"5min":2.0950000000000002,"15min":1.2729999999999999},"min":{"1min":0.45700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":21.143999999999998,"5min":21.143999999999998,"15min":21.143999999999998},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":5.4710000000000001,"5min":1.4690000000000001,"15min":0.80200000000000005},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":22.465,"5min":22.465,"15min":22.465},"last":0.42599999999999999},{"interface":"front","average":{"1min":4.8609999999999998,"5min":1.373,"15min":0.79100000000000004},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":14.042999999999999,"5min":14.042999999999999,"15min":14.042999999999999},"last":0.36199999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":3.9830000000000001,"5min":1.238,"15min":0.78000000000000003},"min":{"1min":0.33600000000000002,"5min":0.307,"15min":0.307},"max":{"1min":14.117000000000001,"5min":14.117000000000001,"15min":14.117000000000001},"last":0.378},{"interface":"front","average":{"1min":5.8049999999999997,"5min":1.617,"15min":0.91900000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":22.334,"5min":22.334,"15min":22.334},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.8259999999999996,"5min":2.0169999999999999,"15min":1.0489999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":22.385000000000002,"5min":22.385000000000002,"15min":22.385000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":3.907,"5min":1.2529999999999999,"15min":0.81100000000000005},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":17.623000000000001,"5min":17.623000000000001,"15min":17.623000000000001},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56116,"kb_used_data":16620,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315724,"statfs":{"total":96636764160,"available":96579301376,"internally_reserved":0,"allocated":17018880,"data_stored":16869087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":6.2830000000000004,"5min":1.708,"15min":0.94599999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":21.954999999999998,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.97199999999999998},{"interface":"front","average":{"1min":6.2729999999999997,"5min":1.7330000000000001,"15min":0.97699999999999998},"min":{"1min":0.35599999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":21.109000000000002,"5min":21.109000000000002,"15min":21.109000000000002},"last":1.171}]},{"osd":1,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.7000000000000002,"5min":1.7889999999999999,"15min":1.304},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":16.664999999999999,"5min":16.664999999999999,"15min":16.664999999999999},"last":1.149},{"interface":"front","average":{"1min":5.1100000000000003,"5min":1.6619999999999999,"15min":1.0880000000000001},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":22.042000000000002,"5min":22.042000000000002,"15min":22.042000000000002},"last":0.373}]},{"osd":2,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.75,"5min":1.827,"15min":1.3400000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":19.658000000000001,"5min":19.658000000000001,"15min":19.658000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":4.891,"5min":1.4790000000000001,"15min":0.91000000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":21.138999999999999,"5min":21.138999999999999,"15min":21.138999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":6.1159999999999997,"5min":1.7210000000000001,"15min":0.98899999999999999},"min":{"1min":0.39200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":21.971,"5min":21.971,"15min":21.971},"last":0.39200000000000002},{"interface":"front","average":{"1min":6.274,"5min":2.1110000000000002,"15min":1.417},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":23.931000000000001,"5min":23.931000000000001,"15min":23.931000000000001},"last":1.107}]},{"osd":4,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.468,"5min":1.302,"15min":0.77400000000000002},"min":{"1min":0.29399999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":14.532999999999999,"5min":14.532999999999999,"15min":14.532999999999999},"last":1.29},{"interface":"front","average":{"1min":4.1900000000000004,"5min":1.27,"15min":0.78300000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":21.081,"5min":21.081,"15min":21.081},"last":0.317}]},{"osd":5,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":2.5649999999999999,"5min":0.94599999999999995,"15min":0.67600000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":12.946,"5min":12.946,"15min":12.946},"last":0.92900000000000005},{"interface":"front","average":{"1min":2.6429999999999998,"5min":0.97999999999999998,"15min":0.70299999999999996},"min":{"1min":0.35199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":19.597000000000001,"5min":19.597000000000001,"15min":19.597000000000001},"last":0.40699999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":2.633,"5min":1.006,"15min":0.73499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.266999999999999,"5min":11.266999999999999,"15min":11.266999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":4.2560000000000002,"5min":1.3320000000000001,"15min":0.84499999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":16.693000000000001,"5min":16.693000000000001,"15min":16.693000000000001},"last":1.0529999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76984,"kb_used_data":49968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94294856,"statfs":{"total":96636764160,"available":96557932544,"internally_reserved":0,"allocated":51167232,"data_stored":51013887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.7160000000000002,"5min":1.427,"15min":0.71199999999999997},"min":{"1min":0.245,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":23.989999999999998,"5min":23.989999999999998,"15min":23.989999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":5.024,"5min":1.3009999999999999,"15min":0.68100000000000005},"min":{"1min":0.255,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":15.622,"5min":15.622,"15min":15.622},"last":0.28899999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.6580000000000004,"5min":1.4430000000000001,"15min":0.74099999999999999},"min":{"1min":0.29899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":23.954000000000001,"5min":23.954000000000001,"15min":23.954000000000001},"last":0.311},{"interface":"front","average":{"1min":5.4690000000000003,"5min":1.4530000000000001,"15min":0.78400000000000003},"min":{"1min":0.34499999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":20.946000000000002,"5min":20.946000000000002,"15min":20.946000000000002},"last":0.33900000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.2939999999999996,"5min":1.4059999999999999,"15min":0.75800000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":27.884,"5min":27.884,"15min":27.884},"last":0.375},{"interface":"front","average":{"1min":5.6310000000000002,"5min":1.4450000000000001,"15min":0.747},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":23.018000000000001,"5min":23.018000000000001,"15min":23.018000000000001},"last":0.45300000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.2439999999999998,"5min":1.952,"15min":1.0700000000000001},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":24.044,"5min":24.044,"15min":24.044},"last":0.38900000000000001},{"interface":"front","average":{"1min":7.9050000000000002,"5min":2.0840000000000001,"15min":1.1140000000000001},"min":{"1min":0.501,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":27.940000000000001,"5min":27.940000000000001,"15min":27.940000000000001},"last":0.437}]},{"osd":5,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":8.516,"5min":2.2000000000000002,"15min":1.147},"min":{"1min":0.44,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":26.969999999999999,"5min":26.969999999999999,"15min":26.969999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":7.0430000000000001,"5min":1.923,"15min":1.0700000000000001},"min":{"1min":0.42399999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":24.018000000000001,"5min":24.018000000000001,"15min":24.018000000000001},"last":0.35599999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.899,"5min":2.0950000000000002,"15min":1.127},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":22.899999999999999,"5min":22.899999999999999,"15min":22.899999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":7.0890000000000004,"5min":1.9550000000000001,"15min":1.099},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":23.898,"5min":23.898,"15min":23.898},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.718,"5min":2.0779999999999998,"15min":1.1379999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":21.010999999999999,"5min":21.010999999999999,"15min":21.010999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":6.2210000000000001,"5min":1.7669999999999999,"15min":1.0249999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":23.053999999999998,"5min":23.053999999999998,"15min":23.053999999999998},"last":0.52800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122684,"kb_used_data":83188,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94249156,"statfs":{"total":96636764160,"available":96511135744,"internally_reserved":0,"allocated":85184512,"data_stored":85032814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":3.8849999999999998,"5min":1.0649999999999999,"15min":0.59499999999999997},"min":{"1min":0.32800000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":19.956,"5min":19.956,"15min":19.956},"last":0.218},{"interface":"front","average":{"1min":4.4450000000000003,"5min":1.2150000000000001,"15min":0.67700000000000005},"min":{"1min":0.29599999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":14.029999999999999,"5min":14.029999999999999,"15min":14.029999999999999},"last":0.27300000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":6.3410000000000002,"5min":1.627,"15min":0.84099999999999997},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":22.942,"5min":22.942,"15min":22.942},"last":0.33100000000000002},{"interface":"front","average":{"1min":2.7879999999999998,"5min":0.87,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.016,"5min":11.016,"15min":11.016},"last":0.25600000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":4.9039999999999999,"5min":1.3069999999999999,"15min":0.70699999999999996},"min":{"1min":0.35899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":19.997,"5min":19.997,"15min":19.997},"last":0.40500000000000003},{"interface":"front","average":{"1min":5.9139999999999997,"5min":1.522,"15min":0.79000000000000004},"min":{"1min":0.40400000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":17.045999999999999,"5min":17.045999999999999,"15min":17.045999999999999},"last":0.36199999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":4.484,"5min":1.786,"15min":1.3360000000000001},"min":{"1min":0.49199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":21.001000000000001,"5min":21.001000000000001,"15min":21.001000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":8.2750000000000004,"5min":2.1640000000000001,"15min":1.1459999999999999},"min":{"1min":0.46400000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.379}]},{"osd":5,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":9.8439999999999994,"5min":2.4820000000000002,"15min":1.2549999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":23.93,"5min":23.93,"15min":23.93},"last":0.51600000000000001},{"interface":"front","average":{"1min":6.6479999999999997,"5min":1.8500000000000001,"15min":1.05},"min":{"1min":0.51600000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":17.010000000000002,"5min":17.010000000000002,"15min":17.010000000000002},"last":0.44900000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":7.6139999999999999,"5min":2.0379999999999998,"15min":1.109},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":27.701000000000001,"5min":27.701000000000001,"15min":27.701000000000001},"last":0.498},{"interface":"front","average":{"1min":4.758,"5min":1.5029999999999999,"15min":0.96099999999999997},"min":{"1min":0.62,"5min":0.443,"15min":0.443},"max":{"1min":20.942,"5min":20.942,"15min":20.942},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":5.657,"5min":1.6879999999999999,"15min":1.026},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":21.030999999999999,"5min":21.030999999999999,"15min":21.030999999999999},"last":0.433},{"interface":"front","average":{"1min":7.9189999999999996,"5min":2.125,"15min":1.159},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":20.902999999999999,"5min":20.902999999999999,"15min":20.902999999999999},"last":0.47099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56116,"kb_used_data":16620,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315724,"statfs":{"total":96636764160,"available":96579301376,"internally_reserved":0,"allocated":17018880,"data_stored":16869087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":4.1100000000000003,"5min":1.1180000000000001,"15min":0.61899999999999999},"min":{"1min":0.33900000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":18.98,"5min":18.98,"15min":18.98},"last":0.36199999999999999},{"interface":"front","average":{"1min":4.9240000000000004,"5min":1.302,"15min":0.69799999999999995},"min":{"1min":0.27300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":20.966999999999999,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.32700000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":3.899,"5min":1.127,"15min":0.66500000000000004},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":20.995999999999999,"5min":20.995999999999999,"15min":20.995999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":3.6629999999999998,"5min":1.0680000000000001,"15min":0.63600000000000001},"min":{"1min":0.34499999999999997,"5min":0.307,"15min":0.307},"max":{"1min":12.052,"5min":12.052,"15min":12.052},"last":0.30599999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.0149999999999997,"5min":1.341,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":19.925999999999998,"5min":19.925999999999998,"15min":19.925999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":4.4059999999999997,"5min":1.2589999999999999,"15min":0.73499999999999999},"min":{"1min":0.373,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":20.916,"5min":20.916,"15min":20.916},"last":0.379}]},{"osd":4,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.2930000000000001,"5min":1.982,"15min":1.097},"min":{"1min":0.46600000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":19.940999999999999,"5min":19.940999999999999,"15min":19.940999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":8.3059999999999992,"5min":2.1480000000000001,"15min":1.1220000000000001},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":22.038,"5min":22.038,"15min":22.038},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":6.3300000000000001,"5min":1.8140000000000001,"15min":1.0609999999999999},"min":{"1min":0.59499999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":19.98,"5min":19.98,"15min":19.98},"last":0.53400000000000003},{"interface":"front","average":{"1min":7.8689999999999998,"5min":2.0790000000000002,"15min":1.1140000000000001},"min":{"1min":0.53500000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":21.050999999999998,"5min":21.050999999999998,"15min":21.050999999999998},"last":0.504}]},{"osd":6,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.3419999999999996,"5min":1.9910000000000001,"15min":1.099},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":22.021999999999998,"5min":22.021999999999998,"15min":22.021999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":6.9569999999999999,"5min":1.921,"15min":1.0820000000000001},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.498},"max":{"1min":19.007999999999999,"5min":19.007999999999999,"15min":19.007999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":6.8129999999999997,"5min":1.885,"15min":1.0640000000000001},"min":{"1min":0.49199999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":21.023,"5min":21.023,"15min":21.023},"last":0.61499999999999999},{"interface":"front","average":{"1min":9.3469999999999995,"5min":2.411,"15min":1.2549999999999999},"min":{"1min":0.498,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":28.928000000000001,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.57599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110200,"kb_used_data":83184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94261640,"statfs":{"total":96636764160,"available":96523919360,"internally_reserved":0,"allocated":85180416,"data_stored":85026617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.6289999999999996,"5min":1.266,"15min":0.70599999999999996},"min":{"1min":0.28399999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":23.542000000000002,"5min":23.542000000000002,"15min":23.542000000000002},"last":0.28799999999999998},{"interface":"front","average":{"1min":4.4550000000000001,"5min":1.2949999999999999,"15min":0.76800000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":20.547000000000001,"5min":20.547000000000001,"15min":20.547000000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.3869999999999996,"5min":1.2709999999999999,"15min":0.752},"min":{"1min":0.31900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":18.984999999999999,"5min":18.984999999999999,"15min":18.984999999999999},"last":0.371},{"interface":"front","average":{"1min":4.9550000000000001,"5min":1.3380000000000001,"15min":0.73499999999999999},"min":{"1min":0.32300000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":20.052,"5min":20.052,"15min":20.052},"last":0.35699999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":5.7050000000000001,"5min":1.5329999999999999,"15min":0.83799999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":20.861000000000001,"5min":20.861000000000001,"15min":20.861000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":5.0060000000000002,"5min":1.405,"15min":0.80500000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":21.984000000000002,"5min":21.984000000000002,"15min":21.984000000000002},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.6619999999999999,"5min":2.1160000000000001,"15min":1.1919999999999999},"min":{"1min":0.40300000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":22.015999999999998,"5min":22.015999999999998,"15min":22.015999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":6.4500000000000002,"5min":1.8380000000000001,"15min":1.0700000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":20.934999999999999,"5min":20.934999999999999,"15min":20.934999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.859,"5min":1.9039999999999999,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":23.474,"5min":23.474,"15min":23.474},"last":0.58799999999999997},{"interface":"front","average":{"1min":7.242,"5min":2.069,"15min":1.2070000000000001},"min":{"1min":0.441,"5min":0.376,"15min":0.376},"max":{"1min":21.975999999999999,"5min":21.975999999999999,"15min":21.975999999999999},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.9580000000000002,"5min":2.1429999999999998,"15min":1.1739999999999999},"min":{"1min":0.45400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":20.898,"5min":20.898,"15min":20.898},"last":0.60299999999999998},{"interface":"front","average":{"1min":6.3879999999999999,"5min":1.8169999999999999,"15min":1.0549999999999999},"min":{"1min":0.48799999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":23.513000000000002,"5min":23.513000000000002,"15min":23.513000000000002},"last":0.46200000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.843,"5min":2.2029999999999998,"15min":1.2629999999999999},"min":{"1min":0.432,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":22.039999999999999,"5min":22.039999999999999,"15min":22.039999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":7.2370000000000001,"5min":2.0449999999999999,"15min":1.179},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.905000000000001,"5min":20.905000000000001,"15min":20.905000000000001},"last":0.63200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53216,"kb_used_data":26200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94318624,"statfs":{"total":96636764160,"available":96582270976,"internally_reserved":0,"allocated":26828800,"data_stored":26661460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.2069999999999999,"5min":1.657,"15min":0.89900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":17.920000000000002,"5min":17.920000000000002,"15min":17.920000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":6.46,"5min":1.7130000000000001,"15min":0.92200000000000004},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":20.904,"5min":20.904,"15min":20.904},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.3390000000000004,"5min":1.7170000000000001,"15min":0.94699999999999995},"min":{"1min":0.503,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":23.911000000000001,"5min":23.911000000000001,"15min":23.911000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":6.5750000000000002,"5min":1.756,"15min":0.95299999999999996},"min":{"1min":0.375,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":21.952999999999999,"5min":21.952999999999999,"15min":21.952999999999999},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.9210000000000003,"5min":1.833,"15min":0.98499999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":21.847999999999999,"5min":21.847999999999999,"15min":21.847999999999999},"last":0.502},{"interface":"front","average":{"1min":8.0950000000000006,"5min":2.0750000000000002,"15min":1.0720000000000001},"min":{"1min":0.504,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":33.182000000000002,"5min":33.182000000000002,"15min":33.182000000000002},"last":0.438}]},{"osd":3,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.1100000000000003,"5min":1.8660000000000001,"15min":0.99199999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":17.010999999999999,"5min":17.010999999999999,"15min":17.010999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":5.5220000000000002,"5min":1.575,"15min":0.91700000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":15.022,"5min":15.022,"15min":15.022},"last":0.44800000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":4.0679999999999996,"5min":1.1919999999999999,"15min":0.71299999999999997},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":5.1680000000000001,"5min":1.4570000000000001,"15min":0.83899999999999997},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":30.946999999999999,"5min":30.946999999999999,"15min":30.946999999999999},"last":0.34499999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":5.859,"5min":1.5800000000000001,"15min":0.86699999999999999},"min":{"1min":0.42399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":15.936999999999999,"5min":15.936999999999999,"15min":15.936999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":5.0999999999999996,"5min":1.464,"15min":0.85799999999999998},"min":{"1min":0.42399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":20.937000000000001,"5min":20.937000000000001,"15min":20.937000000000001},"last":0.371}]},{"osd":7,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":4.4710000000000001,"5min":1.339,"15min":0.81699999999999995},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":12.914,"5min":12.914,"15min":12.914},"last":0.31},{"interface":"front","average":{"1min":5.6820000000000004,"5min":1.6080000000000001,"15min":0.92900000000000005},"min":{"1min":0.48999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":15.045999999999999,"5min":15.045999999999999,"15min":15.045999999999999},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52028,"kb_used_data":12532,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319812,"statfs":{"total":96636764160,"available":96583487488,"internally_reserved":0,"allocated":12832768,"data_stored":12675435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.2850000000000001,"5min":1.877,"15min":0.97499999999999998},"min":{"1min":0.34699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":27.048999999999999,"5min":27.048999999999999,"15min":27.048999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":6.5140000000000002,"5min":1.7290000000000001,"15min":0.93100000000000005},"min":{"1min":0.40100000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":20.956,"5min":20.956,"15min":20.956},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.9500000000000002,"5min":1.8089999999999999,"15min":0.95199999999999996},"min":{"1min":0.307,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":20.923999999999999,"5min":20.923999999999999,"15min":20.923999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":6.6459999999999999,"5min":1.782,"15min":0.97199999999999998},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":24.927,"5min":24.927,"15min":24.927},"last":0.35799999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.6070000000000002,"5min":1.978,"15min":1.04},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":18.602,"5min":18.602,"15min":18.602},"last":0.48299999999999998},{"interface":"front","average":{"1min":6.1580000000000004,"5min":1.722,"15min":0.98199999999999998},"min":{"1min":0.42699999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":15.946999999999999,"5min":15.946999999999999,"15min":15.946999999999999},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.8200000000000003,"5min":2.008,"15min":1.0389999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":17.782,"5min":17.782,"15min":17.782},"last":0.57999999999999996},{"interface":"front","average":{"1min":7.7779999999999996,"5min":2.0699999999999998,"15min":1.119},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":27.077000000000002,"5min":27.077000000000002,"15min":27.077000000000002},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.1859999999999999,"5min":1.214,"15min":0.71799999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":19.172999999999998,"5min":19.172999999999998,"15min":19.172999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":5.2329999999999997,"5min":1.4810000000000001,"15min":0.85599999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.693999999999999,"5min":17.693999999999999,"15min":17.693999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.056,"5min":1.6140000000000001,"15min":0.874},"min":{"1min":0.33700000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":27.103000000000002,"5min":27.103000000000002,"15min":27.103000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":4.9829999999999997,"5min":1.4399999999999999,"15min":0.84999999999999998},"min":{"1min":0.35299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":22.154,"5min":22.154,"15min":22.154},"last":0.51700000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.0890000000000004,"5min":1.2849999999999999,"15min":0.81799999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":19.253,"5min":19.253,"15min":19.253},"last":0.46700000000000003},{"interface":"front","average":{"1min":4.0060000000000002,"5min":1.238,"15min":0.77700000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":27.001000000000001,"5min":27.001000000000001,"15min":27.001000000000001},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":7854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1421312,"data_stored":1403765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1421312,"data_stored":1396653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50331648,"data_stored":50331648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37748736,"data_stored":37748736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:45:45.949 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:46.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.107+0000 7fb739c94700 1 Processor -- start 2023-08-25T04:45:46.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.107+0000 7fb739c94700 1 -- start start 2023-08-25T04:45:46.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.107+0000 7fb739c94700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb7340cc830 0x7fb7340ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:46.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb739c94700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb7340cedc0 0x7fb73406d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:46.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb739c94700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7340cbfe0 con 0x7fb7340caf10 2023-08-25T04:45:46.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb739c94700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7340cd150 con 0x7fb7340cc830 2023-08-25T04:45:46.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb739c94700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7340cb3d0 con 0x7fb7340cedc0 2023-08-25T04:45:46.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb7337fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb7340cc830 0x7fb7340ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:46.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb7337fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb7340cc830 0x7fb7340ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50288/0 (socket says 172.21.15.16:50288) 2023-08-25T04:45:46.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb7337fe700 1 -- 172.21.15.16:0/1735141203 learned_addr learned my addr 172.21.15.16:0/1735141203 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:46.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb733fff700 1 --2- 172.21.15.16:0/1735141203 >> v2:172.21.15.117:3300/0 conn(0x7fb7340cedc0 0x7fb73406d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:46.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb7337fe700 1 -- 172.21.15.16:0/1735141203 >> v2:172.21.15.117:3300/0 conn(0x7fb7340cedc0 msgr2=0x7fb73406d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:46.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb7337fe700 1 --2- 172.21.15.16:0/1735141203 >> v2:172.21.15.117:3300/0 conn(0x7fb7340cedc0 0x7fb73406d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:46.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb7337fe700 1 -- 172.21.15.16:0/1735141203 >> v1:172.21.15.117:6789/0 conn(0x7fb7340caf10 legacy=0x7fb73406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:46.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb7337fe700 1 -- 172.21.15.16:0/1735141203 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7340cb6b0 con 0x7fb7340cc830 2023-08-25T04:45:46.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb733fff700 1 --2- 172.21.15.16:0/1735141203 >> v2:172.21.15.117:3300/0 conn(0x7fb7340cedc0 0x7fb73406d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:46.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb7337fe700 1 --2- 172.21.15.16:0/1735141203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7340cc830 0x7fb7340ccc10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb7340cc780 tx=0x7fb72800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f3d8d3b4749749 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:46.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb7327fc700 1 -- 172.21.15.16:0/1735141203 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800dcf0 con 0x7fb7340cc830 2023-08-25T04:45:46.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb7327fc700 1 -- 172.21.15.16:0/1735141203 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72800de50 con 0x7fb7340cc830 2023-08-25T04:45:46.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.108+0000 7fb7327fc700 1 -- 172.21.15.16:0/1735141203 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb728004250 con 0x7fb7340cc830 2023-08-25T04:45:46.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.109+0000 7fb739c94700 1 -- 172.21.15.16:0/1735141203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7340cc830 msgr2=0x7fb7340ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:46.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.109+0000 7fb739c94700 1 --2- 172.21.15.16:0/1735141203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7340cc830 0x7fb7340ccc10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb7340cc780 tx=0x7fb72800be70 comp rx=0 tx=0).stop 2023-08-25T04:45:46.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.109+0000 7fb739c94700 1 -- 172.21.15.16:0/1735141203 shutdown_connections 2023-08-25T04:45:46.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.109+0000 7fb739c94700 1 --2- 172.21.15.16:0/1735141203 >> v2:172.21.15.117:3300/0 conn(0x7fb7340cedc0 0x7fb73406d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:46.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.109+0000 7fb739c94700 1 --2- 172.21.15.16:0/1735141203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7340cc830 0x7fb7340ccc10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:46.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.109+0000 7fb739c94700 1 -- 172.21.15.16:0/1735141203 >> 172.21.15.16:0/1735141203 conn(0x7fb7340b1a10 msgr2=0x7fb7340b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:46.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.109+0000 7fb739c94700 1 -- 172.21.15.16:0/1735141203 shutdown_connections 2023-08-25T04:45:46.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.109+0000 7fb739c94700 1 -- 172.21.15.16:0/1735141203 wait complete. 2023-08-25T04:45:46.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.110+0000 7fb739c94700 1 Processor -- start 2023-08-25T04:45:46.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.111+0000 7fb739c94700 1 -- start start 2023-08-25T04:45:46.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb739c94700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7340caf10 0x7fb73415d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:46.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb739c94700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7340cc830 0x7fb7341edea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:46.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb739c94700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7340cedc0 0x7fb734155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:46.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb739c94700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73415d000 con 0x7fb7340cedc0 2023-08-25T04:45:46.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb739c94700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7341f2ab0 con 0x7fb7340caf10 2023-08-25T04:45:46.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb739c94700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73415c9b0 con 0x7fb7340cc830 2023-08-25T04:45:46.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb733fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7340cedc0 0x7fb734155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:46.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb733fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7340cedc0 0x7fb734155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50298/0 (socket says 172.21.15.16:50298) 2023-08-25T04:45:46.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb733fff700 1 -- 172.21.15.16:0/982377788 learned_addr learned my addr 172.21.15.16:0/982377788 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:46.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb7337fe700 1 --2- 172.21.15.16:0/982377788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7340caf10 0x7fb73415d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:46.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb732ffd700 1 --2- 172.21.15.16:0/982377788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7340cc830 0x7fb7341edea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:46.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb733fff700 1 -- 172.21.15.16:0/982377788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7340cc830 msgr2=0x7fb7341edea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:46.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb733fff700 1 --2- 172.21.15.16:0/982377788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7340cc830 0x7fb7341edea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:46.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb733fff700 1 -- 172.21.15.16:0/982377788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7340caf10 msgr2=0x7fb73415d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:46.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb733fff700 1 --2- 172.21.15.16:0/982377788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7340caf10 0x7fb73415d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:46.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb733fff700 1 -- 172.21.15.16:0/982377788 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72800b7f0 con 0x7fb7340cedc0 2023-08-25T04:45:46.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb733fff700 1 --2- 172.21.15.16:0/982377788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7340cedc0 0x7fb734155e40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00cd80 tx=0x7fb72c00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:46.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb71bfff700 1 -- 172.21.15.16:0/982377788 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c003a20 con 0x7fb7340cedc0 2023-08-25T04:45:46.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb71bfff700 1 -- 172.21.15.16:0/982377788 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c003ba0 con 0x7fb7340cedc0 2023-08-25T04:45:46.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb739c94700 1 -- 172.21.15.16:0/982377788 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73415cc90 con 0x7fb7340cedc0 2023-08-25T04:45:46.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb71bfff700 1 -- 172.21.15.16:0/982377788 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c004020 con 0x7fb7340cedc0 2023-08-25T04:45:46.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.112+0000 7fb739c94700 1 -- 172.21.15.16:0/982377788 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7341ee3e0 con 0x7fb7340cedc0 2023-08-25T04:45:46.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.113+0000 7fb739c94700 1 -- 172.21.15.16:0/982377788 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73415d1b0 con 0x7fb7340cedc0 2023-08-25T04:45:46.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.114+0000 7fb71bfff700 1 -- 172.21.15.16:0/982377788 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb72c00b040 con 0x7fb7340cedc0 2023-08-25T04:45:46.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.114+0000 7fb71bfff700 1 --2- 172.21.15.16:0/982377788 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb72006a0e0 0x7fb72006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:46.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.114+0000 7fb71bfff700 1 -- 172.21.15.16:0/982377788 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb72c088a60 con 0x7fb7340cedc0 2023-08-25T04:45:46.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.114+0000 7fb7337fe700 1 --2- 172.21.15.16:0/982377788 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb72006a0e0 0x7fb72006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:46.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.115+0000 7fb7337fe700 1 --2- 172.21.15.16:0/982377788 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb72006a0e0 0x7fb72006c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb728000c00 tx=0x7fb728012000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:46.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.119+0000 7fb71bfff700 1 -- 172.21.15.16:0/982377788 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb73415d1b0 con 0x7fb7340cedc0 2023-08-25T04:45:46.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.322+0000 7fb739c94700 1 -- 172.21.15.16:0/982377788 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb73404ee70 con 0x7fb7340cedc0 2023-08-25T04:45:46.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.323+0000 7fb71bfff700 1 -- 172.21.15.16:0/982377788 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18329 (secure 0 0 0) 0x7fb72c01d090 con 0x7fb7340cedc0 2023-08-25T04:45:46.325 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:45:46.326 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:44:30.464568+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:43:40.197381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:43:41.268759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:46.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.325+0000 7fb739c94700 1 -- 172.21.15.16:0/982377788 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb72006a0e0 msgr2=0x7fb72006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.325+0000 7fb739c94700 1 --2- 172.21.15.16:0/982377788 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb72006a0e0 0x7fb72006c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb728000c00 tx=0x7fb728012000 comp rx=0 tx=0).stop 2023-08-25T04:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.325+0000 7fb739c94700 1 -- 172.21.15.16:0/982377788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7340cedc0 msgr2=0x7fb734155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.325+0000 7fb739c94700 1 --2- 172.21.15.16:0/982377788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7340cedc0 0x7fb734155e40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00cd80 tx=0x7fb72c00a560 comp rx=0 tx=0).stop 2023-08-25T04:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.325+0000 7fb739c94700 1 -- 172.21.15.16:0/982377788 shutdown_connections 2023-08-25T04:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.325+0000 7fb739c94700 1 --2- 172.21.15.16:0/982377788 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fb72006a0e0 0x7fb72006c5a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.325+0000 7fb739c94700 1 --2- 172.21.15.16:0/982377788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7340cedc0 0x7fb734155e40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.325+0000 7fb739c94700 1 --2- 172.21.15.16:0/982377788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7340caf10 0x7fb73415d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.325+0000 7fb739c94700 1 --2- 172.21.15.16:0/982377788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7340cc830 0x7fb7341edea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.325+0000 7fb739c94700 1 -- 172.21.15.16:0/982377788 >> 172.21.15.16:0/982377788 conn(0x7fb7340b1a10 msgr2=0x7fb7340cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.325+0000 7fb739c94700 1 -- 172.21.15.16:0/982377788 shutdown_connections 2023-08-25T04:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:46.325+0000 7fb739c94700 1 -- 172.21.15.16:0/982377788 wait complete. 2023-08-25T04:45:47.340 INFO:tasks.ceph:Scrubbing osd.0 2023-08-25T04:45:47.341 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-08-25T04:45:47.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.485+0000 7fe9f3d6e700 1 Processor -- start 2023-08-25T04:45:47.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.485+0000 7fe9f3d6e700 1 -- start start 2023-08-25T04:45:47.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.486+0000 7fe9f3d6e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe9ec0cf200 0x7fe9ec06a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.486+0000 7fe9f3d6e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe9ec0cc470 0x7fe9ec06a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.486+0000 7fe9f3d6e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec0cfc60 con 0x7fe9ec15d200 2023-08-25T04:45:47.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.486+0000 7fe9f3d6e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec1613c0 con 0x7fe9ec0cf200 2023-08-25T04:45:47.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.486+0000 7fe9f3d6e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec0cf6a0 con 0x7fe9ec0cc470 2023-08-25T04:45:47.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.486+0000 7fe9f1309700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe9ec0cf200 0x7fe9ec06a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.486+0000 7fe9f1b0a700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe9ec15d200 0x7fe9ec1617e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40716/0 (socket says 172.21.15.16:40716) 2023-08-25T04:45:47.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.486+0000 7fe9f1b0a700 1 -- 172.21.15.16:0/1622686297 learned_addr learned my addr 172.21.15.16:0/1622686297 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:47.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.486+0000 7fe9f230b700 1 --2- 172.21.15.16:0/1622686297 >> v2:172.21.15.117:3300/0 conn(0x7fe9ec0cc470 0x7fe9ec06a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.486+0000 7fe9f1309700 1 -- 172.21.15.16:0/1622686297 >> v2:172.21.15.117:3300/0 conn(0x7fe9ec0cc470 msgr2=0x7fe9ec06a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:47.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.486+0000 7fe9f1309700 1 --2- 172.21.15.16:0/1622686297 >> v2:172.21.15.117:3300/0 conn(0x7fe9ec0cc470 0x7fe9ec06a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.486+0000 7fe9f1309700 1 -- 172.21.15.16:0/1622686297 >> v1:172.21.15.16:6789/0 conn(0x7fe9ec15d200 legacy=0x7fe9ec1617e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:47.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.486+0000 7fe9f1309700 1 -- 172.21.15.16:0/1622686297 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec0cf980 con 0x7fe9ec0cf200 2023-08-25T04:45:47.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.486+0000 7fe9f0b08700 1 -- 172.21.15.16:0/1622686297 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133867237 0 0) 0x7fe9ec0cfc60 con 0x7fe9ec15d200 2023-08-25T04:45:47.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.487+0000 7fe9f1309700 1 --2- 172.21.15.16:0/1622686297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9ec0cf200 0x7fe9ec06a340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0715b0 tx=0x7fe9e8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbff11cc5dd998a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:47.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.487+0000 7fe9f0b08700 1 -- 172.21.15.16:0/1622686297 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8011830 con 0x7fe9ec0cf200 2023-08-25T04:45:47.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.487+0000 7fe9f0b08700 1 -- 172.21.15.16:0/1622686297 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e8011990 con 0x7fe9ec0cf200 2023-08-25T04:45:47.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.487+0000 7fe9f0b08700 1 -- 172.21.15.16:0/1622686297 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8011d20 con 0x7fe9ec0cf200 2023-08-25T04:45:47.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.487+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/1622686297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9ec0cf200 msgr2=0x7fe9ec06a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:47.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.487+0000 7fe9f3d6e700 1 --2- 172.21.15.16:0/1622686297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9ec0cf200 0x7fe9ec06a340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0715b0 tx=0x7fe9e8009b20 comp rx=0 tx=0).stop 2023-08-25T04:45:47.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.487+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/1622686297 shutdown_connections 2023-08-25T04:45:47.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.487+0000 7fe9f3d6e700 1 --2- 172.21.15.16:0/1622686297 >> v2:172.21.15.117:3300/0 conn(0x7fe9ec0cc470 0x7fe9ec06a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.487+0000 7fe9f3d6e700 1 --2- 172.21.15.16:0/1622686297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9ec0cf200 0x7fe9ec06a340 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.487+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/1622686297 >> 172.21.15.16:0/1622686297 conn(0x7fe9ec0cc940 msgr2=0x7fe9ec0ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:47.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.488+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/1622686297 shutdown_connections 2023-08-25T04:45:47.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.488+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/1622686297 wait complete. 2023-08-25T04:45:47.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.489+0000 7fe9f3d6e700 1 Processor -- start 2023-08-25T04:45:47.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.489+0000 7fe9f3d6e700 1 -- start start 2023-08-25T04:45:47.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.490+0000 7fe9f3d6e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9ec0cc470 0x7fe9ec0cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.490+0000 7fe9f3d6e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9ec0cf200 0x7fe9ec0aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.490+0000 7fe9f3d6e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9ec15d200 0x7fe9ec15b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.490+0000 7fe9f3d6e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0b0110 con 0x7fe9ec0cf200 2023-08-25T04:45:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.490+0000 7fe9f3d6e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0af260 con 0x7fe9ec15d200 2023-08-25T04:45:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.490+0000 7fe9f3d6e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0af500 con 0x7fe9ec0cc470 2023-08-25T04:45:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.490+0000 7fe9f1309700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9ec0cf200 0x7fe9ec0aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.490+0000 7fe9f1309700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9ec0cf200 0x7fe9ec0aed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50310/0 (socket says 172.21.15.16:50310) 2023-08-25T04:45:47.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.490+0000 7fe9f1309700 1 -- 172.21.15.16:0/3672405695 learned_addr learned my addr 172.21.15.16:0/3672405695 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:47.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.491+0000 7fe9f1b0a700 1 --2- 172.21.15.16:0/3672405695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9ec0cc470 0x7fe9ec0cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.491+0000 7fe9f230b700 1 --2- 172.21.15.16:0/3672405695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9ec15d200 0x7fe9ec15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.491+0000 7fe9f1309700 1 -- 172.21.15.16:0/3672405695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9ec0cc470 msgr2=0x7fe9ec0cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:47.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.491+0000 7fe9f1309700 1 --2- 172.21.15.16:0/3672405695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9ec0cc470 0x7fe9ec0cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.491+0000 7fe9f1309700 1 -- 172.21.15.16:0/3672405695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9ec15d200 msgr2=0x7fe9ec15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:47.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.491+0000 7fe9f1309700 1 --2- 172.21.15.16:0/3672405695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9ec15d200 0x7fe9ec15b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.491+0000 7fe9f1309700 1 -- 172.21.15.16:0/3672405695 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e80094a0 con 0x7fe9ec0cf200 2023-08-25T04:45:47.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.491+0000 7fe9f1309700 1 --2- 172.21.15.16:0/3672405695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9ec0cf200 0x7fe9ec0aed20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8014040 tx=0x7fe9e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:47.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.491+0000 7fe9e27fc700 1 -- 172.21.15.16:0/3672405695 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80036a0 con 0x7fe9ec0cf200 2023-08-25T04:45:47.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.491+0000 7fe9e27fc700 1 -- 172.21.15.16:0/3672405695 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e801e070 con 0x7fe9ec0cf200 2023-08-25T04:45:47.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.491+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/3672405695 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec0af7e0 con 0x7fe9ec0cf200 2023-08-25T04:45:47.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.491+0000 7fe9e27fc700 1 -- 172.21.15.16:0/3672405695 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8003a60 con 0x7fe9ec0cf200 2023-08-25T04:45:47.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.491+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/3672405695 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec0afda0 con 0x7fe9ec0cf200 2023-08-25T04:45:47.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.492+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/3672405695 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe9ec160fe0 con 0x7fe9ec0cf200 2023-08-25T04:45:47.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.492+0000 7fe9e27fc700 1 -- 172.21.15.16:0/3672405695 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe9e8003bc0 con 0x7fe9ec0cf200 2023-08-25T04:45:47.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.493+0000 7fe9e27fc700 1 --2- 172.21.15.16:0/3672405695 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe9d006a0e0 0x7fe9d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.493+0000 7fe9e27fc700 1 -- 172.21.15.16:0/3672405695 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe9e80892b0 con 0x7fe9ec0cf200 2023-08-25T04:45:47.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.493+0000 7fe9e27fc700 1 --2- 172.21.15.16:0/3672405695 >> [v2:172.21.15.16:6809/1681052994,v1:172.21.15.16:6810/1681052994] conn(0x7fe9d00729e0 0x7fe9d0074e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.493+0000 7fe9e27fc700 1 -- 172.21.15.16:0/3672405695 --> [v2:172.21.15.16:6809/1681052994,v1:172.21.15.16:6810/1681052994] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9d00754f0 con 0x7fe9d00729e0 2023-08-25T04:45:47.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.493+0000 7fe9e27fc700 1 -- 172.21.15.16:0/3672405695 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9e808b970 con 0x7fe9ec0cf200 2023-08-25T04:45:47.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.493+0000 7fe9f1b0a700 1 --2- 172.21.15.16:0/3672405695 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe9d006a0e0 0x7fe9d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.493+0000 7fe9f230b700 1 --2- 172.21.15.16:0/3672405695 >> [v2:172.21.15.16:6809/1681052994,v1:172.21.15.16:6810/1681052994] conn(0x7fe9d00729e0 0x7fe9d0074e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.494+0000 7fe9f230b700 1 --2- 172.21.15.16:0/3672405695 >> [v2:172.21.15.16:6809/1681052994,v1:172.21.15.16:6810/1681052994] conn(0x7fe9d00729e0 0x7fe9d0074e20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:47.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.494+0000 7fe9f1b0a700 1 --2- 172.21.15.16:0/3672405695 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe9d006a0e0 0x7fe9d006c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc007fd0 tx=0x7fe9dc007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:47.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.494+0000 7fe9e27fc700 1 -- 172.21.15.16:0/3672405695 <== osd.0 v2:172.21.15.16:6809/1681052994 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe9d00754f0 con 0x7fe9d00729e0 2023-08-25T04:45:47.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.509+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/3672405695 --> [v2:172.21.15.16:6809/1681052994,v1:172.21.15.16:6810/1681052994] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe9ec0746c0 con 0x7fe9d00729e0 2023-08-25T04:45:47.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.509+0000 7fe9e27fc700 1 -- 172.21.15.16:0/3672405695 <== osd.0 v2:172.21.15.16:6809/1681052994 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe9ec0746c0 con 0x7fe9d00729e0 2023-08-25T04:45:47.517 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-08-25T04:45:47.518 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T04:45:47.518 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-08-25T04:45:47.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.510+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/3672405695 >> [v2:172.21.15.16:6809/1681052994,v1:172.21.15.16:6810/1681052994] conn(0x7fe9d00729e0 msgr2=0x7fe9d0074e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:47.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.510+0000 7fe9f3d6e700 1 --2- 172.21.15.16:0/3672405695 >> [v2:172.21.15.16:6809/1681052994,v1:172.21.15.16:6810/1681052994] conn(0x7fe9d00729e0 0x7fe9d0074e20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.510+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/3672405695 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe9d006a0e0 msgr2=0x7fe9d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:47.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.510+0000 7fe9f3d6e700 1 --2- 172.21.15.16:0/3672405695 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe9d006a0e0 0x7fe9d006c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc007fd0 tx=0x7fe9dc007de0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.510+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/3672405695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9ec0cf200 msgr2=0x7fe9ec0aed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:47.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.510+0000 7fe9f3d6e700 1 --2- 172.21.15.16:0/3672405695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9ec0cf200 0x7fe9ec0aed20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8014040 tx=0x7fe9e8004750 comp rx=0 tx=0).stop 2023-08-25T04:45:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.510+0000 7fe9f230b700 1 -- 172.21.15.16:0/3672405695 reap_dead start 2023-08-25T04:45:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.510+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/3672405695 shutdown_connections 2023-08-25T04:45:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.510+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/3672405695 >> 172.21.15.16:0/3672405695 conn(0x7fe9ec0cc940 msgr2=0x7fe9ec1616e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.510+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/3672405695 shutdown_connections 2023-08-25T04:45:47.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.510+0000 7fe9f3d6e700 1 -- 172.21.15.16:0/3672405695 wait complete. 2023-08-25T04:45:47.523 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-08-25T04:45:47.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.648+0000 7f7489586700 1 Processor -- start 2023-08-25T04:45:47.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.648+0000 7f7489586700 1 -- start start 2023-08-25T04:45:47.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.648+0000 7f7489586700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f74840b4080 0x7f7484167fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.648+0000 7f7489586700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74840b2be0 con 0x7f74840d3dc0 2023-08-25T04:45:47.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.648+0000 7f7489586700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74840d1b00 con 0x7f748415d520 2023-08-25T04:45:47.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.648+0000 7f7489586700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74840ce6f0 con 0x7f74840b4080 2023-08-25T04:45:47.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f74827fc700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f74840d3dc0 0x7f74840d13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40734/0 (socket says 172.21.15.16:40734) 2023-08-25T04:45:47.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f74827fc700 1 -- 172.21.15.16:0/395156204 learned_addr learned my addr 172.21.15.16:0/395156204 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:47.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f74837fe700 1 --2- 172.21.15.16:0/395156204 >> v2:172.21.15.117:3300/0 conn(0x7f74840b4080 0x7f7484167fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 -- 172.21.15.16:0/395156204 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685945651 0 0) 0x7f74840b2be0 con 0x7f74840d3dc0 2023-08-25T04:45:47.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 -- 172.21.15.16:0/395156204 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f746c0035b0 con 0x7f74840d3dc0 2023-08-25T04:45:47.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 -- 172.21.15.16:0/395156204 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1454789656 0 0) 0x7f746c0035b0 con 0x7f74840d3dc0 2023-08-25T04:45:47.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 -- 172.21.15.16:0/395156204 >> v2:172.21.15.117:3300/0 conn(0x7f74840b4080 msgr2=0x7f7484167fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:47.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 --2- 172.21.15.16:0/395156204 >> v2:172.21.15.117:3300/0 conn(0x7f74840b4080 0x7f7484167fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 -- 172.21.15.16:0/395156204 >> v1:172.21.15.117:6789/0 conn(0x7f748415d520 legacy=0x7f74840d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:47.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 -- 172.21.15.16:0/395156204 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74840d0a40 con 0x7f74840d3dc0 2023-08-25T04:45:47.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 -- 172.21.15.16:0/395156204 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f7478001670 con 0x7f74840d3dc0 2023-08-25T04:45:47.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 -- 172.21.15.16:0/395156204 >> v1:172.21.15.16:6789/0 conn(0x7f74840d3dc0 legacy=0x7f74840d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:47.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 --2- 172.21.15.16:0/395156204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f746c003a70 0x7f746c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 --2- 172.21.15.16:0/395156204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f746c004850 0x7f746c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 --2- 172.21.15.16:0/395156204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f746c005210 0x7f746c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 -- 172.21.15.16:0/395156204 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74840ce6f0 con 0x7f746c003a70 2023-08-25T04:45:47.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 -- 172.21.15.16:0/395156204 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c00c090 con 0x7f746c005210 2023-08-25T04:45:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7481ffb700 1 -- 172.21.15.16:0/395156204 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746c00c250 con 0x7f746c004850 2023-08-25T04:45:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f7482ffd700 1 --2- 172.21.15.16:0/395156204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f746c003a70 0x7f746c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f74827fc700 1 --2- 172.21.15.16:0/395156204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f746c004850 0x7f746c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.649+0000 7f74837fe700 1 --2- 172.21.15.16:0/395156204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f746c005210 0x7f746c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f7482ffd700 1 -- 172.21.15.16:0/395156204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f746c004850 msgr2=0x7f746c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f7482ffd700 1 --2- 172.21.15.16:0/395156204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f746c004850 0x7f746c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f7482ffd700 1 -- 172.21.15.16:0/395156204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f746c005210 msgr2=0x7f746c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f7482ffd700 1 --2- 172.21.15.16:0/395156204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f746c005210 0x7f746c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f74837fe700 1 -- 172.21.15.16:0/395156204 reap_dead start 2023-08-25T04:45:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f7482ffd700 1 -- 172.21.15.16:0/395156204 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c0035b0 con 0x7f746c003a70 2023-08-25T04:45:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f7482ffd700 1 --2- 172.21.15.16:0/395156204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f746c003a70 0x7f746c003e50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f74740018d0 tx=0x7f746c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58e11a70e1c4648 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f7481ffb700 1 -- 172.21.15.16:0/395156204 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740052d0 con 0x7f746c003a70 2023-08-25T04:45:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f7481ffb700 1 -- 172.21.15.16:0/395156204 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7474005430 con 0x7f746c003a70 2023-08-25T04:45:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f7481ffb700 1 -- 172.21.15.16:0/395156204 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740038c0 con 0x7f746c003a70 2023-08-25T04:45:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f7489586700 1 -- 172.21.15.16:0/395156204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f746c003a70 msgr2=0x7f746c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f7489586700 1 --2- 172.21.15.16:0/395156204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f746c003a70 0x7f746c003e50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f74740018d0 tx=0x7f746c005880 comp rx=0 tx=0).stop 2023-08-25T04:45:47.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f7489586700 1 -- 172.21.15.16:0/395156204 shutdown_connections 2023-08-25T04:45:47.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f7489586700 1 --2- 172.21.15.16:0/395156204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f746c003a70 0x7f746c003e50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.650+0000 7f7489586700 1 -- 172.21.15.16:0/395156204 >> 172.21.15.16:0/395156204 conn(0x7f74840d3110 msgr2=0x7f74840d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:47.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.651+0000 7f7489586700 1 -- 172.21.15.16:0/395156204 shutdown_connections 2023-08-25T04:45:47.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.651+0000 7f7489586700 1 -- 172.21.15.16:0/395156204 wait complete. 2023-08-25T04:45:47.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.652+0000 7f7489586700 1 Processor -- start 2023-08-25T04:45:47.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.652+0000 7f7489586700 1 -- start start 2023-08-25T04:45:47.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7489586700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f746c003a70 0x7f74840b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7489586700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74841538d0 0x7f74840b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7489586700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74840b5480 0x7f74841f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7489586700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74840b18a0 con 0x7f746c003a70 2023-08-25T04:45:47.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7489586700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74840b5900 con 0x7f74840b5480 2023-08-25T04:45:47.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7489586700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74840b1220 con 0x7f74841538d0 2023-08-25T04:45:47.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7482ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f746c003a70 0x7f74840b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7482ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f746c003a70 0x7f74840b1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50330/0 (socket says 172.21.15.16:50330) 2023-08-25T04:45:47.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7482ffd700 1 -- 172.21.15.16:0/86626012 learned_addr learned my addr 172.21.15.16:0/86626012 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:47.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f74837fe700 1 --2- 172.21.15.16:0/86626012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74840b5480 0x7f74841f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f74827fc700 1 --2- 172.21.15.16:0/86626012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74841538d0 0x7f74840b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7482ffd700 1 -- 172.21.15.16:0/86626012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74841538d0 msgr2=0x7f74840b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:47.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7482ffd700 1 --2- 172.21.15.16:0/86626012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74841538d0 0x7f74840b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7482ffd700 1 -- 172.21.15.16:0/86626012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74840b5480 msgr2=0x7f74841f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:47.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7482ffd700 1 --2- 172.21.15.16:0/86626012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74840b5480 0x7f74841f2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7482ffd700 1 -- 172.21.15.16:0/86626012 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74841f3800 con 0x7f746c003a70 2023-08-25T04:45:47.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7482ffd700 1 --2- 172.21.15.16:0/86626012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f746c003a70 0x7f74840b1cc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f746c00c060 tx=0x7f7474001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:47.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f746b7fe700 1 -- 172.21.15.16:0/86626012 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400c690 con 0x7f746c003a70 2023-08-25T04:45:47.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f746b7fe700 1 -- 172.21.15.16:0/86626012 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747400c7f0 con 0x7f746c003a70 2023-08-25T04:45:47.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7489586700 1 -- 172.21.15.16:0/86626012 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74841f3520 con 0x7f746c003a70 2023-08-25T04:45:47.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f746b7fe700 1 -- 172.21.15.16:0/86626012 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400cb60 con 0x7f746c003a70 2023-08-25T04:45:47.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.653+0000 7f7489586700 1 -- 172.21.15.16:0/86626012 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7484153d50 con 0x7f746c003a70 2023-08-25T04:45:47.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.654+0000 7f7489586700 1 -- 172.21.15.16:0/86626012 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74840b1b10 con 0x7f746c003a70 2023-08-25T04:45:47.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.655+0000 7f746b7fe700 1 -- 172.21.15.16:0/86626012 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f747400ccc0 con 0x7f746c003a70 2023-08-25T04:45:47.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.655+0000 7f746b7fe700 1 --2- 172.21.15.16:0/86626012 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f747006a0e0 0x7f747006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:47.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.656+0000 7f746b7fe700 1 -- 172.21.15.16:0/86626012 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7474089500 con 0x7f746c003a70 2023-08-25T04:45:47.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.656+0000 7f74827fc700 1 --2- 172.21.15.16:0/86626012 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f747006a0e0 0x7f747006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:47.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.656+0000 7f74827fc700 1 --2- 172.21.15.16:0/86626012 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f747006a0e0 0x7f747006c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7478000c00 tx=0x7f7478009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:47.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.660+0000 7f746b7fe700 1 -- 172.21.15.16:0/86626012 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7474054bc0 con 0x7f746c003a70 2023-08-25T04:45:47.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.859+0000 7f7489586700 1 -- 172.21.15.16:0/86626012 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f74840ce900 con 0x7f747006a0e0 2023-08-25T04:45:47.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.859+0000 7f746b7fe700 1 -- 172.21.15.16:0/86626012 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7478004d10 con 0x7f747006a0e0 2023-08-25T04:45:47.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.861+0000 7f7489586700 1 -- 172.21.15.16:0/86626012 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f747006a0e0 msgr2=0x7f747006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:47.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.861+0000 7f7489586700 1 --2- 172.21.15.16:0/86626012 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f747006a0e0 0x7f747006c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7478000c00 tx=0x7f7478009040 comp rx=0 tx=0).stop 2023-08-25T04:45:47.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.861+0000 7f7489586700 1 -- 172.21.15.16:0/86626012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f746c003a70 msgr2=0x7f74840b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:47.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.861+0000 7f7489586700 1 --2- 172.21.15.16:0/86626012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f746c003a70 0x7f74840b1cc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f746c00c060 tx=0x7f7474001230 comp rx=0 tx=0).stop 2023-08-25T04:45:47.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.861+0000 7f7489586700 1 -- 172.21.15.16:0/86626012 shutdown_connections 2023-08-25T04:45:47.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.861+0000 7f7489586700 1 --2- 172.21.15.16:0/86626012 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f747006a0e0 0x7f747006c5a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.861+0000 7f7489586700 1 --2- 172.21.15.16:0/86626012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74840b5480 0x7f74841f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.861+0000 7f7489586700 1 --2- 172.21.15.16:0/86626012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f746c003a70 0x7f74840b1cc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.861+0000 7f7489586700 1 --2- 172.21.15.16:0/86626012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74841538d0 0x7f74840b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.862+0000 7f7489586700 1 -- 172.21.15.16:0/86626012 >> 172.21.15.16:0/86626012 conn(0x7f74840d3110 msgr2=0x7f748415b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.862+0000 7f7489586700 1 -- 172.21.15.16:0/86626012 shutdown_connections 2023-08-25T04:45:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:47.862+0000 7f7489586700 1 -- 172.21.15.16:0/86626012 wait complete. 2023-08-25T04:45:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 0 to deep-scrub 2023-08-25T04:45:47.875 INFO:tasks.ceph:Scrubbing osd.1 2023-08-25T04:45:47.876 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-08-25T04:45:48.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.005+0000 7f1c18756700 1 Processor -- start 2023-08-25T04:45:48.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.005+0000 7f1c18756700 1 -- start start 2023-08-25T04:45:48.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.006+0000 7f1c18756700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1c1015a3c0 0x7f1c100ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.006+0000 7f1c18756700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c100cbc50 con 0x7f1c1006f6a0 2023-08-25T04:45:48.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.006+0000 7f1c18756700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1015a7a0 con 0x7f1c100cc0e0 2023-08-25T04:45:48.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.006+0000 7f1c18756700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c100ce740 con 0x7f1c1015a3c0 2023-08-25T04:45:48.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.006+0000 7f1c15cf1700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1c1006f6a0 0x7f1c100b2fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40754/0 (socket says 172.21.15.16:40754) 2023-08-25T04:45:48.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c15cf1700 1 -- 172.21.15.16:0/1553683855 learned_addr learned my addr 172.21.15.16:0/1553683855 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:48.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c164f2700 1 --2- 172.21.15.16:0/1553683855 >> v2:172.21.15.117:3300/0 conn(0x7f1c1015a3c0 0x7f1c100ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 -- 172.21.15.16:0/1553683855 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926248263 0 0) 0x7f1c100cbc50 con 0x7f1c1006f6a0 2023-08-25T04:45:48.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 -- 172.21.15.16:0/1553683855 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bfc0035b0 con 0x7f1c1006f6a0 2023-08-25T04:45:48.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 -- 172.21.15.16:0/1553683855 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2950363602 0 0) 0x7f1bfc0035b0 con 0x7f1c1006f6a0 2023-08-25T04:45:48.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 -- 172.21.15.16:0/1553683855 >> v2:172.21.15.117:3300/0 conn(0x7f1c1015a3c0 msgr2=0x7f1c100ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:48.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 --2- 172.21.15.16:0/1553683855 >> v2:172.21.15.117:3300/0 conn(0x7f1c1015a3c0 0x7f1c100ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 -- 172.21.15.16:0/1553683855 >> v1:172.21.15.117:6789/0 conn(0x7f1c100cc0e0 legacy=0x7f1c1006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 -- 172.21.15.16:0/1553683855 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100cea20 con 0x7f1c1006f6a0 2023-08-25T04:45:48.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 -- 172.21.15.16:0/1553683855 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f1c0c001670 con 0x7f1c1006f6a0 2023-08-25T04:45:48.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 -- 172.21.15.16:0/1553683855 >> v1:172.21.15.16:6789/0 conn(0x7f1c1006f6a0 legacy=0x7f1c100b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 --2- 172.21.15.16:0/1553683855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bfc003a00 0x7f1bfc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 --2- 172.21.15.16:0/1553683855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bfc004850 0x7f1bfc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 --2- 172.21.15.16:0/1553683855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc005210 0x7f1bfc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 -- 172.21.15.16:0/1553683855 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100ce740 con 0x7f1bfc005210 2023-08-25T04:45:48.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 -- 172.21.15.16:0/1553683855 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc00c0b0 con 0x7f1bfc003a00 2023-08-25T04:45:48.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c154f0700 1 -- 172.21.15.16:0/1553683855 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc00c270 con 0x7f1bfc004850 2023-08-25T04:45:48.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c16cf3700 1 --2- 172.21.15.16:0/1553683855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc005210 0x7f1bfc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c164f2700 1 --2- 172.21.15.16:0/1553683855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bfc003a00 0x7f1bfc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.007+0000 7f1c15cf1700 1 --2- 172.21.15.16:0/1553683855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bfc004850 0x7f1bfc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.008+0000 7f1c16cf3700 1 -- 172.21.15.16:0/1553683855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bfc004850 msgr2=0x7f1bfc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:48.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.008+0000 7f1c16cf3700 1 --2- 172.21.15.16:0/1553683855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bfc004850 0x7f1bfc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.008+0000 7f1c16cf3700 1 -- 172.21.15.16:0/1553683855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bfc003a00 msgr2=0x7f1bfc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:48.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.008+0000 7f1c16cf3700 1 --2- 172.21.15.16:0/1553683855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bfc003a00 0x7f1bfc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.008+0000 7f1c16cf3700 1 -- 172.21.15.16:0/1553683855 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc0035b0 con 0x7f1bfc005210 2023-08-25T04:45:48.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.008+0000 7f1c16cf3700 1 -- 172.21.15.16:0/1553683855 reap_dead start 2023-08-25T04:45:48.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.008+0000 7f1c16cf3700 1 --2- 172.21.15.16:0/1553683855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc005210 0x7f1bfc00ba10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800c190 tx=0x7f1bfc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd18e0f90453d5d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.008+0000 7f1c154f0700 1 -- 172.21.15.16:0/1553683855 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c08001db0 con 0x7f1bfc005210 2023-08-25T04:45:48.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.008+0000 7f1c154f0700 1 -- 172.21.15.16:0/1553683855 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0800ccf0 con 0x7f1bfc005210 2023-08-25T04:45:48.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.008+0000 7f1c154f0700 1 -- 172.21.15.16:0/1553683855 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c08003c40 con 0x7f1bfc005210 2023-08-25T04:45:48.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.008+0000 7f1c18756700 1 -- 172.21.15.16:0/1553683855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc005210 msgr2=0x7f1bfc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.008+0000 7f1c18756700 1 --2- 172.21.15.16:0/1553683855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc005210 0x7f1bfc00ba10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800c190 tx=0x7f1bfc005880 comp rx=0 tx=0).stop 2023-08-25T04:45:48.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.009+0000 7f1c18756700 1 -- 172.21.15.16:0/1553683855 shutdown_connections 2023-08-25T04:45:48.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.009+0000 7f1c18756700 1 --2- 172.21.15.16:0/1553683855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc005210 0x7f1bfc00ba10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.009+0000 7f1c18756700 1 -- 172.21.15.16:0/1553683855 >> 172.21.15.16:0/1553683855 conn(0x7f1c100b1cb0 msgr2=0x7f1c100b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:48.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.009+0000 7f1c18756700 1 -- 172.21.15.16:0/1553683855 shutdown_connections 2023-08-25T04:45:48.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.009+0000 7f1c18756700 1 -- 172.21.15.16:0/1553683855 wait complete. 2023-08-25T04:45:48.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.010+0000 7f1c18756700 1 Processor -- start 2023-08-25T04:45:48.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.010+0000 7f1c18756700 1 -- start start 2023-08-25T04:45:48.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c18756700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bfc005210 0x7f1c10154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c18756700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c10152580 0x7f1c10152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c18756700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c10153030 0x7f1c101534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c18756700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10150a60 con 0x7f1c10152580 2023-08-25T04:45:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c18756700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10150450 con 0x7f1bfc005210 2023-08-25T04:45:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c18756700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10155290 con 0x7f1c10153030 2023-08-25T04:45:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c15cf1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c10152580 0x7f1c10152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c15cf1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c10152580 0x7f1c10152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50352/0 (socket says 172.21.15.16:50352) 2023-08-25T04:45:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c15cf1700 1 -- 172.21.15.16:0/575572391 learned_addr learned my addr 172.21.15.16:0/575572391 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c164f2700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bfc005210 0x7f1c10154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c16cf3700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c10153030 0x7f1c101534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c15cf1700 1 -- 172.21.15.16:0/575572391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c10153030 msgr2=0x7f1c101534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c15cf1700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c10153030 0x7f1c101534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c15cf1700 1 -- 172.21.15.16:0/575572391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bfc005210 msgr2=0x7f1c10154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c15cf1700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bfc005210 0x7f1c10154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c15cf1700 1 -- 172.21.15.16:0/575572391 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c10155570 con 0x7f1c10152580 2023-08-25T04:45:48.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c16cf3700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c10153030 0x7f1c101534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:48.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c15cf1700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c10152580 0x7f1c10152af0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0072c0 tx=0x7f1c0c007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c06ffd700 1 -- 172.21.15.16:0/575572391 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c0077a0 con 0x7f1c10152580 2023-08-25T04:45:48.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c06ffd700 1 -- 172.21.15.16:0/575572391 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c00f8d0 con 0x7f1c10152580 2023-08-25T04:45:48.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c18756700 1 -- 172.21.15.16:0/575572391 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c101506f0 con 0x7f1c10152580 2023-08-25T04:45:48.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c06ffd700 1 -- 172.21.15.16:0/575572391 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00fc80 con 0x7f1c10152580 2023-08-25T04:45:48.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.011+0000 7f1c18756700 1 -- 172.21.15.16:0/575572391 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c100c7280 con 0x7f1c10152580 2023-08-25T04:45:48.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.012+0000 7f1c18756700 1 -- 172.21.15.16:0/575572391 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c100cb8e0 con 0x7f1c10152580 2023-08-25T04:45:48.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.013+0000 7f1c06ffd700 1 -- 172.21.15.16:0/575572391 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1c0c01d460 con 0x7f1c10152580 2023-08-25T04:45:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.013+0000 7f1c06ffd700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1bf406a0e0 0x7f1bf406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.013+0000 7f1c06ffd700 1 -- 172.21.15.16:0/575572391 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1c0c088600 con 0x7f1c10152580 2023-08-25T04:45:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.013+0000 7f1c06ffd700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.16:6800/3011235108,v1:172.21.15.16:6801/3011235108] conn(0x7f1bf40729e0 0x7f1bf4074e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.013+0000 7f1c06ffd700 1 -- 172.21.15.16:0/575572391 --> [v2:172.21.15.16:6800/3011235108,v1:172.21.15.16:6801/3011235108] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1bf40754f0 con 0x7f1bf40729e0 2023-08-25T04:45:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.013+0000 7f1c164f2700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1bf406a0e0 0x7f1bf406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.013+0000 7f1c06ffd700 1 -- 172.21.15.16:0/575572391 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c0c08acc0 con 0x7f1c10152580 2023-08-25T04:45:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.014+0000 7f1c16cf3700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.16:6800/3011235108,v1:172.21.15.16:6801/3011235108] conn(0x7f1bf40729e0 0x7f1bf4074e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.014+0000 7f1c16cf3700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.16:6800/3011235108,v1:172.21.15.16:6801/3011235108] conn(0x7f1bf40729e0 0x7f1bf4074e20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.014+0000 7f1c164f2700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1bf406a0e0 0x7f1bf406c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009b20 tx=0x7f1c00009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.014+0000 7f1c06ffd700 1 -- 172.21.15.16:0/575572391 <== osd.1 v2:172.21.15.16:6800/3011235108 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1bf40754f0 con 0x7f1bf40729e0 2023-08-25T04:45:48.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.029+0000 7f1c18756700 1 -- 172.21.15.16:0/575572391 --> [v2:172.21.15.16:6800/3011235108,v1:172.21.15.16:6801/3011235108] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1c100cb600 con 0x7f1bf40729e0 2023-08-25T04:45:48.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.029+0000 7f1c06ffd700 1 -- 172.21.15.16:0/575572391 <== osd.1 v2:172.21.15.16:6800/3011235108 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1c08001cd0 con 0x7f1bf40729e0 2023-08-25T04:45:48.031 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-08-25T04:45:48.031 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T04:45:48.031 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-08-25T04:45:48.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.030+0000 7f1c18756700 1 -- 172.21.15.16:0/575572391 >> [v2:172.21.15.16:6800/3011235108,v1:172.21.15.16:6801/3011235108] conn(0x7f1bf40729e0 msgr2=0x7f1bf4074e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.030+0000 7f1c18756700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.16:6800/3011235108,v1:172.21.15.16:6801/3011235108] conn(0x7f1bf40729e0 0x7f1bf4074e20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.030+0000 7f1c18756700 1 -- 172.21.15.16:0/575572391 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1bf406a0e0 msgr2=0x7f1bf406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.030+0000 7f1c18756700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f1bf406a0e0 0x7f1bf406c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009b20 tx=0x7f1c00009210 comp rx=0 tx=0).stop 2023-08-25T04:45:48.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.030+0000 7f1c18756700 1 -- 172.21.15.16:0/575572391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c10152580 msgr2=0x7f1c10152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.030+0000 7f1c18756700 1 --2- 172.21.15.16:0/575572391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c10152580 0x7f1c10152af0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0072c0 tx=0x7f1c0c007680 comp rx=0 tx=0).stop 2023-08-25T04:45:48.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.030+0000 7f1c16cf3700 1 -- 172.21.15.16:0/575572391 reap_dead start 2023-08-25T04:45:48.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.030+0000 7f1c18756700 1 -- 172.21.15.16:0/575572391 shutdown_connections 2023-08-25T04:45:48.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.030+0000 7f1c18756700 1 -- 172.21.15.16:0/575572391 >> 172.21.15.16:0/575572391 conn(0x7f1c100b1cb0 msgr2=0x7f1c10159440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:48.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.030+0000 7f1c18756700 1 -- 172.21.15.16:0/575572391 shutdown_connections 2023-08-25T04:45:48.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.030+0000 7f1c18756700 1 -- 172.21.15.16:0/575572391 wait complete. 2023-08-25T04:45:48.043 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-08-25T04:45:48.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.168+0000 7fd35e467700 1 Processor -- start 2023-08-25T04:45:48.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.168+0000 7fd35e467700 1 -- start start 2023-08-25T04:45:48.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.169+0000 7fd35e467700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd358070eb0 0x7fd3580ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.169+0000 7fd35e467700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580cbfe0 con 0x7fd3580caf10 2023-08-25T04:45:48.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.169+0000 7fd35e467700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580cb3d0 con 0x7fd3580cc830 2023-08-25T04:45:48.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.169+0000 7fd35e467700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3580cb6b0 con 0x7fd358070eb0 2023-08-25T04:45:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.169+0000 7fd3577fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd3580caf10 0x7fd3580cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40776/0 (socket says 172.21.15.16:40776) 2023-08-25T04:45:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.169+0000 7fd3577fe700 1 -- 172.21.15.16:0/994740353 learned_addr learned my addr 172.21.15.16:0/994740353 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.169+0000 7fd35ca04700 1 --2- 172.21.15.16:0/994740353 >> v2:172.21.15.117:3300/0 conn(0x7fd358070eb0 0x7fd3580ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.169+0000 7fd356ffd700 1 -- 172.21.15.16:0/994740353 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276877103 0 0) 0x7fd3580cbfe0 con 0x7fd3580caf10 2023-08-25T04:45:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.170+0000 7fd356ffd700 1 -- 172.21.15.16:0/994740353 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3440035b0 con 0x7fd3580caf10 2023-08-25T04:45:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.170+0000 7fd356ffd700 1 -- 172.21.15.16:0/994740353 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244235372 0 0) 0x7fd3580cb3d0 con 0x7fd3580cc830 2023-08-25T04:45:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.170+0000 7fd356ffd700 1 -- 172.21.15.16:0/994740353 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3580cbfe0 con 0x7fd3580cc830 2023-08-25T04:45:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.170+0000 7fd35ca04700 1 -- 172.21.15.16:0/994740353 >> v1:172.21.15.117:6789/0 conn(0x7fd3580cc830 legacy=0x7fd3580ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.170+0000 7fd356ffd700 1 -- 172.21.15.16:0/994740353 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2213232948 0 0) 0x7fd3440035b0 con 0x7fd3580caf10 2023-08-25T04:45:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.170+0000 7fd35ca04700 1 -- 172.21.15.16:0/994740353 >> v1:172.21.15.16:6789/0 conn(0x7fd3580caf10 legacy=0x7fd3580cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.170+0000 7fd35ca04700 1 -- 172.21.15.16:0/994740353 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580cb990 con 0x7fd358070eb0 2023-08-25T04:45:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.170+0000 7fd35ca04700 1 --2- 172.21.15.16:0/994740353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd358070eb0 0x7fd3580ce4c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd350009d90 tx=0x7fd35000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9fcb1a971f7d30d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.170+0000 7fd356ffd700 1 -- 172.21.15.16:0/994740353 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35000e070 con 0x7fd358070eb0 2023-08-25T04:45:48.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.170+0000 7fd356ffd700 1 -- 172.21.15.16:0/994740353 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd350003a20 con 0x7fd358070eb0 2023-08-25T04:45:48.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.170+0000 7fd356ffd700 1 -- 172.21.15.16:0/994740353 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348001670 con 0x7fd358070eb0 2023-08-25T04:45:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.171+0000 7fd35e467700 1 -- 172.21.15.16:0/994740353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd358070eb0 msgr2=0x7fd3580ce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.171+0000 7fd35e467700 1 --2- 172.21.15.16:0/994740353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd358070eb0 0x7fd3580ce4c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd350009d90 tx=0x7fd35000b330 comp rx=0 tx=0).stop 2023-08-25T04:45:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.171+0000 7fd35e467700 1 -- 172.21.15.16:0/994740353 shutdown_connections 2023-08-25T04:45:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.171+0000 7fd35e467700 1 --2- 172.21.15.16:0/994740353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd358070eb0 0x7fd3580ce4c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.171+0000 7fd35e467700 1 -- 172.21.15.16:0/994740353 >> 172.21.15.16:0/994740353 conn(0x7fd3580b1a10 msgr2=0x7fd3580b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.171+0000 7fd35e467700 1 -- 172.21.15.16:0/994740353 shutdown_connections 2023-08-25T04:45:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.171+0000 7fd35e467700 1 -- 172.21.15.16:0/994740353 wait complete. 2023-08-25T04:45:48.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.172+0000 7fd35e467700 1 Processor -- start 2023-08-25T04:45:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.172+0000 7fd35e467700 1 -- start start 2023-08-25T04:45:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd35e467700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd358070eb0 0x7fd35814a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd35e467700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3580caf10 0x7fd3580c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd35e467700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3580cc830 0x7fd3580c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd35e467700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580b4350 con 0x7fd3580caf10 2023-08-25T04:45:48.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd35e467700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35814cf60 con 0x7fd358070eb0 2023-08-25T04:45:48.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd35e467700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580b39b0 con 0x7fd3580cc830 2023-08-25T04:45:48.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd3577fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3580caf10 0x7fd3580c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.183 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd3577fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3580caf10 0x7fd3580c5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50368/0 (socket says 172.21.15.16:50368) 2023-08-25T04:45:48.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd3577fe700 1 -- 172.21.15.16:0/752674940 learned_addr learned my addr 172.21.15.16:0/752674940 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:48.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd35ca04700 1 --2- 172.21.15.16:0/752674940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3580cc830 0x7fd3580c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd357fff700 1 --2- 172.21.15.16:0/752674940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd358070eb0 0x7fd35814a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd3577fe700 1 -- 172.21.15.16:0/752674940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3580cc830 msgr2=0x7fd3580c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd3577fe700 1 --2- 172.21.15.16:0/752674940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3580cc830 0x7fd3580c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd3577fe700 1 -- 172.21.15.16:0/752674940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd358070eb0 msgr2=0x7fd35814a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd3577fe700 1 --2- 172.21.15.16:0/752674940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd358070eb0 0x7fd35814a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd3577fe700 1 -- 172.21.15.16:0/752674940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd350009a70 con 0x7fd3580caf10 2023-08-25T04:45:48.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.173+0000 7fd3577fe700 1 --2- 172.21.15.16:0/752674940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3580caf10 0x7fd3580c5980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd34800c700 tx=0x7fd34800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.174+0000 7fd354ff9700 1 -- 172.21.15.16:0/752674940 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348004c80 con 0x7fd3580caf10 2023-08-25T04:45:48.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.174+0000 7fd354ff9700 1 -- 172.21.15.16:0/752674940 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd348004de0 con 0x7fd3580caf10 2023-08-25T04:45:48.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.174+0000 7fd354ff9700 1 -- 172.21.15.16:0/752674940 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348007310 con 0x7fd3580caf10 2023-08-25T04:45:48.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.174+0000 7fd35e467700 1 -- 172.21.15.16:0/752674940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3580b3c90 con 0x7fd3580caf10 2023-08-25T04:45:48.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.174+0000 7fd35e467700 1 -- 172.21.15.16:0/752674940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3580b35f0 con 0x7fd3580caf10 2023-08-25T04:45:48.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.175+0000 7fd35e467700 1 -- 172.21.15.16:0/752674940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3580b4490 con 0x7fd3580caf10 2023-08-25T04:45:48.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.175+0000 7fd354ff9700 1 -- 172.21.15.16:0/752674940 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd348007470 con 0x7fd3580caf10 2023-08-25T04:45:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.176+0000 7fd354ff9700 1 --2- 172.21.15.16:0/752674940 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd33806a0e0 0x7fd33806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.176+0000 7fd354ff9700 1 -- 172.21.15.16:0/752674940 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd3480883a0 con 0x7fd3580caf10 2023-08-25T04:45:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.176+0000 7fd357fff700 1 --2- 172.21.15.16:0/752674940 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd33806a0e0 0x7fd33806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.176+0000 7fd357fff700 1 --2- 172.21.15.16:0/752674940 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd33806a0e0 0x7fd33806c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd3400010e0 tx=0x7fd340009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.180+0000 7fd354ff9700 1 -- 172.21.15.16:0/752674940 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd3580b4490 con 0x7fd3580caf10 2023-08-25T04:45:48.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.378+0000 7fd35e467700 1 -- 172.21.15.16:0/752674940 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3580b3b20 con 0x7fd33806a0e0 2023-08-25T04:45:48.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.378+0000 7fd354ff9700 1 -- 172.21.15.16:0/752674940 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd3580b3b20 con 0x7fd33806a0e0 2023-08-25T04:45:48.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.380+0000 7fd35e467700 1 -- 172.21.15.16:0/752674940 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd33806a0e0 msgr2=0x7fd33806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.380+0000 7fd35e467700 1 --2- 172.21.15.16:0/752674940 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd33806a0e0 0x7fd33806c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd3400010e0 tx=0x7fd340009040 comp rx=0 tx=0).stop 2023-08-25T04:45:48.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.380+0000 7fd35e467700 1 -- 172.21.15.16:0/752674940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3580caf10 msgr2=0x7fd3580c5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.380+0000 7fd35e467700 1 --2- 172.21.15.16:0/752674940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3580caf10 0x7fd3580c5980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd34800c700 tx=0x7fd34800cac0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.380+0000 7fd35e467700 1 -- 172.21.15.16:0/752674940 shutdown_connections 2023-08-25T04:45:48.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.380+0000 7fd35e467700 1 --2- 172.21.15.16:0/752674940 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd33806a0e0 0x7fd33806c5a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.380+0000 7fd35e467700 1 --2- 172.21.15.16:0/752674940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3580cc830 0x7fd3580c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.380+0000 7fd35e467700 1 --2- 172.21.15.16:0/752674940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd358070eb0 0x7fd35814a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.380+0000 7fd35e467700 1 --2- 172.21.15.16:0/752674940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3580caf10 0x7fd3580c5980 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.380+0000 7fd35e467700 1 -- 172.21.15.16:0/752674940 >> 172.21.15.16:0/752674940 conn(0x7fd3580b1a10 msgr2=0x7fd3580afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:48.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.381+0000 7fd35e467700 1 -- 172.21.15.16:0/752674940 shutdown_connections 2023-08-25T04:45:48.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.381+0000 7fd35e467700 1 -- 172.21.15.16:0/752674940 wait complete. 2023-08-25T04:45:48.387 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 1 to deep-scrub 2023-08-25T04:45:48.394 INFO:tasks.ceph:Scrubbing osd.2 2023-08-25T04:45:48.395 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-08-25T04:45:48.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.526+0000 7fc5221c7700 1 Processor -- start 2023-08-25T04:45:48.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.526+0000 7fc5221c7700 1 -- start start 2023-08-25T04:45:48.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.527+0000 7fc5221c7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc51c15b010 0x7fc51c071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.527+0000 7fc5221c7700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc51c0b27a0 0x7fc51c161780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.527+0000 7fc5221c7700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51c0ce8e0 con 0x7fc51c161cc0 2023-08-25T04:45:48.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.527+0000 7fc5221c7700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51c072640 con 0x7fc51c0b27a0 2023-08-25T04:45:48.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.527+0000 7fc5221c7700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c0ce040 con 0x7fc51c15b010 2023-08-25T04:45:48.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.527+0000 7fc51affd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc51c0b27a0 0x7fc51c161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.527+0000 7fc51affd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc51c0b27a0 0x7fc51c161780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50374/0 (socket says 172.21.15.16:50374) 2023-08-25T04:45:48.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.527+0000 7fc51affd700 1 -- 172.21.15.16:0/3877737371 learned_addr learned my addr 172.21.15.16:0/3877737371 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:48.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.527+0000 7fc51b7fe700 1 --2- 172.21.15.16:0/3877737371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc51c15b010 0x7fc51c071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.527+0000 7fc51affd700 1 -- 172.21.15.16:0/3877737371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc51c15b010 msgr2=0x7fc51c071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:48.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.527+0000 7fc51affd700 1 --2- 172.21.15.16:0/3877737371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc51c15b010 0x7fc51c071a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.527+0000 7fc51affd700 1 -- 172.21.15.16:0/3877737371 >> v1:172.21.15.117:6789/0 conn(0x7fc51c161cc0 legacy=0x7fc51c15daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:48.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.527+0000 7fc51affd700 1 -- 172.21.15.16:0/3877737371 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c0ce320 con 0x7fc51c0b27a0 2023-08-25T04:45:48.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.528+0000 7fc51affd700 1 --2- 172.21.15.16:0/3877737371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc51c0b27a0 0x7fc51c161780 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0098f0 tx=0x7fc50c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72c22efc8a65694 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.528+0000 7fc51a7fc700 1 -- 172.21.15.16:0/3877737371 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c004230 con 0x7fc51c0b27a0 2023-08-25T04:45:48.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.528+0000 7fc51a7fc700 1 -- 172.21.15.16:0/3877737371 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50c004390 con 0x7fc51c0b27a0 2023-08-25T04:45:48.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.528+0000 7fc51a7fc700 1 -- 172.21.15.16:0/3877737371 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c0036a0 con 0x7fc51c0b27a0 2023-08-25T04:45:48.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.528+0000 7fc5221c7700 1 -- 172.21.15.16:0/3877737371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc51c0b27a0 msgr2=0x7fc51c161780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.528+0000 7fc5221c7700 1 --2- 172.21.15.16:0/3877737371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc51c0b27a0 0x7fc51c161780 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0098f0 tx=0x7fc50c009c00 comp rx=0 tx=0).stop 2023-08-25T04:45:48.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.528+0000 7fc5221c7700 1 -- 172.21.15.16:0/3877737371 shutdown_connections 2023-08-25T04:45:48.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.528+0000 7fc5221c7700 1 --2- 172.21.15.16:0/3877737371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc51c15b010 0x7fc51c071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.528+0000 7fc5221c7700 1 --2- 172.21.15.16:0/3877737371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc51c0b27a0 0x7fc51c161780 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.528+0000 7fc5221c7700 1 -- 172.21.15.16:0/3877737371 >> 172.21.15.16:0/3877737371 conn(0x7fc51c0b1cb0 msgr2=0x7fc51c0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:48.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.528+0000 7fc5221c7700 1 -- 172.21.15.16:0/3877737371 shutdown_connections 2023-08-25T04:45:48.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.528+0000 7fc5221c7700 1 -- 172.21.15.16:0/3877737371 wait complete. 2023-08-25T04:45:48.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.529+0000 7fc5221c7700 1 Processor -- start 2023-08-25T04:45:48.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.530+0000 7fc5221c7700 1 -- start start 2023-08-25T04:45:48.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.530+0000 7fc5221c7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc51c0b27a0 0x7fc51c1f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.530+0000 7fc5221c7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc51c15b010 0x7fc51c0ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.530+0000 7fc5221c7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc51c161cc0 0x7fc51c0c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.530+0000 7fc5221c7700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c1f2d10 con 0x7fc51c161cc0 2023-08-25T04:45:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.530+0000 7fc5221c7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c15c140 con 0x7fc51c15b010 2023-08-25T04:45:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.530+0000 7fc5221c7700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c15c420 con 0x7fc51c0b27a0 2023-08-25T04:45:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.530+0000 7fc51bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc51c161cc0 0x7fc51c0c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.530+0000 7fc51bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc51c161cc0 0x7fc51c0c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50380/0 (socket says 172.21.15.16:50380) 2023-08-25T04:45:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.531+0000 7fc51bfff700 1 -- 172.21.15.16:0/2723215998 learned_addr learned my addr 172.21.15.16:0/2723215998 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.531+0000 7fc51b7fe700 1 --2- 172.21.15.16:0/2723215998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc51c0b27a0 0x7fc51c1f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.531+0000 7fc51affd700 1 --2- 172.21.15.16:0/2723215998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc51c15b010 0x7fc51c0ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.531+0000 7fc51bfff700 1 -- 172.21.15.16:0/2723215998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc51c0b27a0 msgr2=0x7fc51c1f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.531+0000 7fc51bfff700 1 --2- 172.21.15.16:0/2723215998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc51c0b27a0 0x7fc51c1f27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.531+0000 7fc51bfff700 1 -- 172.21.15.16:0/2723215998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc51c15b010 msgr2=0x7fc51c0ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.531+0000 7fc51bfff700 1 --2- 172.21.15.16:0/2723215998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc51c15b010 0x7fc51c0ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.531+0000 7fc51bfff700 1 -- 172.21.15.16:0/2723215998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c009550 con 0x7fc51c161cc0 2023-08-25T04:45:48.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.531+0000 7fc51bfff700 1 --2- 172.21.15.16:0/2723215998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc51c161cc0 0x7fc51c0c72a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc51400cc10 tx=0x7fc51400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.531+0000 7fc513fff700 1 -- 172.21.15.16:0/2723215998 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51400aa60 con 0x7fc51c161cc0 2023-08-25T04:45:48.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.531+0000 7fc513fff700 1 -- 172.21.15.16:0/2723215998 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51400abc0 con 0x7fc51c161cc0 2023-08-25T04:45:48.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.531+0000 7fc5221c7700 1 -- 172.21.15.16:0/2723215998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51c15c700 con 0x7fc51c161cc0 2023-08-25T04:45:48.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.531+0000 7fc513fff700 1 -- 172.21.15.16:0/2723215998 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514012420 con 0x7fc51c161cc0 2023-08-25T04:45:48.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.531+0000 7fc5221c7700 1 -- 172.21.15.16:0/2723215998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51c0c7d90 con 0x7fc51c161cc0 2023-08-25T04:45:48.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.532+0000 7fc5221c7700 1 -- 172.21.15.16:0/2723215998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc51c161260 con 0x7fc51c161cc0 2023-08-25T04:45:48.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.533+0000 7fc513fff700 1 -- 172.21.15.16:0/2723215998 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc514012580 con 0x7fc51c161cc0 2023-08-25T04:45:48.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.533+0000 7fc513fff700 1 --2- 172.21.15.16:0/2723215998 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc4fc06a0e0 0x7fc4fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.533+0000 7fc513fff700 1 -- 172.21.15.16:0/2723215998 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc514088800 con 0x7fc51c161cc0 2023-08-25T04:45:48.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.533+0000 7fc513fff700 1 --2- 172.21.15.16:0/2723215998 >> [v2:172.21.15.16:6824/2473914366,v1:172.21.15.16:6825/2473914366] conn(0x7fc4fc0729e0 0x7fc4fc074e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.533+0000 7fc513fff700 1 -- 172.21.15.16:0/2723215998 --> [v2:172.21.15.16:6824/2473914366,v1:172.21.15.16:6825/2473914366] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4fc0754f0 con 0x7fc4fc0729e0 2023-08-25T04:45:48.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.533+0000 7fc513fff700 1 -- 172.21.15.16:0/2723215998 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc51408d2c0 con 0x7fc51c161cc0 2023-08-25T04:45:48.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.533+0000 7fc51affd700 1 --2- 172.21.15.16:0/2723215998 >> [v2:172.21.15.16:6824/2473914366,v1:172.21.15.16:6825/2473914366] conn(0x7fc4fc0729e0 0x7fc4fc074e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.533+0000 7fc51b7fe700 1 --2- 172.21.15.16:0/2723215998 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc4fc06a0e0 0x7fc4fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.534+0000 7fc51affd700 1 --2- 172.21.15.16:0/2723215998 >> [v2:172.21.15.16:6824/2473914366,v1:172.21.15.16:6825/2473914366] conn(0x7fc4fc0729e0 0x7fc4fc074e20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.534+0000 7fc51b7fe700 1 --2- 172.21.15.16:0/2723215998 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc4fc06a0e0 0x7fc4fc06c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc50400ab60 tx=0x7fc504008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.534+0000 7fc513fff700 1 -- 172.21.15.16:0/2723215998 <== osd.2 v2:172.21.15.16:6824/2473914366 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc4fc0754f0 con 0x7fc4fc0729e0 2023-08-25T04:45:48.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.549+0000 7fc5221c7700 1 -- 172.21.15.16:0/2723215998 --> [v2:172.21.15.16:6824/2473914366,v1:172.21.15.16:6825/2473914366] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc51c0ce600 con 0x7fc4fc0729e0 2023-08-25T04:45:48.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.549+0000 7fc513fff700 1 -- 172.21.15.16:0/2723215998 <== osd.2 v2:172.21.15.16:6824/2473914366 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc50c0045e0 con 0x7fc4fc0729e0 2023-08-25T04:45:48.552 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-08-25T04:45:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T04:45:48.553 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-08-25T04:45:48.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.549+0000 7fc5221c7700 1 -- 172.21.15.16:0/2723215998 >> [v2:172.21.15.16:6824/2473914366,v1:172.21.15.16:6825/2473914366] conn(0x7fc4fc0729e0 msgr2=0x7fc4fc074e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.549+0000 7fc5221c7700 1 --2- 172.21.15.16:0/2723215998 >> [v2:172.21.15.16:6824/2473914366,v1:172.21.15.16:6825/2473914366] conn(0x7fc4fc0729e0 0x7fc4fc074e20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.550+0000 7fc5221c7700 1 -- 172.21.15.16:0/2723215998 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc4fc06a0e0 msgr2=0x7fc4fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.550+0000 7fc5221c7700 1 --2- 172.21.15.16:0/2723215998 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc4fc06a0e0 0x7fc4fc06c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc50400ab60 tx=0x7fc504008040 comp rx=0 tx=0).stop 2023-08-25T04:45:48.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.550+0000 7fc5221c7700 1 -- 172.21.15.16:0/2723215998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc51c161cc0 msgr2=0x7fc51c0c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.550+0000 7fc5221c7700 1 --2- 172.21.15.16:0/2723215998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc51c161cc0 0x7fc51c0c72a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc51400cc10 tx=0x7fc51400cf20 comp rx=0 tx=0).stop 2023-08-25T04:45:48.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.550+0000 7fc51bfff700 1 -- 172.21.15.16:0/2723215998 reap_dead start 2023-08-25T04:45:48.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.550+0000 7fc5221c7700 1 -- 172.21.15.16:0/2723215998 shutdown_connections 2023-08-25T04:45:48.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.550+0000 7fc5221c7700 1 -- 172.21.15.16:0/2723215998 >> 172.21.15.16:0/2723215998 conn(0x7fc51c0b1cb0 msgr2=0x7fc51c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:48.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.550+0000 7fc5221c7700 1 -- 172.21.15.16:0/2723215998 shutdown_connections 2023-08-25T04:45:48.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.550+0000 7fc5221c7700 1 -- 172.21.15.16:0/2723215998 wait complete. 2023-08-25T04:45:48.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-08-25T04:45:48.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.688+0000 7f4f1c4f7700 1 Processor -- start 2023-08-25T04:45:48.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.688+0000 7f4f1c4f7700 1 -- start start 2023-08-25T04:45:48.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1c4f7700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4f1415e670 0x7f4f140ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1c4f7700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4f1406a340 0x7f4f1406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1c4f7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f140cc820 0x7f4f140ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1c4f7700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1406ad30 con 0x7f4f1415e670 2023-08-25T04:45:48.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1c4f7700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f140713e0 con 0x7f4f1406a340 2023-08-25T04:45:48.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1c4f7700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1415ea50 con 0x7f4f140cc820 2023-08-25T04:45:48.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1a293700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4f1415e670 0x7f4f140ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1a293700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4f1415e670 0x7f4f140ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50388/0 (socket says 172.21.15.16:50388) 2023-08-25T04:45:48.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1a293700 1 -- 172.21.15.16:0/1508480662 learned_addr learned my addr 172.21.15.16:0/1508480662 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:48.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f19a92700 1 --2- 172.21.15.16:0/1508480662 >> v2:172.21.15.117:3300/0 conn(0x7f4f1406a340 0x7f4f1406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1aa94700 1 --2- 172.21.15.16:0/1508480662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f140cc820 0x7f4f140ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1a293700 1 -- 172.21.15.16:0/1508480662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f140cc820 msgr2=0x7f4f140ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:48.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1a293700 1 --2- 172.21.15.16:0/1508480662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f140cc820 0x7f4f140ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1a293700 1 -- 172.21.15.16:0/1508480662 >> v2:172.21.15.117:3300/0 conn(0x7f4f1406a340 msgr2=0x7f4f1406a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:48.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1a293700 1 --2- 172.21.15.16:0/1508480662 >> v2:172.21.15.117:3300/0 conn(0x7f4f1406a340 0x7f4f1406a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1a293700 1 -- 172.21.15.16:0/1508480662 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f140ca9d0 con 0x7f4f1415e670 2023-08-25T04:45:48.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1aa94700 1 --2- 172.21.15.16:0/1508480662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f140cc820 0x7f4f140ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:48.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f19a92700 1 --2- 172.21.15.16:0/1508480662 >> v2:172.21.15.117:3300/0 conn(0x7f4f1406a340 0x7f4f1406a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:48.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f1a293700 1 --2- 172.21.15.16:0/1508480662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f1415e670 0x7f4f140ca490 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4f1406c7d0 tx=0x7f4f10009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c218b49cbf97fe6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f19291700 1 -- 172.21.15.16:0/1508480662 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000b870 con 0x7f4f1415e670 2023-08-25T04:45:48.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f19291700 1 -- 172.21.15.16:0/1508480662 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1000b9d0 con 0x7f4f1415e670 2023-08-25T04:45:48.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.689+0000 7f4f19291700 1 -- 172.21.15.16:0/1508480662 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000bd60 con 0x7f4f1415e670 2023-08-25T04:45:48.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.690+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/1508480662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f1415e670 msgr2=0x7f4f140ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.690+0000 7f4f1c4f7700 1 --2- 172.21.15.16:0/1508480662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f1415e670 0x7f4f140ca490 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4f1406c7d0 tx=0x7f4f10009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.690+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/1508480662 shutdown_connections 2023-08-25T04:45:48.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.690+0000 7f4f1c4f7700 1 --2- 172.21.15.16:0/1508480662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f140cc820 0x7f4f140ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.690+0000 7f4f1c4f7700 1 --2- 172.21.15.16:0/1508480662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f1415e670 0x7f4f140ca490 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.690+0000 7f4f1c4f7700 1 --2- 172.21.15.16:0/1508480662 >> v2:172.21.15.117:3300/0 conn(0x7f4f1406a340 0x7f4f1406a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.690+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/1508480662 >> 172.21.15.16:0/1508480662 conn(0x7f4f140b1a10 msgr2=0x7f4f140b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:48.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.690+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/1508480662 shutdown_connections 2023-08-25T04:45:48.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.690+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/1508480662 wait complete. 2023-08-25T04:45:48.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.692+0000 7f4f1c4f7700 1 Processor -- start 2023-08-25T04:45:48.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.692+0000 7f4f1c4f7700 1 -- start start 2023-08-25T04:45:48.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1c4f7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1406a340 0x7f4f140c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1c4f7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f140cc820 0x7f4f140b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1c4f7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f1415e670 0x7f4f140b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1c4f7700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f141f0430 con 0x7f4f1415e670 2023-08-25T04:45:48.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1c4f7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f140c5e10 con 0x7f4f140cc820 2023-08-25T04:45:48.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1c4f7700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f140c60f0 con 0x7f4f1406a340 2023-08-25T04:45:48.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1aa94700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f1415e670 0x7f4f140b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1aa94700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f1415e670 0x7f4f140b0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50396/0 (socket says 172.21.15.16:50396) 2023-08-25T04:45:48.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1aa94700 1 -- 172.21.15.16:0/2130114011 learned_addr learned my addr 172.21.15.16:0/2130114011 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:48.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1a293700 1 --2- 172.21.15.16:0/2130114011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1406a340 0x7f4f140c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1aa94700 1 -- 172.21.15.16:0/2130114011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1406a340 msgr2=0x7f4f140c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1aa94700 1 --2- 172.21.15.16:0/2130114011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1406a340 0x7f4f140c4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f19a92700 1 --2- 172.21.15.16:0/2130114011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f140cc820 0x7f4f140b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1aa94700 1 -- 172.21.15.16:0/2130114011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f140cc820 msgr2=0x7f4f140b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1aa94700 1 --2- 172.21.15.16:0/2130114011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f140cc820 0x7f4f140b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1aa94700 1 -- 172.21.15.16:0/2130114011 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f10009550 con 0x7f4f1415e670 2023-08-25T04:45:48.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1aa94700 1 --2- 172.21.15.16:0/2130114011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f1415e670 0x7f4f140b0f40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00cef0 tx=0x7f4f0c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f0affd700 1 -- 172.21.15.16:0/2130114011 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c00ae50 con 0x7f4f1415e670 2023-08-25T04:45:48.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f0affd700 1 -- 172.21.15.16:0/2130114011 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c015440 con 0x7f4f1415e670 2023-08-25T04:45:48.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/2130114011 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f140c63d0 con 0x7f4f1415e670 2023-08-25T04:45:48.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.693+0000 7f4f0affd700 1 -- 172.21.15.16:0/2130114011 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0157f0 con 0x7f4f1415e670 2023-08-25T04:45:48.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.694+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/2130114011 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f140c5a70 con 0x7f4f1415e670 2023-08-25T04:45:48.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.694+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/2130114011 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f141f0930 con 0x7f4f1415e670 2023-08-25T04:45:48.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.695+0000 7f4f0affd700 1 -- 172.21.15.16:0/2130114011 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4f0c00d430 con 0x7f4f1415e670 2023-08-25T04:45:48.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.695+0000 7f4f0affd700 1 --2- 172.21.15.16:0/2130114011 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4ef806a0e0 0x7f4ef806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.695+0000 7f4f0affd700 1 -- 172.21.15.16:0/2130114011 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4f0c088bc0 con 0x7f4f1415e670 2023-08-25T04:45:48.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.695+0000 7f4f1a293700 1 --2- 172.21.15.16:0/2130114011 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4ef806a0e0 0x7f4ef806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.696+0000 7f4f1a293700 1 --2- 172.21.15.16:0/2130114011 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4ef806a0e0 0x7f4ef806c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f140b4e30 tx=0x7f4f10008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.700+0000 7f4f0affd700 1 -- 172.21.15.16:0/2130114011 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4f141f0930 con 0x7f4f1415e670 2023-08-25T04:45:48.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.903+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/2130114011 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f140c6260 con 0x7f4ef806a0e0 2023-08-25T04:45:48.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.903+0000 7f4f0affd700 1 -- 172.21.15.16:0/2130114011 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4f140c6260 con 0x7f4ef806a0e0 2023-08-25T04:45:48.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.906+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/2130114011 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4ef806a0e0 msgr2=0x7f4ef806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.906+0000 7f4f1c4f7700 1 --2- 172.21.15.16:0/2130114011 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4ef806a0e0 0x7f4ef806c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f140b4e30 tx=0x7f4f10008030 comp rx=0 tx=0).stop 2023-08-25T04:45:48.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.906+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/2130114011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f1415e670 msgr2=0x7f4f140b0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.906+0000 7f4f1c4f7700 1 --2- 172.21.15.16:0/2130114011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f1415e670 0x7f4f140b0f40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00cef0 tx=0x7f4f0c00a340 comp rx=0 tx=0).stop 2023-08-25T04:45:48.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.906+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/2130114011 shutdown_connections 2023-08-25T04:45:48.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.906+0000 7f4f1c4f7700 1 --2- 172.21.15.16:0/2130114011 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4ef806a0e0 0x7f4ef806c5a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.906+0000 7f4f1c4f7700 1 --2- 172.21.15.16:0/2130114011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f1415e670 0x7f4f140b0f40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.906+0000 7f4f1c4f7700 1 --2- 172.21.15.16:0/2130114011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1406a340 0x7f4f140c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.906+0000 7f4f1c4f7700 1 --2- 172.21.15.16:0/2130114011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f140cc820 0x7f4f140b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.906+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/2130114011 >> 172.21.15.16:0/2130114011 conn(0x7f4f140b1a10 msgr2=0x7f4f140ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.906+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/2130114011 shutdown_connections 2023-08-25T04:45:48.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:48.906+0000 7f4f1c4f7700 1 -- 172.21.15.16:0/2130114011 wait complete. 2023-08-25T04:45:48.910 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 2 to deep-scrub 2023-08-25T04:45:48.920 INFO:tasks.ceph:Scrubbing osd.3 2023-08-25T04:45:48.920 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-08-25T04:45:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.049+0000 7f16e4091700 1 Processor -- start 2023-08-25T04:45:49.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.049+0000 7f16e4091700 1 -- start start 2023-08-25T04:45:49.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.050+0000 7f16e4091700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16dc15b010 0x7f16dc071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.050+0000 7f16e4091700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f16dc0b27a0 0x7f16dc161780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.050+0000 7f16e4091700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc0ce8e0 con 0x7f16dc161cc0 2023-08-25T04:45:49.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.050+0000 7f16e4091700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc072640 con 0x7f16dc0b27a0 2023-08-25T04:45:49.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.050+0000 7f16e4091700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc0ce040 con 0x7f16dc15b010 2023-08-25T04:45:49.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.050+0000 7f16e162c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f16dc0b27a0 0x7f16dc161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.050+0000 7f16e162c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f16dc0b27a0 0x7f16dc161780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50400/0 (socket says 172.21.15.16:50400) 2023-08-25T04:45:49.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.050+0000 7f16e162c700 1 -- 172.21.15.16:0/2209286639 learned_addr learned my addr 172.21.15.16:0/2209286639 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:49.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.050+0000 7f16e1e2d700 1 --2- 172.21.15.16:0/2209286639 >> v2:172.21.15.117:3300/0 conn(0x7f16dc15b010 0x7f16dc071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.050+0000 7f16e162c700 1 -- 172.21.15.16:0/2209286639 >> v2:172.21.15.117:3300/0 conn(0x7f16dc15b010 msgr2=0x7f16dc071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:49.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.050+0000 7f16e162c700 1 --2- 172.21.15.16:0/2209286639 >> v2:172.21.15.117:3300/0 conn(0x7f16dc15b010 0x7f16dc071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.050+0000 7f16e162c700 1 -- 172.21.15.16:0/2209286639 >> v1:172.21.15.117:6789/0 conn(0x7f16dc161cc0 legacy=0x7f16dc15daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.050+0000 7f16e162c700 1 -- 172.21.15.16:0/2209286639 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0ce320 con 0x7f16dc0b27a0 2023-08-25T04:45:49.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.050+0000 7f16e162c700 1 --2- 172.21.15.16:0/2209286639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16dc0b27a0 0x7f16dc161780 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f16dc074260 tx=0x7f16cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8cfc216fc9dc66 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.051+0000 7f16e0e2b700 1 -- 172.21.15.16:0/2209286639 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc00b870 con 0x7f16dc0b27a0 2023-08-25T04:45:49.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.051+0000 7f16e0e2b700 1 -- 172.21.15.16:0/2209286639 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc00b9d0 con 0x7f16dc0b27a0 2023-08-25T04:45:49.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.051+0000 7f16e0e2b700 1 -- 172.21.15.16:0/2209286639 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc00bd60 con 0x7f16dc0b27a0 2023-08-25T04:45:49.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.051+0000 7f16e4091700 1 -- 172.21.15.16:0/2209286639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16dc0b27a0 msgr2=0x7f16dc161780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.051+0000 7f16e4091700 1 --2- 172.21.15.16:0/2209286639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16dc0b27a0 0x7f16dc161780 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f16dc074260 tx=0x7f16cc009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.051+0000 7f16e4091700 1 -- 172.21.15.16:0/2209286639 shutdown_connections 2023-08-25T04:45:49.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.051+0000 7f16e4091700 1 --2- 172.21.15.16:0/2209286639 >> v2:172.21.15.117:3300/0 conn(0x7f16dc15b010 0x7f16dc071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.051+0000 7f16e4091700 1 --2- 172.21.15.16:0/2209286639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16dc0b27a0 0x7f16dc161780 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.051+0000 7f16e4091700 1 -- 172.21.15.16:0/2209286639 >> 172.21.15.16:0/2209286639 conn(0x7f16dc0b1cb0 msgr2=0x7f16dc0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:49.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.051+0000 7f16e4091700 1 -- 172.21.15.16:0/2209286639 shutdown_connections 2023-08-25T04:45:49.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.051+0000 7f16e4091700 1 -- 172.21.15.16:0/2209286639 wait complete. 2023-08-25T04:45:49.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.053+0000 7f16e4091700 1 Processor -- start 2023-08-25T04:45:49.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.053+0000 7f16e4091700 1 -- start start 2023-08-25T04:45:49.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.053+0000 7f16e4091700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16dc0b27a0 0x7f16dc0c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.053+0000 7f16e4091700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16dc15b010 0x7f16dc15dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.053+0000 7f16e4091700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16dc161cc0 0x7f16dc15e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.053+0000 7f16e4091700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0c9b80 con 0x7f16dc0b27a0 2023-08-25T04:45:49.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.053+0000 7f16e4091700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc15e6e0 con 0x7f16dc15b010 2023-08-25T04:45:49.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.053+0000 7f16e4091700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0ad7c0 con 0x7f16dc161cc0 2023-08-25T04:45:49.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.053+0000 7f16e1e2d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16dc0b27a0 0x7f16dc0c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.053+0000 7f16e1e2d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16dc0b27a0 0x7f16dc0c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50406/0 (socket says 172.21.15.16:50406) 2023-08-25T04:45:49.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.053+0000 7f16e1e2d700 1 -- 172.21.15.16:0/320286733 learned_addr learned my addr 172.21.15.16:0/320286733 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:49.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.054+0000 7f16e162c700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16dc15b010 0x7f16dc15dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.054+0000 7f16e262e700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16dc161cc0 0x7f16dc15e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.054+0000 7f16e1e2d700 1 -- 172.21.15.16:0/320286733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16dc161cc0 msgr2=0x7f16dc15e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.054+0000 7f16e1e2d700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16dc161cc0 0x7f16dc15e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.054+0000 7f16e1e2d700 1 -- 172.21.15.16:0/320286733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16dc15b010 msgr2=0x7f16dc15dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.054+0000 7f16e1e2d700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16dc15b010 0x7f16dc15dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.054+0000 7f16e1e2d700 1 -- 172.21.15.16:0/320286733 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc009550 con 0x7f16dc0b27a0 2023-08-25T04:45:49.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.054+0000 7f16e262e700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16dc161cc0 0x7f16dc15e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:49.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.054+0000 7f16e1e2d700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16dc0b27a0 0x7f16dc0c9640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f16d800e810 tx=0x7f16d800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.054+0000 7f16d27fc700 1 -- 172.21.15.16:0/320286733 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8013610 con 0x7f16dc0b27a0 2023-08-25T04:45:49.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.054+0000 7f16d27fc700 1 -- 172.21.15.16:0/320286733 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d8013770 con 0x7f16dc0b27a0 2023-08-25T04:45:49.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.054+0000 7f16d27fc700 1 -- 172.21.15.16:0/320286733 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8013b20 con 0x7f16dc0b27a0 2023-08-25T04:45:49.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.054+0000 7f16e4091700 1 -- 172.21.15.16:0/320286733 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc15c280 con 0x7f16dc0b27a0 2023-08-25T04:45:49.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.054+0000 7f16e4091700 1 -- 172.21.15.16:0/320286733 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc0ad450 con 0x7f16dc0b27a0 2023-08-25T04:45:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.055+0000 7f16e4091700 1 -- 172.21.15.16:0/320286733 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16dc15c100 con 0x7f16dc0b27a0 2023-08-25T04:45:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.056+0000 7f16d27fc700 1 -- 172.21.15.16:0/320286733 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f16d8013c80 con 0x7f16dc0b27a0 2023-08-25T04:45:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.056+0000 7f16d27fc700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f16c006a0e0 0x7f16c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.056+0000 7f16d27fc700 1 -- 172.21.15.16:0/320286733 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f16d80887d0 con 0x7f16dc0b27a0 2023-08-25T04:45:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.056+0000 7f16d27fc700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.16:6808/1569731109,v1:172.21.15.16:6811/1569731109] conn(0x7f16c00729e0 0x7f16c0074e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.056+0000 7f16d27fc700 1 -- 172.21.15.16:0/320286733 --> [v2:172.21.15.16:6808/1569731109,v1:172.21.15.16:6811/1569731109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16c00754f0 con 0x7f16c00729e0 2023-08-25T04:45:49.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.056+0000 7f16d27fc700 1 -- 172.21.15.16:0/320286733 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16d8088c20 con 0x7f16dc0b27a0 2023-08-25T04:45:49.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.056+0000 7f16e162c700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f16c006a0e0 0x7f16c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.056+0000 7f16e262e700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.16:6808/1569731109,v1:172.21.15.16:6811/1569731109] conn(0x7f16c00729e0 0x7f16c0074e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.057+0000 7f16e262e700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.16:6808/1569731109,v1:172.21.15.16:6811/1569731109] conn(0x7f16c00729e0 0x7f16c0074e20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.057+0000 7f16e162c700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f16c006a0e0 0x7f16c006c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f16cc000c00 tx=0x7f16cc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.057+0000 7f16d27fc700 1 -- 172.21.15.16:0/320286733 <== osd.3 v2:172.21.15.16:6808/1569731109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f16c00754f0 con 0x7f16c00729e0 2023-08-25T04:45:49.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.072+0000 7f16e4091700 1 -- 172.21.15.16:0/320286733 --> [v2:172.21.15.16:6808/1569731109,v1:172.21.15.16:6811/1569731109] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f16dc161260 con 0x7f16c00729e0 2023-08-25T04:45:49.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.072+0000 7f16d27fc700 1 -- 172.21.15.16:0/320286733 <== osd.3 v2:172.21.15.16:6808/1569731109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f16d4003a00 con 0x7f16c00729e0 2023-08-25T04:45:49.075 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-08-25T04:45:49.075 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T04:45:49.076 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-08-25T04:45:49.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.073+0000 7f16e4091700 1 -- 172.21.15.16:0/320286733 >> [v2:172.21.15.16:6808/1569731109,v1:172.21.15.16:6811/1569731109] conn(0x7f16c00729e0 msgr2=0x7f16c0074e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.073+0000 7f16e4091700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.16:6808/1569731109,v1:172.21.15.16:6811/1569731109] conn(0x7f16c00729e0 0x7f16c0074e20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.073+0000 7f16e4091700 1 -- 172.21.15.16:0/320286733 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f16c006a0e0 msgr2=0x7f16c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.073+0000 7f16e4091700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f16c006a0e0 0x7f16c006c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f16cc000c00 tx=0x7f16cc008030 comp rx=0 tx=0).stop 2023-08-25T04:45:49.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.073+0000 7f16e4091700 1 -- 172.21.15.16:0/320286733 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16dc0b27a0 msgr2=0x7f16dc0c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.073+0000 7f16e4091700 1 --2- 172.21.15.16:0/320286733 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16dc0b27a0 0x7f16dc0c9640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f16d800e810 tx=0x7f16d800eb20 comp rx=0 tx=0).stop 2023-08-25T04:45:49.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.073+0000 7f16e262e700 1 -- 172.21.15.16:0/320286733 reap_dead start 2023-08-25T04:45:49.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.073+0000 7f16e4091700 1 -- 172.21.15.16:0/320286733 shutdown_connections 2023-08-25T04:45:49.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.073+0000 7f16e4091700 1 -- 172.21.15.16:0/320286733 >> 172.21.15.16:0/320286733 conn(0x7f16dc0b1cb0 msgr2=0x7f16dc0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:49.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.073+0000 7f16e4091700 1 -- 172.21.15.16:0/320286733 shutdown_connections 2023-08-25T04:45:49.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.073+0000 7f16e4091700 1 -- 172.21.15.16:0/320286733 wait complete. 2023-08-25T04:45:49.086 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-08-25T04:45:49.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.211+0000 7f3c6abe3700 1 Processor -- start 2023-08-25T04:45:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.211+0000 7f3c6abe3700 1 -- start start 2023-08-25T04:45:49.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.212+0000 7f3c6abe3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3c6415e670 0x7f3c640ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.212+0000 7f3c6abe3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6406a340 0x7f3c6406a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.212+0000 7f3c6abe3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3c640cc820 0x7f3c640ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.212+0000 7f3c6abe3700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6406ad00 con 0x7f3c6415e670 2023-08-25T04:45:49.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.212+0000 7f3c6abe3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c640713e0 con 0x7f3c640cc820 2023-08-25T04:45:49.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.212+0000 7f3c6abe3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6415ea50 con 0x7f3c6406a340 2023-08-25T04:45:49.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.212+0000 7f3c6897f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3c6415e670 0x7f3c640ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.212+0000 7f3c6897f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3c6415e670 0x7f3c640ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50416/0 (socket says 172.21.15.16:50416) 2023-08-25T04:45:49.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.212+0000 7f3c6897f700 1 -- 172.21.15.16:0/3269289871 learned_addr learned my addr 172.21.15.16:0/3269289871 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:49.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.212+0000 7f3c63fff700 1 --2- 172.21.15.16:0/3269289871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6406a340 0x7f3c6406a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.212+0000 7f3c69180700 1 --2- 172.21.15.16:0/3269289871 >> v2:172.21.15.117:3300/0 conn(0x7f3c640cc820 0x7f3c640ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.213+0000 7f3c6897f700 1 -- 172.21.15.16:0/3269289871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6406a340 msgr2=0x7f3c6406a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:49.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.213+0000 7f3c6897f700 1 --2- 172.21.15.16:0/3269289871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6406a340 0x7f3c6406a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.213+0000 7f3c6897f700 1 -- 172.21.15.16:0/3269289871 >> v2:172.21.15.117:3300/0 conn(0x7f3c640cc820 msgr2=0x7f3c640ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:49.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.213+0000 7f3c6897f700 1 --2- 172.21.15.16:0/3269289871 >> v2:172.21.15.117:3300/0 conn(0x7f3c640cc820 0x7f3c640ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.213+0000 7f3c6897f700 1 -- 172.21.15.16:0/3269289871 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c640ca9d0 con 0x7f3c6415e670 2023-08-25T04:45:49.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.213+0000 7f3c63fff700 1 --2- 172.21.15.16:0/3269289871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6406a340 0x7f3c6406a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:49.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.213+0000 7f3c69180700 1 --2- 172.21.15.16:0/3269289871 >> v2:172.21.15.117:3300/0 conn(0x7f3c640cc820 0x7f3c640ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:49.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.213+0000 7f3c6897f700 1 --2- 172.21.15.16:0/3269289871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c6415e670 0x7f3c640ca490 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3c6406b220 tx=0x7f3c58009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadb7ccd74529c79 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.213+0000 7f3c637fe700 1 -- 172.21.15.16:0/3269289871 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800b870 con 0x7f3c6415e670 2023-08-25T04:45:49.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.213+0000 7f3c637fe700 1 -- 172.21.15.16:0/3269289871 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5800b9d0 con 0x7f3c6415e670 2023-08-25T04:45:49.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.213+0000 7f3c637fe700 1 -- 172.21.15.16:0/3269289871 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800bd60 con 0x7f3c6415e670 2023-08-25T04:45:49.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.213+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3269289871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c6415e670 msgr2=0x7f3c640ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.213+0000 7f3c6abe3700 1 --2- 172.21.15.16:0/3269289871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c6415e670 0x7f3c640ca490 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3c6406b220 tx=0x7f3c58009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.213+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3269289871 shutdown_connections 2023-08-25T04:45:49.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.214+0000 7f3c6abe3700 1 --2- 172.21.15.16:0/3269289871 >> v2:172.21.15.117:3300/0 conn(0x7f3c640cc820 0x7f3c640ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.214+0000 7f3c6abe3700 1 --2- 172.21.15.16:0/3269289871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c6415e670 0x7f3c640ca490 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.214+0000 7f3c6abe3700 1 --2- 172.21.15.16:0/3269289871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6406a340 0x7f3c6406a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.214+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3269289871 >> 172.21.15.16:0/3269289871 conn(0x7f3c640b1a10 msgr2=0x7f3c640b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:49.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.214+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3269289871 shutdown_connections 2023-08-25T04:45:49.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.214+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3269289871 wait complete. 2023-08-25T04:45:49.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.215+0000 7f3c6abe3700 1 Processor -- start 2023-08-25T04:45:49.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.215+0000 7f3c6abe3700 1 -- start start 2023-08-25T04:45:49.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6abe3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c6406a340 0x7f3c640c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6abe3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c640cc820 0x7f3c640c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6abe3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6415e670 0x7f3c64150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6abe3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c640c6b70 con 0x7f3c6406a340 2023-08-25T04:45:49.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6abe3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c640c3eb0 con 0x7f3c640cc820 2023-08-25T04:45:49.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6abe3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c640c4190 con 0x7f3c6415e670 2023-08-25T04:45:49.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6897f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c6406a340 0x7f3c640c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6897f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c6406a340 0x7f3c640c4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50420/0 (socket says 172.21.15.16:50420) 2023-08-25T04:45:49.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6897f700 1 -- 172.21.15.16:0/3897044966 learned_addr learned my addr 172.21.15.16:0/3897044966 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:49.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c69180700 1 --2- 172.21.15.16:0/3897044966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6415e670 0x7f3c64150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c63fff700 1 --2- 172.21.15.16:0/3897044966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c640cc820 0x7f3c640c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6897f700 1 -- 172.21.15.16:0/3897044966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6415e670 msgr2=0x7f3c64150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6897f700 1 --2- 172.21.15.16:0/3897044966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6415e670 0x7f3c64150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6897f700 1 -- 172.21.15.16:0/3897044966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c640cc820 msgr2=0x7f3c640c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6897f700 1 --2- 172.21.15.16:0/3897044966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c640cc820 0x7f3c640c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6897f700 1 -- 172.21.15.16:0/3897044966 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58009550 con 0x7f3c6406a340 2023-08-25T04:45:49.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c6897f700 1 --2- 172.21.15.16:0/3897044966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c6406a340 0x7f3c640c4c70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009c10 tx=0x7f3c58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.216+0000 7f3c617fa700 1 -- 172.21.15.16:0/3897044966 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c58004250 con 0x7f3c6406a340 2023-08-25T04:45:49.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.217+0000 7f3c617fa700 1 -- 172.21.15.16:0/3897044966 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5801f070 con 0x7f3c6406a340 2023-08-25T04:45:49.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.217+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3897044966 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c640c4470 con 0x7f3c6406a340 2023-08-25T04:45:49.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.217+0000 7f3c617fa700 1 -- 172.21.15.16:0/3897044966 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c580045d0 con 0x7f3c6406a340 2023-08-25T04:45:49.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.217+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3897044966 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c641f4000 con 0x7f3c6406a340 2023-08-25T04:45:49.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.217+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3897044966 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6404ee70 con 0x7f3c6406a340 2023-08-25T04:45:49.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.218+0000 7f3c617fa700 1 -- 172.21.15.16:0/3897044966 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c58021030 con 0x7f3c6406a340 2023-08-25T04:45:49.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.218+0000 7f3c617fa700 1 --2- 172.21.15.16:0/3897044966 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f3c4806a0e0 0x7f3c4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.218+0000 7f3c617fa700 1 -- 172.21.15.16:0/3897044966 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3c58089900 con 0x7f3c6406a340 2023-08-25T04:45:49.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.219+0000 7f3c63fff700 1 --2- 172.21.15.16:0/3897044966 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f3c4806a0e0 0x7f3c4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.219+0000 7f3c63fff700 1 --2- 172.21.15.16:0/3897044966 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f3c4806a0e0 0x7f3c4806c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3c64151ff0 tx=0x7f3c50008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.223+0000 7f3c617fa700 1 -- 172.21.15.16:0/3897044966 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3c58055040 con 0x7f3c6406a340 2023-08-25T04:45:49.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.420+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3897044966 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c64071630 con 0x7f3c4806a0e0 2023-08-25T04:45:49.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.421+0000 7f3c617fa700 1 -- 172.21.15.16:0/3897044966 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3c5000b600 con 0x7f3c4806a0e0 2023-08-25T04:45:49.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.423+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3897044966 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f3c4806a0e0 msgr2=0x7f3c4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.423+0000 7f3c6abe3700 1 --2- 172.21.15.16:0/3897044966 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f3c4806a0e0 0x7f3c4806c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3c64151ff0 tx=0x7f3c50008040 comp rx=0 tx=0).stop 2023-08-25T04:45:49.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.423+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3897044966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c6406a340 msgr2=0x7f3c640c4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.423+0000 7f3c6abe3700 1 --2- 172.21.15.16:0/3897044966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c6406a340 0x7f3c640c4c70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009c10 tx=0x7f3c58004750 comp rx=0 tx=0).stop 2023-08-25T04:45:49.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.423+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3897044966 shutdown_connections 2023-08-25T04:45:49.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.424+0000 7f3c6abe3700 1 --2- 172.21.15.16:0/3897044966 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f3c4806a0e0 0x7f3c4806c5a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.424+0000 7f3c6abe3700 1 --2- 172.21.15.16:0/3897044966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6415e670 0x7f3c64150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.424+0000 7f3c6abe3700 1 --2- 172.21.15.16:0/3897044966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c6406a340 0x7f3c640c4c70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.424+0000 7f3c6abe3700 1 --2- 172.21.15.16:0/3897044966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c640cc820 0x7f3c640c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.424+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3897044966 >> 172.21.15.16:0/3897044966 conn(0x7f3c640b1a10 msgr2=0x7f3c640b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:49.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.424+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3897044966 shutdown_connections 2023-08-25T04:45:49.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.424+0000 7f3c6abe3700 1 -- 172.21.15.16:0/3897044966 wait complete. 2023-08-25T04:45:49.427 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 3 to deep-scrub 2023-08-25T04:45:49.437 INFO:tasks.ceph:Scrubbing osd.4 2023-08-25T04:45:49.437 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-08-25T04:45:49.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.566+0000 7f72fe24d700 1 Processor -- start 2023-08-25T04:45:49.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.566+0000 7f72fe24d700 1 -- start start 2023-08-25T04:45:49.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.567+0000 7f72fe24d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f72f80b27a0 0x7f72f8071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.567+0000 7f72fe24d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f80ce8e0 con 0x7f72f815daf0 2023-08-25T04:45:49.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.567+0000 7f72fe24d700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f8072640 con 0x7f72f815b010 2023-08-25T04:45:49.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.567+0000 7f72fe24d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f80ce040 con 0x7f72f80b27a0 2023-08-25T04:45:49.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.567+0000 7f72f6ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f72f80b27a0 0x7f72f8071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.567+0000 7f72f7fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f72f815daf0 0x7f72f806a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40846/0 (socket says 172.21.15.16:40846) 2023-08-25T04:45:49.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.567+0000 7f72f7fff700 1 -- 172.21.15.16:0/253859208 learned_addr learned my addr 172.21.15.16:0/253859208 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:49.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.567+0000 7f72f6ffd700 1 -- 172.21.15.16:0/253859208 >> v1:172.21.15.117:6789/0 conn(0x7f72f815b010 legacy=0x7f72f8161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:49.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.567+0000 7f72f6ffd700 1 -- 172.21.15.16:0/253859208 >> v1:172.21.15.16:6789/0 conn(0x7f72f815daf0 legacy=0x7f72f806a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.567+0000 7f72f67fc700 1 -- 172.21.15.16:0/253859208 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383491194 0 0) 0x7f72f80ce8e0 con 0x7f72f815daf0 2023-08-25T04:45:49.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.567+0000 7f72f6ffd700 1 -- 172.21.15.16:0/253859208 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f80ce320 con 0x7f72f80b27a0 2023-08-25T04:45:49.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.567+0000 7f72f6ffd700 1 --2- 172.21.15.16:0/253859208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f80b27a0 0x7f72f8071a70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009840 tx=0x7f72e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a19c7ba9cdd8cb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.568+0000 7f72f67fc700 1 -- 172.21.15.16:0/253859208 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8004230 con 0x7f72f80b27a0 2023-08-25T04:45:49.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.568+0000 7f72f67fc700 1 -- 172.21.15.16:0/253859208 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e8004390 con 0x7f72f80b27a0 2023-08-25T04:45:49.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.568+0000 7f72f67fc700 1 -- 172.21.15.16:0/253859208 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e80036a0 con 0x7f72f80b27a0 2023-08-25T04:45:49.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.568+0000 7f72fe24d700 1 -- 172.21.15.16:0/253859208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f80b27a0 msgr2=0x7f72f8071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.568+0000 7f72fe24d700 1 --2- 172.21.15.16:0/253859208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f80b27a0 0x7f72f8071a70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009840 tx=0x7f72e8009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:49.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.568+0000 7f72fe24d700 1 -- 172.21.15.16:0/253859208 shutdown_connections 2023-08-25T04:45:49.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.568+0000 7f72fe24d700 1 --2- 172.21.15.16:0/253859208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f80b27a0 0x7f72f8071a70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.568+0000 7f72fe24d700 1 -- 172.21.15.16:0/253859208 >> 172.21.15.16:0/253859208 conn(0x7f72f80b1cb0 msgr2=0x7f72f80b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:49.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.568+0000 7f72fe24d700 1 -- 172.21.15.16:0/253859208 shutdown_connections 2023-08-25T04:45:49.574 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.568+0000 7f72fe24d700 1 -- 172.21.15.16:0/253859208 wait complete. 2023-08-25T04:45:49.576 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.569+0000 7f72fe24d700 1 Processor -- start 2023-08-25T04:45:49.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.570+0000 7f72fe24d700 1 -- start start 2023-08-25T04:45:49.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.570+0000 7f72fe24d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72f80b27a0 0x7f72f80acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.570+0000 7f72fe24d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f815b010 0x7f72f814c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.570+0000 7f72fe24d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72f815daf0 0x7f72f81f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.570+0000 7f72fe24d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f814cac0 con 0x7f72f815b010 2023-08-25T04:45:49.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.570+0000 7f72fe24d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f81f38b0 con 0x7f72f80b27a0 2023-08-25T04:45:49.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.570+0000 7f72fe24d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f81f3b90 con 0x7f72f815daf0 2023-08-25T04:45:49.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.570+0000 7f72f6ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f815b010 0x7f72f814c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.570+0000 7f72f6ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f815b010 0x7f72f814c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50436/0 (socket says 172.21.15.16:50436) 2023-08-25T04:45:49.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.570+0000 7f72f6ffd700 1 -- 172.21.15.16:0/2307560194 learned_addr learned my addr 172.21.15.16:0/2307560194 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:49.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.571+0000 7f72f77fe700 1 --2- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72f80b27a0 0x7f72f80acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.571+0000 7f72f7fff700 1 --2- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72f815daf0 0x7f72f81f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.571+0000 7f72f6ffd700 1 -- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72f815daf0 msgr2=0x7f72f81f6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.571+0000 7f72f6ffd700 1 --2- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72f815daf0 0x7f72f81f6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.571+0000 7f72f6ffd700 1 -- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72f80b27a0 msgr2=0x7f72f80acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.571+0000 7f72f6ffd700 1 --2- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72f80b27a0 0x7f72f80acc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.571+0000 7f72f6ffd700 1 -- 172.21.15.16:0/2307560194 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e80094a0 con 0x7f72f815b010 2023-08-25T04:45:49.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.571+0000 7f72f6ffd700 1 --2- 172.21.15.16:0/2307560194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f815b010 0x7f72f814c580 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f72f80cea70 tx=0x7f72e80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.571+0000 7f72effff700 1 -- 172.21.15.16:0/2307560194 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8011630 con 0x7f72f815b010 2023-08-25T04:45:49.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.571+0000 7f72effff700 1 -- 172.21.15.16:0/2307560194 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e8011790 con 0x7f72f815b010 2023-08-25T04:45:49.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.571+0000 7f72fe24d700 1 -- 172.21.15.16:0/2307560194 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f81f3e70 con 0x7f72f815b010 2023-08-25T04:45:49.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.571+0000 7f72effff700 1 -- 172.21.15.16:0/2307560194 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8011b40 con 0x7f72f815b010 2023-08-25T04:45:49.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.571+0000 7f72fe24d700 1 -- 172.21.15.16:0/2307560194 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f81f6940 con 0x7f72f815b010 2023-08-25T04:45:49.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.572+0000 7f72fe24d700 1 -- 172.21.15.16:0/2307560194 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f72f8161260 con 0x7f72f815b010 2023-08-25T04:45:49.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.573+0000 7f72effff700 1 -- 172.21.15.16:0/2307560194 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f72e8011ca0 con 0x7f72f815b010 2023-08-25T04:45:49.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.573+0000 7f72effff700 1 --2- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f72d806a0e0 0x7f72d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.573+0000 7f72effff700 1 -- 172.21.15.16:0/2307560194 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f72e8089ce0 con 0x7f72f815b010 2023-08-25T04:45:49.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.573+0000 7f72effff700 1 --2- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:6816/2302216214,v1:172.21.15.117:6817/2302216214] conn(0x7f72d80729e0 0x7f72d8074e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.573+0000 7f72effff700 1 -- 172.21.15.16:0/2307560194 --> [v2:172.21.15.117:6816/2302216214,v1:172.21.15.117:6817/2302216214] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72d80754f0 con 0x7f72d80729e0 2023-08-25T04:45:49.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.573+0000 7f72effff700 1 -- 172.21.15.16:0/2307560194 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72e808c3a0 con 0x7f72f815b010 2023-08-25T04:45:49.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.573+0000 7f72f77fe700 1 --2- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f72d806a0e0 0x7f72d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.573+0000 7f72f7fff700 1 --2- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:6816/2302216214,v1:172.21.15.117:6817/2302216214] conn(0x7f72d80729e0 0x7f72d8074e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.574+0000 7f72f77fe700 1 --2- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f72d806a0e0 0x7f72d806c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f72e0004f30 tx=0x7f72e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.574+0000 7f72f7fff700 1 --2- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:6816/2302216214,v1:172.21.15.117:6817/2302216214] conn(0x7f72d80729e0 0x7f72d8074e20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.575+0000 7f72effff700 1 -- 172.21.15.16:0/2307560194 <== osd.4 v2:172.21.15.117:6816/2302216214 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f72d80754f0 con 0x7f72d80729e0 2023-08-25T04:45:49.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.590+0000 7f72fe24d700 1 -- 172.21.15.16:0/2307560194 --> [v2:172.21.15.117:6816/2302216214,v1:172.21.15.117:6817/2302216214] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f72f80ce600 con 0x7f72d80729e0 2023-08-25T04:45:49.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.590+0000 7f72effff700 1 -- 172.21.15.16:0/2307560194 <== osd.4 v2:172.21.15.117:6816/2302216214 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f72f0007130 con 0x7f72d80729e0 2023-08-25T04:45:49.591 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-08-25T04:45:49.592 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T04:45:49.592 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-08-25T04:45:49.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.590+0000 7f72fe24d700 1 -- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:6816/2302216214,v1:172.21.15.117:6817/2302216214] conn(0x7f72d80729e0 msgr2=0x7f72d8074e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.590+0000 7f72fe24d700 1 --2- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:6816/2302216214,v1:172.21.15.117:6817/2302216214] conn(0x7f72d80729e0 0x7f72d8074e20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.590+0000 7f72fe24d700 1 -- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f72d806a0e0 msgr2=0x7f72d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.590+0000 7f72fe24d700 1 --2- 172.21.15.16:0/2307560194 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f72d806a0e0 0x7f72d806c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f72e0004f30 tx=0x7f72e0009040 comp rx=0 tx=0).stop 2023-08-25T04:45:49.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.590+0000 7f72fe24d700 1 -- 172.21.15.16:0/2307560194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f815b010 msgr2=0x7f72f814c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.590+0000 7f72fe24d700 1 --2- 172.21.15.16:0/2307560194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f815b010 0x7f72f814c580 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f72f80cea70 tx=0x7f72e80047c0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.590+0000 7f72f7fff700 1 -- 172.21.15.16:0/2307560194 reap_dead start 2023-08-25T04:45:49.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.590+0000 7f72fe24d700 1 -- 172.21.15.16:0/2307560194 shutdown_connections 2023-08-25T04:45:49.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.590+0000 7f72fe24d700 1 -- 172.21.15.16:0/2307560194 >> 172.21.15.16:0/2307560194 conn(0x7f72f80b1cb0 msgr2=0x7f72f815f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:49.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.591+0000 7f72fe24d700 1 -- 172.21.15.16:0/2307560194 shutdown_connections 2023-08-25T04:45:49.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.591+0000 7f72fe24d700 1 -- 172.21.15.16:0/2307560194 wait complete. 2023-08-25T04:45:49.603 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-08-25T04:45:49.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.728+0000 7f5226359700 1 Processor -- start 2023-08-25T04:45:49.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.728+0000 7f5226359700 1 -- start start 2023-08-25T04:45:49.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.729+0000 7f5226359700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f522015cf40 0x7f52200cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.729+0000 7f5226359700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52200cf970 0x7f522006a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.729+0000 7f5226359700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52200ac850 con 0x7f522015d320 2023-08-25T04:45:49.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.729+0000 7f5226359700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52200ce240 con 0x7f52200cf970 2023-08-25T04:45:49.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.729+0000 7f5226359700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5220071a60 con 0x7f522015cf40 2023-08-25T04:45:49.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.729+0000 7f521f7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52200cf970 0x7f522006a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.729+0000 7f521f7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52200cf970 0x7f522006a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50448/0 (socket says 172.21.15.16:50448) 2023-08-25T04:45:49.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.729+0000 7f521f7fe700 1 -- 172.21.15.16:0/3026491409 learned_addr learned my addr 172.21.15.16:0/3026491409 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:49.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.730+0000 7f521ffff700 1 --2- 172.21.15.16:0/3026491409 >> v2:172.21.15.117:3300/0 conn(0x7f522015cf40 0x7f52200cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.730+0000 7f521f7fe700 1 -- 172.21.15.16:0/3026491409 >> v2:172.21.15.117:3300/0 conn(0x7f522015cf40 msgr2=0x7f52200cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:49.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.730+0000 7f521f7fe700 1 --2- 172.21.15.16:0/3026491409 >> v2:172.21.15.117:3300/0 conn(0x7f522015cf40 0x7f52200cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.730+0000 7f521f7fe700 1 -- 172.21.15.16:0/3026491409 >> v1:172.21.15.117:6789/0 conn(0x7f522015d320 legacy=0x7f5220160d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.730+0000 7f521f7fe700 1 -- 172.21.15.16:0/3026491409 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5220071d40 con 0x7f52200cf970 2023-08-25T04:45:49.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.730+0000 7f521f7fe700 1 --2- 172.21.15.16:0/3026491409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52200cf970 0x7f522006a340 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f52200cd900 tx=0x7f5208009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4e22353e17a4b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.730+0000 7f521effd700 1 -- 172.21.15.16:0/3026491409 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208011830 con 0x7f52200cf970 2023-08-25T04:45:49.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.730+0000 7f521effd700 1 -- 172.21.15.16:0/3026491409 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5208011990 con 0x7f52200cf970 2023-08-25T04:45:49.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.730+0000 7f521effd700 1 -- 172.21.15.16:0/3026491409 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208011d20 con 0x7f52200cf970 2023-08-25T04:45:49.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.731+0000 7f5226359700 1 -- 172.21.15.16:0/3026491409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52200cf970 msgr2=0x7f522006a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.731+0000 7f5226359700 1 --2- 172.21.15.16:0/3026491409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52200cf970 0x7f522006a340 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f52200cd900 tx=0x7f5208009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.731+0000 7f5226359700 1 -- 172.21.15.16:0/3026491409 shutdown_connections 2023-08-25T04:45:49.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.731+0000 7f5226359700 1 --2- 172.21.15.16:0/3026491409 >> v2:172.21.15.117:3300/0 conn(0x7f522015cf40 0x7f52200cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.731+0000 7f5226359700 1 --2- 172.21.15.16:0/3026491409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52200cf970 0x7f522006a340 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.731+0000 7f5226359700 1 -- 172.21.15.16:0/3026491409 >> 172.21.15.16:0/3026491409 conn(0x7f52200b1a10 msgr2=0x7f52200b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:49.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.731+0000 7f5226359700 1 -- 172.21.15.16:0/3026491409 shutdown_connections 2023-08-25T04:45:49.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.731+0000 7f5226359700 1 -- 172.21.15.16:0/3026491409 wait complete. 2023-08-25T04:45:49.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.732+0000 7f5226359700 1 Processor -- start 2023-08-25T04:45:49.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.732+0000 7f5226359700 1 -- start start 2023-08-25T04:45:49.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f5226359700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52200cf970 0x7f522015a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f5226359700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f522015cf40 0x7f52200b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f5226359700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f522015d320 0x7f52200b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f5226359700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52200c41d0 con 0x7f52200cf970 2023-08-25T04:45:49.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f5226359700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52200c68c0 con 0x7f522015cf40 2023-08-25T04:45:49.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f5226359700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52200c65e0 con 0x7f522015d320 2023-08-25T04:45:49.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f521ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52200cf970 0x7f522015a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f521ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52200cf970 0x7f522015a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50450/0 (socket says 172.21.15.16:50450) 2023-08-25T04:45:49.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f521ffff700 1 -- 172.21.15.16:0/4066313097 learned_addr learned my addr 172.21.15.16:0/4066313097 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:49.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f521f7fe700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f522015cf40 0x7f52200b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f52248f6700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f522015d320 0x7f52200b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f521ffff700 1 -- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f522015d320 msgr2=0x7f52200b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f521ffff700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f522015d320 0x7f52200b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f521ffff700 1 -- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f522015cf40 msgr2=0x7f52200b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f521ffff700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f522015cf40 0x7f52200b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f521ffff700 1 -- 172.21.15.16:0/4066313097 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5208009550 con 0x7f52200cf970 2023-08-25T04:45:49.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f521f7fe700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f522015cf40 0x7f52200b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:49.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.733+0000 7f521ffff700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52200cf970 0x7f522015a160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f521000e9b0 tx=0x7f521000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.734+0000 7f521cff9700 1 -- 172.21.15.16:0/4066313097 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5210009710 con 0x7f52200cf970 2023-08-25T04:45:49.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.734+0000 7f521cff9700 1 -- 172.21.15.16:0/4066313097 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521000c850 con 0x7f52200cf970 2023-08-25T04:45:49.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.734+0000 7f5226359700 1 -- 172.21.15.16:0/4066313097 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52200c3b10 con 0x7f52200cf970 2023-08-25T04:45:49.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.734+0000 7f521cff9700 1 -- 172.21.15.16:0/4066313097 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521000cbc0 con 0x7f52200cf970 2023-08-25T04:45:49.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.734+0000 7f5226359700 1 -- 172.21.15.16:0/4066313097 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52200c6170 con 0x7f52200cf970 2023-08-25T04:45:49.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.735+0000 7f5226359700 1 -- 172.21.15.16:0/4066313097 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52200c3970 con 0x7f52200cf970 2023-08-25T04:45:49.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.735+0000 7f521cff9700 1 -- 172.21.15.16:0/4066313097 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f521000cd20 con 0x7f52200cf970 2023-08-25T04:45:49.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.735+0000 7f521cff9700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f520006a0e0 0x7f520006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.736+0000 7f521cff9700 1 -- 172.21.15.16:0/4066313097 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5210088610 con 0x7f52200cf970 2023-08-25T04:45:49.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.736+0000 7f521f7fe700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f520006a0e0 0x7f520006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.736+0000 7f521f7fe700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f520006a0e0 0x7f520006c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f52200cfde0 tx=0x7f5208008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.740+0000 7f521cff9700 1 -- 172.21.15.16:0/4066313097 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f52200c3970 con 0x7f52200cf970 2023-08-25T04:45:49.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.942+0000 7f5226359700 1 -- 172.21.15.16:0/4066313097 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f52200cdf50 con 0x7f520006a0e0 2023-08-25T04:45:49.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.943+0000 7f521cff9700 1 -- 172.21.15.16:0/4066313097 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5208011c00 con 0x7f520006a0e0 2023-08-25T04:45:49.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.945+0000 7f5226359700 1 -- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f520006a0e0 msgr2=0x7f520006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.945+0000 7f5226359700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f520006a0e0 0x7f520006c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f52200cfde0 tx=0x7f5208008030 comp rx=0 tx=0).stop 2023-08-25T04:45:49.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.945+0000 7f5226359700 1 -- 172.21.15.16:0/4066313097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52200cf970 msgr2=0x7f522015a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.945+0000 7f5226359700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52200cf970 0x7f522015a160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f521000e9b0 tx=0x7f521000ecc0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.945+0000 7f5226359700 1 -- 172.21.15.16:0/4066313097 shutdown_connections 2023-08-25T04:45:49.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.945+0000 7f5226359700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f520006a0e0 0x7f520006c5a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.945+0000 7f5226359700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f522015d320 0x7f52200b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.945+0000 7f5226359700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52200cf970 0x7f522015a160 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.945+0000 7f5226359700 1 --2- 172.21.15.16:0/4066313097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f522015cf40 0x7f52200b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.945+0000 7f5226359700 1 -- 172.21.15.16:0/4066313097 >> 172.21.15.16:0/4066313097 conn(0x7f52200b1a10 msgr2=0x7f52200d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:49.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.945+0000 7f5226359700 1 -- 172.21.15.16:0/4066313097 shutdown_connections 2023-08-25T04:45:49.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:49.945+0000 7f5226359700 1 -- 172.21.15.16:0/4066313097 wait complete. 2023-08-25T04:45:49.949 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 4 to deep-scrub 2023-08-25T04:45:49.958 INFO:tasks.ceph:Scrubbing osd.5 2023-08-25T04:45:49.959 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-08-25T04:45:50.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.087+0000 7fd237280700 1 Processor -- start 2023-08-25T04:45:50.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.087+0000 7fd237280700 1 -- start start 2023-08-25T04:45:50.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd237280700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23015ad60 0x7fd23015e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd237280700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd2300cf660 0x7fd23006cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd237280700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd23006d490 0x7fd23006a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd237280700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd230071060 con 0x7fd23006d490 2023-08-25T04:45:50.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd237280700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2300cdb90 con 0x7fd2300cf660 2023-08-25T04:45:50.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd237280700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300cde70 con 0x7fd23015ad60 2023-08-25T04:45:50.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd23581d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd23006d490 0x7fd23006a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd23581d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd23006d490 0x7fd23006a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50460/0 (socket says 172.21.15.16:50460) 2023-08-25T04:45:50.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd23581d700 1 -- 172.21.15.16:0/4160987982 learned_addr learned my addr 172.21.15.16:0/4160987982 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:50.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd23481b700 1 --2- 172.21.15.16:0/4160987982 >> v2:172.21.15.117:3300/0 conn(0x7fd2300cf660 0x7fd23006cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd23501c700 1 --2- 172.21.15.16:0/4160987982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23015ad60 0x7fd23015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd23581d700 1 -- 172.21.15.16:0/4160987982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23015ad60 msgr2=0x7fd23015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:50.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd23581d700 1 --2- 172.21.15.16:0/4160987982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23015ad60 0x7fd23015e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd23581d700 1 -- 172.21.15.16:0/4160987982 >> v2:172.21.15.117:3300/0 conn(0x7fd2300cf660 msgr2=0x7fd23006cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:50.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd23581d700 1 --2- 172.21.15.16:0/4160987982 >> v2:172.21.15.117:3300/0 conn(0x7fd2300cf660 0x7fd23006cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.088+0000 7fd23581d700 1 -- 172.21.15.16:0/4160987982 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd230071300 con 0x7fd23006d490 2023-08-25T04:45:50.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.089+0000 7fd23581d700 1 --2- 172.21.15.16:0/4160987982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23006d490 0x7fd23006a340 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd2300cd9d0 tx=0x7fd22800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce1e75232adddb1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.089+0000 7fd227fff700 1 -- 172.21.15.16:0/4160987982 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800e070 con 0x7fd23006d490 2023-08-25T04:45:50.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.089+0000 7fd227fff700 1 -- 172.21.15.16:0/4160987982 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22800b9c0 con 0x7fd23006d490 2023-08-25T04:45:50.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.089+0000 7fd227fff700 1 -- 172.21.15.16:0/4160987982 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800bd70 con 0x7fd23006d490 2023-08-25T04:45:50.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.089+0000 7fd237280700 1 -- 172.21.15.16:0/4160987982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23006d490 msgr2=0x7fd23006a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.089+0000 7fd237280700 1 --2- 172.21.15.16:0/4160987982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23006d490 0x7fd23006a340 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd2300cd9d0 tx=0x7fd22800b330 comp rx=0 tx=0).stop 2023-08-25T04:45:50.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.089+0000 7fd237280700 1 -- 172.21.15.16:0/4160987982 shutdown_connections 2023-08-25T04:45:50.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.089+0000 7fd237280700 1 --2- 172.21.15.16:0/4160987982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23006d490 0x7fd23006a340 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.089+0000 7fd237280700 1 --2- 172.21.15.16:0/4160987982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23015ad60 0x7fd23015e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.089+0000 7fd237280700 1 --2- 172.21.15.16:0/4160987982 >> v2:172.21.15.117:3300/0 conn(0x7fd2300cf660 0x7fd23006cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.089+0000 7fd237280700 1 -- 172.21.15.16:0/4160987982 >> 172.21.15.16:0/4160987982 conn(0x7fd2300b19a0 msgr2=0x7fd2300b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:50.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.089+0000 7fd237280700 1 -- 172.21.15.16:0/4160987982 shutdown_connections 2023-08-25T04:45:50.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.090+0000 7fd237280700 1 -- 172.21.15.16:0/4160987982 wait complete. 2023-08-25T04:45:50.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.091+0000 7fd237280700 1 Processor -- start 2023-08-25T04:45:50.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.091+0000 7fd237280700 1 -- start start 2023-08-25T04:45:50.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.091+0000 7fd237280700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23006d490 0x7fd230155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.091+0000 7fd237280700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2300cf660 0x7fd2301f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.091+0000 7fd237280700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23015ad60 0x7fd2301f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.091+0000 7fd237280700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd230152e30 con 0x7fd23006d490 2023-08-25T04:45:50.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.091+0000 7fd237280700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd230155cd0 con 0x7fd2300cf660 2023-08-25T04:45:50.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.091+0000 7fd237280700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd230155fb0 con 0x7fd23015ad60 2023-08-25T04:45:50.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd23501c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23006d490 0x7fd230155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd23501c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23006d490 0x7fd230155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50462/0 (socket says 172.21.15.16:50462) 2023-08-25T04:45:50.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd23501c700 1 -- 172.21.15.16:0/1072740805 learned_addr learned my addr 172.21.15.16:0/1072740805 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:50.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd23481b700 1 --2- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2300cf660 0x7fd2301f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd23581d700 1 --2- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23015ad60 0x7fd2301f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd23501c700 1 -- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23015ad60 msgr2=0x7fd2301f2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd23501c700 1 --2- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23015ad60 0x7fd2301f2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd23501c700 1 -- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2300cf660 msgr2=0x7fd2301f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd23501c700 1 --2- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2300cf660 0x7fd2301f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd23501c700 1 -- 172.21.15.16:0/1072740805 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd228009b30 con 0x7fd23006d490 2023-08-25T04:45:50.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd23501c700 1 --2- 172.21.15.16:0/1072740805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23006d490 0x7fd230155460 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd22000d800 tx=0x7fd22000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd225ffb700 1 -- 172.21.15.16:0/1072740805 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200125f0 con 0x7fd23006d490 2023-08-25T04:45:50.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd225ffb700 1 -- 172.21.15.16:0/1072740805 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd220012750 con 0x7fd23006d490 2023-08-25T04:45:50.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd237280700 1 -- 172.21.15.16:0/1072740805 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd230156290 con 0x7fd23006d490 2023-08-25T04:45:50.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd225ffb700 1 -- 172.21.15.16:0/1072740805 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220012b00 con 0x7fd23006d490 2023-08-25T04:45:50.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.092+0000 7fd237280700 1 -- 172.21.15.16:0/1072740805 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2300c4d90 con 0x7fd23006d490 2023-08-25T04:45:50.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.093+0000 7fd237280700 1 -- 172.21.15.16:0/1072740805 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd23015b140 con 0x7fd23006d490 2023-08-25T04:45:50.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.094+0000 7fd225ffb700 1 -- 172.21.15.16:0/1072740805 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd220012c60 con 0x7fd23006d490 2023-08-25T04:45:50.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.095+0000 7fd225ffb700 1 --2- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd21406a0e0 0x7fd21406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.095+0000 7fd225ffb700 1 -- 172.21.15.16:0/1072740805 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd220089000 con 0x7fd23006d490 2023-08-25T04:45:50.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.095+0000 7fd225ffb700 1 --2- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:6806/3890202206,v1:172.21.15.117:6808/3890202206] conn(0x7fd2140729e0 0x7fd214074e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.095+0000 7fd225ffb700 1 -- 172.21.15.16:0/1072740805 --> [v2:172.21.15.117:6806/3890202206,v1:172.21.15.117:6808/3890202206] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2140754f0 con 0x7fd2140729e0 2023-08-25T04:45:50.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.095+0000 7fd225ffb700 1 -- 172.21.15.16:0/1072740805 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd220089450 con 0x7fd23006d490 2023-08-25T04:45:50.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.095+0000 7fd23481b700 1 --2- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd21406a0e0 0x7fd21406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.095+0000 7fd23581d700 1 --2- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:6806/3890202206,v1:172.21.15.117:6808/3890202206] conn(0x7fd2140729e0 0x7fd214074e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.095+0000 7fd23481b700 1 --2- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd21406a0e0 0x7fd21406c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd2301f0260 tx=0x7fd22c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.096+0000 7fd23581d700 1 --2- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:6806/3890202206,v1:172.21.15.117:6808/3890202206] conn(0x7fd2140729e0 0x7fd214074e20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.096+0000 7fd225ffb700 1 -- 172.21.15.16:0/1072740805 <== osd.5 v2:172.21.15.117:6806/3890202206 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd2140754f0 con 0x7fd2140729e0 2023-08-25T04:45:50.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.111+0000 7fd237280700 1 -- 172.21.15.16:0/1072740805 --> [v2:172.21.15.117:6806/3890202206,v1:172.21.15.117:6808/3890202206] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd2300ce150 con 0x7fd2140729e0 2023-08-25T04:45:50.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.111+0000 7fd225ffb700 1 -- 172.21.15.16:0/1072740805 <== osd.5 v2:172.21.15.117:6806/3890202206 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd22800bd50 con 0x7fd2140729e0 2023-08-25T04:45:50.113 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-08-25T04:45:50.113 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T04:45:50.114 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-08-25T04:45:50.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.112+0000 7fd237280700 1 -- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:6806/3890202206,v1:172.21.15.117:6808/3890202206] conn(0x7fd2140729e0 msgr2=0x7fd214074e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.112+0000 7fd237280700 1 --2- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:6806/3890202206,v1:172.21.15.117:6808/3890202206] conn(0x7fd2140729e0 0x7fd214074e20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.112+0000 7fd237280700 1 -- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd21406a0e0 msgr2=0x7fd21406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.112+0000 7fd237280700 1 --2- 172.21.15.16:0/1072740805 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fd21406a0e0 0x7fd21406c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd2301f0260 tx=0x7fd22c008040 comp rx=0 tx=0).stop 2023-08-25T04:45:50.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.112+0000 7fd237280700 1 -- 172.21.15.16:0/1072740805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23006d490 msgr2=0x7fd230155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.112+0000 7fd237280700 1 --2- 172.21.15.16:0/1072740805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23006d490 0x7fd230155460 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd22000d800 tx=0x7fd22000db10 comp rx=0 tx=0).stop 2023-08-25T04:45:50.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.112+0000 7fd23581d700 1 -- 172.21.15.16:0/1072740805 reap_dead start 2023-08-25T04:45:50.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.112+0000 7fd237280700 1 -- 172.21.15.16:0/1072740805 shutdown_connections 2023-08-25T04:45:50.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.112+0000 7fd237280700 1 -- 172.21.15.16:0/1072740805 >> 172.21.15.16:0/1072740805 conn(0x7fd2300b19a0 msgr2=0x7fd23006a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:50.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.112+0000 7fd237280700 1 -- 172.21.15.16:0/1072740805 shutdown_connections 2023-08-25T04:45:50.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.112+0000 7fd237280700 1 -- 172.21.15.16:0/1072740805 wait complete. 2023-08-25T04:45:50.125 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-08-25T04:45:50.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.250+0000 7f4adcfea700 1 Processor -- start 2023-08-25T04:45:50.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.250+0000 7f4adcfea700 1 -- start start 2023-08-25T04:45:50.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4adcfea700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4ad815e670 0x7f4ad80ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4adcfea700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad806a340 0x7f4ad806a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4adcfea700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4ad80cc820 0x7f4ad80ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4adcfea700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad806ad00 con 0x7f4ad80cc820 2023-08-25T04:45:50.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4adcfea700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad80713e0 con 0x7f4ad815e670 2023-08-25T04:45:50.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4adcfea700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad815ea50 con 0x7f4ad806a340 2023-08-25T04:45:50.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4ad6d9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4ad80cc820 0x7f4ad80ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4ad6d9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4ad80cc820 0x7f4ad80ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50476/0 (socket says 172.21.15.16:50476) 2023-08-25T04:45:50.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4ad6d9d700 1 -- 172.21.15.16:0/61724885 learned_addr learned my addr 172.21.15.16:0/61724885 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:50.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4ad659c700 1 --2- 172.21.15.16:0/61724885 >> v2:172.21.15.117:3300/0 conn(0x7f4ad815e670 0x7f4ad80ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4ad5d9b700 1 --2- 172.21.15.16:0/61724885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad806a340 0x7f4ad806a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4ad6d9d700 1 -- 172.21.15.16:0/61724885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad806a340 msgr2=0x7f4ad806a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:50.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4ad6d9d700 1 --2- 172.21.15.16:0/61724885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad806a340 0x7f4ad806a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4ad6d9d700 1 -- 172.21.15.16:0/61724885 >> v2:172.21.15.117:3300/0 conn(0x7f4ad815e670 msgr2=0x7f4ad80ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:50.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4ad6d9d700 1 --2- 172.21.15.16:0/61724885 >> v2:172.21.15.117:3300/0 conn(0x7f4ad815e670 0x7f4ad80ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4ad6d9d700 1 -- 172.21.15.16:0/61724885 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad80ca9d0 con 0x7f4ad80cc820 2023-08-25T04:45:50.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.251+0000 7f4ad6d9d700 1 --2- 172.21.15.16:0/61724885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ad80cc820 0x7f4ad80ccc70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80740f0 tx=0x7f4ad000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a68f22256400f67 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.252+0000 7f4ad559a700 1 -- 172.21.15.16:0/61724885 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000e070 con 0x7f4ad80cc820 2023-08-25T04:45:50.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.252+0000 7f4ad559a700 1 -- 172.21.15.16:0/61724885 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad000b9c0 con 0x7f4ad80cc820 2023-08-25T04:45:50.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.252+0000 7f4ad559a700 1 -- 172.21.15.16:0/61724885 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000bd70 con 0x7f4ad80cc820 2023-08-25T04:45:50.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.252+0000 7f4adcfea700 1 -- 172.21.15.16:0/61724885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ad80cc820 msgr2=0x7f4ad80ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.252+0000 7f4adcfea700 1 --2- 172.21.15.16:0/61724885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ad80cc820 0x7f4ad80ccc70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80740f0 tx=0x7f4ad000b330 comp rx=0 tx=0).stop 2023-08-25T04:45:50.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.252+0000 7f4adcfea700 1 -- 172.21.15.16:0/61724885 shutdown_connections 2023-08-25T04:45:50.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.252+0000 7f4adcfea700 1 --2- 172.21.15.16:0/61724885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ad80cc820 0x7f4ad80ccc70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.252+0000 7f4adcfea700 1 --2- 172.21.15.16:0/61724885 >> v2:172.21.15.117:3300/0 conn(0x7f4ad815e670 0x7f4ad80ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.252+0000 7f4adcfea700 1 --2- 172.21.15.16:0/61724885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad806a340 0x7f4ad806a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.252+0000 7f4adcfea700 1 -- 172.21.15.16:0/61724885 >> 172.21.15.16:0/61724885 conn(0x7f4ad80b1a10 msgr2=0x7f4ad80b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:50.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.252+0000 7f4adcfea700 1 -- 172.21.15.16:0/61724885 shutdown_connections 2023-08-25T04:45:50.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.252+0000 7f4adcfea700 1 -- 172.21.15.16:0/61724885 wait complete. 2023-08-25T04:45:50.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.254+0000 7f4adcfea700 1 Processor -- start 2023-08-25T04:45:50.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.254+0000 7f4adcfea700 1 -- start start 2023-08-25T04:45:50.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.254+0000 7f4adcfea700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad806a340 0x7f4ad81583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.254+0000 7f4adcfea700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad80cc820 0x7f4ad80c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.254+0000 7f4adcfea700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ad815e670 0x7f4ad806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.254+0000 7f4adcfea700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad80c6860 con 0x7f4ad815e670 2023-08-25T04:45:50.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.254+0000 7f4adcfea700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad80c3eb0 con 0x7f4ad80cc820 2023-08-25T04:45:50.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.254+0000 7f4adcfea700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad80c4130 con 0x7f4ad806a340 2023-08-25T04:45:50.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.254+0000 7f4ad6d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ad815e670 0x7f4ad806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4ad6d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ad815e670 0x7f4ad806ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50482/0 (socket says 172.21.15.16:50482) 2023-08-25T04:45:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4ad6d9d700 1 -- 172.21.15.16:0/118674521 learned_addr learned my addr 172.21.15.16:0/118674521 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4ad5d9b700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad80cc820 0x7f4ad80c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4ad659c700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad806a340 0x7f4ad81583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4ad6d9d700 1 -- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad806a340 msgr2=0x7f4ad81583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4ad6d9d700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad806a340 0x7f4ad81583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4ad6d9d700 1 -- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad80cc820 msgr2=0x7f4ad80c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4ad6d9d700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad80cc820 0x7f4ad80c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4ad6d9d700 1 -- 172.21.15.16:0/118674521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0009b30 con 0x7f4ad815e670 2023-08-25T04:45:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4ad659c700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad806a340 0x7f4ad81583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4ad6d9d700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ad815e670 0x7f4ad806ced0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80cfcc0 tx=0x7f4ad0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4ac6ffd700 1 -- 172.21.15.16:0/118674521 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0004310 con 0x7f4ad815e670 2023-08-25T04:45:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4ac6ffd700 1 -- 172.21.15.16:0/118674521 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad0004490 con 0x7f4ad815e670 2023-08-25T04:45:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4adcfea700 1 -- 172.21.15.16:0/118674521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad80af920 con 0x7f4ad815e670 2023-08-25T04:45:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4ac6ffd700 1 -- 172.21.15.16:0/118674521 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0004840 con 0x7f4ad815e670 2023-08-25T04:45:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.255+0000 7f4adcfea700 1 -- 172.21.15.16:0/118674521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad80afee0 con 0x7f4ad815e670 2023-08-25T04:45:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.256+0000 7f4adcfea700 1 -- 172.21.15.16:0/118674521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad804ee70 con 0x7f4ad815e670 2023-08-25T04:45:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.257+0000 7f4ac6ffd700 1 -- 172.21.15.16:0/118674521 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ad001c440 con 0x7f4ad815e670 2023-08-25T04:45:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.257+0000 7f4ac6ffd700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4ab806a0e0 0x7f4ab806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.257+0000 7f4ac6ffd700 1 -- 172.21.15.16:0/118674521 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4ad0089b80 con 0x7f4ad815e670 2023-08-25T04:45:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.257+0000 7f4ad659c700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4ab806a0e0 0x7f4ab806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.258+0000 7f4ad659c700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4ab806a0e0 0x7f4ab806c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800a9b0 tx=0x7f4ac8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.261+0000 7f4ac6ffd700 1 -- 172.21.15.16:0/118674521 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4ad00552c0 con 0x7f4ad815e670 2023-08-25T04:45:50.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.461+0000 7f4adcfea700 1 -- 172.21.15.16:0/118674521 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ad8071630 con 0x7f4ab806a0e0 2023-08-25T04:45:50.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.462+0000 7f4ac6ffd700 1 -- 172.21.15.16:0/118674521 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4ac800ae20 con 0x7f4ab806a0e0 2023-08-25T04:45:50.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.464+0000 7f4adcfea700 1 -- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4ab806a0e0 msgr2=0x7f4ab806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.464+0000 7f4adcfea700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4ab806a0e0 0x7f4ab806c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800a9b0 tx=0x7f4ac8008040 comp rx=0 tx=0).stop 2023-08-25T04:45:50.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.464+0000 7f4adcfea700 1 -- 172.21.15.16:0/118674521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ad815e670 msgr2=0x7f4ad806ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.464+0000 7f4adcfea700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ad815e670 0x7f4ad806ced0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80cfcc0 tx=0x7f4ad0004ad0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.464+0000 7f4adcfea700 1 -- 172.21.15.16:0/118674521 shutdown_connections 2023-08-25T04:45:50.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.464+0000 7f4adcfea700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4ab806a0e0 0x7f4ab806c5a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.464+0000 7f4adcfea700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ad815e670 0x7f4ad806ced0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.464+0000 7f4adcfea700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ad806a340 0x7f4ad81583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.464+0000 7f4adcfea700 1 --2- 172.21.15.16:0/118674521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad80cc820 0x7f4ad80c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.464+0000 7f4adcfea700 1 -- 172.21.15.16:0/118674521 >> 172.21.15.16:0/118674521 conn(0x7f4ad80b1a10 msgr2=0x7f4ad815cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:50.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.464+0000 7f4adcfea700 1 -- 172.21.15.16:0/118674521 shutdown_connections 2023-08-25T04:45:50.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.464+0000 7f4adcfea700 1 -- 172.21.15.16:0/118674521 wait complete. 2023-08-25T04:45:50.468 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 5 to deep-scrub 2023-08-25T04:45:50.479 INFO:tasks.ceph:Scrubbing osd.6 2023-08-25T04:45:50.480 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-08-25T04:45:50.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.608+0000 7f91aaadc700 1 Processor -- start 2023-08-25T04:45:50.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.608+0000 7f91aaadc700 1 -- start start 2023-08-25T04:45:50.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.609+0000 7f91aaadc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f91a415b010 0x7f91a4071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.609+0000 7f91aaadc700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f91a415daf0 0x7f91a415df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.609+0000 7f91aaadc700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a415e460 con 0x7f91a40b27a0 2023-08-25T04:45:50.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.609+0000 7f91aaadc700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a40ce8e0 con 0x7f91a415b010 2023-08-25T04:45:50.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.609+0000 7f91aaadc700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a4072640 con 0x7f91a415daf0 2023-08-25T04:45:50.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.609+0000 7f91a8878700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f91a415b010 0x7f91a4071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.609+0000 7f91a3fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f91a40b27a0 0x7f91a4161780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40902/0 (socket says 172.21.15.16:40902) 2023-08-25T04:45:50.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.609+0000 7f91a3fff700 1 -- 172.21.15.16:0/3511789362 learned_addr learned my addr 172.21.15.16:0/3511789362 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:50.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.609+0000 7f91a9079700 1 --2- 172.21.15.16:0/3511789362 >> v2:172.21.15.117:3300/0 conn(0x7f91a415daf0 0x7f91a415df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.609+0000 7f91a8878700 1 -- 172.21.15.16:0/3511789362 >> v2:172.21.15.117:3300/0 conn(0x7f91a415daf0 msgr2=0x7f91a415df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:50.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91a8878700 1 --2- 172.21.15.16:0/3511789362 >> v2:172.21.15.117:3300/0 conn(0x7f91a415daf0 0x7f91a415df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91a8878700 1 -- 172.21.15.16:0/3511789362 >> v1:172.21.15.16:6789/0 conn(0x7f91a40b27a0 legacy=0x7f91a4161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91a8878700 1 -- 172.21.15.16:0/3511789362 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a40ce040 con 0x7f91a415b010 2023-08-25T04:45:50.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91a37fe700 1 -- 172.21.15.16:0/3511789362 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083016653 0 0) 0x7f91a415e460 con 0x7f91a40b27a0 2023-08-25T04:45:50.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91a8878700 1 --2- 172.21.15.16:0/3511789362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a415b010 0x7f91a4071a70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f91a415ec40 tx=0x7f9198009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f4df6bb11fa214 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91a37fe700 1 -- 172.21.15.16:0/3511789362 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198011830 con 0x7f91a415b010 2023-08-25T04:45:50.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91a37fe700 1 -- 172.21.15.16:0/3511789362 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9198011990 con 0x7f91a415b010 2023-08-25T04:45:50.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91a37fe700 1 -- 172.21.15.16:0/3511789362 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198011d20 con 0x7f91a415b010 2023-08-25T04:45:50.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91aaadc700 1 -- 172.21.15.16:0/3511789362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a415b010 msgr2=0x7f91a4071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91aaadc700 1 --2- 172.21.15.16:0/3511789362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a415b010 0x7f91a4071a70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f91a415ec40 tx=0x7f9198009b20 comp rx=0 tx=0).stop 2023-08-25T04:45:50.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91aaadc700 1 -- 172.21.15.16:0/3511789362 shutdown_connections 2023-08-25T04:45:50.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91aaadc700 1 --2- 172.21.15.16:0/3511789362 >> v2:172.21.15.117:3300/0 conn(0x7f91a415daf0 0x7f91a415df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91aaadc700 1 --2- 172.21.15.16:0/3511789362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a415b010 0x7f91a4071a70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91aaadc700 1 -- 172.21.15.16:0/3511789362 >> 172.21.15.16:0/3511789362 conn(0x7f91a40b1cb0 msgr2=0x7f91a40b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:50.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.610+0000 7f91aaadc700 1 -- 172.21.15.16:0/3511789362 shutdown_connections 2023-08-25T04:45:50.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.611+0000 7f91aaadc700 1 -- 172.21.15.16:0/3511789362 wait complete. 2023-08-25T04:45:50.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.612+0000 7f91aaadc700 1 Processor -- start 2023-08-25T04:45:50.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.612+0000 7f91aaadc700 1 -- start start 2023-08-25T04:45:50.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91aaadc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a40b27a0 0x7f91a41e8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91aaadc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a415b010 0x7f91a41e6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91aaadc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91a415daf0 0x7f91a41e6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91aaadc700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a40c4430 con 0x7f91a40b27a0 2023-08-25T04:45:50.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91aaadc700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a415c5f0 con 0x7f91a415daf0 2023-08-25T04:45:50.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91aaadc700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a40c4150 con 0x7f91a415b010 2023-08-25T04:45:50.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a8878700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a40b27a0 0x7f91a41e8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a8878700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a40b27a0 0x7f91a41e8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50492/0 (socket says 172.21.15.16:50492) 2023-08-25T04:45:50.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a8878700 1 -- 172.21.15.16:0/93290197 learned_addr learned my addr 172.21.15.16:0/93290197 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:50.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a3fff700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a415b010 0x7f91a41e6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a9079700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91a415daf0 0x7f91a41e6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a8878700 1 -- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a415b010 msgr2=0x7f91a41e6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a8878700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a415b010 0x7f91a41e6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a8878700 1 -- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91a415daf0 msgr2=0x7f91a41e6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a8878700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91a415daf0 0x7f91a41e6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a8878700 1 -- 172.21.15.16:0/93290197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91980094a0 con 0x7f91a40b27a0 2023-08-25T04:45:50.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a3fff700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91a415b010 0x7f91a41e6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:50.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a9079700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91a415daf0 0x7f91a41e6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:50.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a8878700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a40b27a0 0x7f91a41e8dd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f91980090b0 tx=0x7f9198004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a17fa700 1 -- 172.21.15.16:0/93290197 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91980038a0 con 0x7f91a40b27a0 2023-08-25T04:45:50.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a17fa700 1 -- 172.21.15.16:0/93290197 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919801f070 con 0x7f91a40b27a0 2023-08-25T04:45:50.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91a17fa700 1 -- 172.21.15.16:0/93290197 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198003c20 con 0x7f91a40b27a0 2023-08-25T04:45:50.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91aaadc700 1 -- 172.21.15.16:0/93290197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a415bfa0 con 0x7f91a40b27a0 2023-08-25T04:45:50.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.613+0000 7f91aaadc700 1 -- 172.21.15.16:0/93290197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a4154750 con 0x7f91a40b27a0 2023-08-25T04:45:50.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.614+0000 7f91aaadc700 1 -- 172.21.15.16:0/93290197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91a40ce600 con 0x7f91a40b27a0 2023-08-25T04:45:50.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.615+0000 7f91a17fa700 1 -- 172.21.15.16:0/93290197 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f919801a430 con 0x7f91a40b27a0 2023-08-25T04:45:50.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.615+0000 7f91a17fa700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f918806a0e0 0x7f918806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.615+0000 7f91a17fa700 1 -- 172.21.15.16:0/93290197 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9198021070 con 0x7f91a40b27a0 2023-08-25T04:45:50.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.615+0000 7f91a17fa700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:6800/2380390161,v1:172.21.15.117:6801/2380390161] conn(0x7f91880729e0 0x7f9188074e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.615+0000 7f91a17fa700 1 -- 172.21.15.16:0/93290197 --> [v2:172.21.15.117:6800/2380390161,v1:172.21.15.117:6801/2380390161] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91880754f0 con 0x7f91880729e0 2023-08-25T04:45:50.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.616+0000 7f91a3fff700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f918806a0e0 0x7f918806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.616+0000 7f91a17fa700 1 -- 172.21.15.16:0/93290197 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f919808c440 con 0x7f91a40b27a0 2023-08-25T04:45:50.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.616+0000 7f91a9079700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:6800/2380390161,v1:172.21.15.117:6801/2380390161] conn(0x7f91880729e0 0x7f9188074e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.616+0000 7f91a3fff700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f918806a0e0 0x7f918806c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91a415da30 tx=0x7f9190009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.616+0000 7f91a9079700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:6800/2380390161,v1:172.21.15.117:6801/2380390161] conn(0x7f91880729e0 0x7f9188074e20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.617+0000 7f91a17fa700 1 -- 172.21.15.16:0/93290197 <== osd.6 v2:172.21.15.117:6800/2380390161 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f91880754f0 con 0x7f91880729e0 2023-08-25T04:45:50.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.632+0000 7f91aaadc700 1 -- 172.21.15.16:0/93290197 --> [v2:172.21.15.117:6800/2380390161,v1:172.21.15.117:6801/2380390161] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f91a40ce320 con 0x7f91880729e0 2023-08-25T04:45:50.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.633+0000 7f91a17fa700 1 -- 172.21.15.16:0/93290197 <== osd.6 v2:172.21.15.117:6800/2380390161 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f919c003a20 con 0x7f91880729e0 2023-08-25T04:45:50.634 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-08-25T04:45:50.635 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T04:45:50.635 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-08-25T04:45:50.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.633+0000 7f91aaadc700 1 -- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:6800/2380390161,v1:172.21.15.117:6801/2380390161] conn(0x7f91880729e0 msgr2=0x7f9188074e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.633+0000 7f91aaadc700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:6800/2380390161,v1:172.21.15.117:6801/2380390161] conn(0x7f91880729e0 0x7f9188074e20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.633+0000 7f91aaadc700 1 -- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f918806a0e0 msgr2=0x7f918806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.633+0000 7f91aaadc700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f918806a0e0 0x7f918806c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91a415da30 tx=0x7f9190009040 comp rx=0 tx=0).stop 2023-08-25T04:45:50.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.633+0000 7f91aaadc700 1 -- 172.21.15.16:0/93290197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a40b27a0 msgr2=0x7f91a41e8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.633+0000 7f91aaadc700 1 --2- 172.21.15.16:0/93290197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a40b27a0 0x7f91a41e8dd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f91980090b0 tx=0x7f9198004750 comp rx=0 tx=0).stop 2023-08-25T04:45:50.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.633+0000 7f91a9079700 1 -- 172.21.15.16:0/93290197 reap_dead start 2023-08-25T04:45:50.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.633+0000 7f91aaadc700 1 -- 172.21.15.16:0/93290197 shutdown_connections 2023-08-25T04:45:50.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.633+0000 7f91aaadc700 1 -- 172.21.15.16:0/93290197 >> 172.21.15.16:0/93290197 conn(0x7f91a40b1cb0 msgr2=0x7f91a406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:50.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.633+0000 7f91aaadc700 1 -- 172.21.15.16:0/93290197 shutdown_connections 2023-08-25T04:45:50.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.633+0000 7f91aaadc700 1 -- 172.21.15.16:0/93290197 wait complete. 2023-08-25T04:45:50.647 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-08-25T04:45:50.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.778+0000 7fea2029a700 1 Processor -- start 2023-08-25T04:45:50.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.778+0000 7fea2029a700 1 -- start start 2023-08-25T04:45:50.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea2029a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fea180cf970 0x7fea1806a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea2029a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fea1815d320 0x7fea1806a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea2029a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180ac850 con 0x7fea1815cf40 2023-08-25T04:45:50.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea2029a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180ce240 con 0x7fea1815d320 2023-08-25T04:45:50.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea2029a700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea18071a60 con 0x7fea180cf970 2023-08-25T04:45:50.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea1e837700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fea1815d320 0x7fea1806a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea1e036700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fea1815cf40 0x7fea180cda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40916/0 (socket says 172.21.15.16:40916) 2023-08-25T04:45:50.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea1e036700 1 -- 172.21.15.16:0/3267143528 learned_addr learned my addr 172.21.15.16:0/3267143528 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:50.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea1d835700 1 --2- 172.21.15.16:0/3267143528 >> v2:172.21.15.117:3300/0 conn(0x7fea180cf970 0x7fea1806a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea1d034700 1 -- 172.21.15.16:0/3267143528 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114798316 0 0) 0x7fea180ac850 con 0x7fea1815cf40 2023-08-25T04:45:50.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea1d034700 1 -- 172.21.15.16:0/3267143528 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea040035b0 con 0x7fea1815cf40 2023-08-25T04:45:50.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea1e837700 1 -- 172.21.15.16:0/3267143528 >> v2:172.21.15.117:3300/0 conn(0x7fea180cf970 msgr2=0x7fea1806a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:50.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea1e837700 1 --2- 172.21.15.16:0/3267143528 >> v2:172.21.15.117:3300/0 conn(0x7fea180cf970 0x7fea1806a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea1e837700 1 -- 172.21.15.16:0/3267143528 >> v1:172.21.15.16:6789/0 conn(0x7fea1815cf40 legacy=0x7fea180cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.779+0000 7fea1e837700 1 -- 172.21.15.16:0/3267143528 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea18071d40 con 0x7fea1815d320 2023-08-25T04:45:50.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.780+0000 7fea1e837700 1 --2- 172.21.15.16:0/3267143528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1815d320 0x7fea1806a880 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fea1806c9c0 tx=0x7fea1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aca6d9f549cabbd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.780+0000 7fea1d034700 1 -- 172.21.15.16:0/3267143528 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1000e070 con 0x7fea1815d320 2023-08-25T04:45:50.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.780+0000 7fea1d034700 1 -- 172.21.15.16:0/3267143528 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1000bb20 con 0x7fea1815d320 2023-08-25T04:45:50.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.780+0000 7fea1d034700 1 -- 172.21.15.16:0/3267143528 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10012430 con 0x7fea1815d320 2023-08-25T04:45:50.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.780+0000 7fea2029a700 1 -- 172.21.15.16:0/3267143528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1815d320 msgr2=0x7fea1806a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.780+0000 7fea2029a700 1 --2- 172.21.15.16:0/3267143528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1815d320 0x7fea1806a880 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fea1806c9c0 tx=0x7fea1000b330 comp rx=0 tx=0).stop 2023-08-25T04:45:50.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.780+0000 7fea2029a700 1 -- 172.21.15.16:0/3267143528 shutdown_connections 2023-08-25T04:45:50.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.780+0000 7fea2029a700 1 --2- 172.21.15.16:0/3267143528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1815d320 0x7fea1806a880 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.780+0000 7fea2029a700 1 --2- 172.21.15.16:0/3267143528 >> v2:172.21.15.117:3300/0 conn(0x7fea180cf970 0x7fea1806a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.780+0000 7fea2029a700 1 -- 172.21.15.16:0/3267143528 >> 172.21.15.16:0/3267143528 conn(0x7fea180b1a10 msgr2=0x7fea180b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:50.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.780+0000 7fea2029a700 1 -- 172.21.15.16:0/3267143528 shutdown_connections 2023-08-25T04:45:50.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.780+0000 7fea2029a700 1 -- 172.21.15.16:0/3267143528 wait complete. 2023-08-25T04:45:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.782+0000 7fea2029a700 1 Processor -- start 2023-08-25T04:45:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.782+0000 7fea2029a700 1 -- start start 2023-08-25T04:45:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.782+0000 7fea2029a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180cf970 0x7fea181544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.782+0000 7fea2029a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea1815cf40 0x7fea180b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.782+0000 7fea2029a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1815d320 0x7fea180b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.782+0000 7fea2029a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18154ad0 con 0x7fea1815d320 2023-08-25T04:45:50.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.782+0000 7fea2029a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18154db0 con 0x7fea180cf970 2023-08-25T04:45:50.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.782+0000 7fea2029a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea18155090 con 0x7fea1815cf40 2023-08-25T04:45:50.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea1e837700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1815d320 0x7fea180b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea1e837700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1815d320 0x7fea180b2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50512/0 (socket says 172.21.15.16:50512) 2023-08-25T04:45:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea1e837700 1 -- 172.21.15.16:0/3543561872 learned_addr learned my addr 172.21.15.16:0/3543561872 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea1e036700 1 --2- 172.21.15.16:0/3543561872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180cf970 0x7fea181544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea1d835700 1 --2- 172.21.15.16:0/3543561872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea1815cf40 0x7fea180b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea1e837700 1 -- 172.21.15.16:0/3543561872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea1815cf40 msgr2=0x7fea180b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea1e837700 1 --2- 172.21.15.16:0/3543561872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea1815cf40 0x7fea180b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea1e837700 1 -- 172.21.15.16:0/3543561872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180cf970 msgr2=0x7fea181544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea1e837700 1 --2- 172.21.15.16:0/3543561872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180cf970 0x7fea181544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea1e837700 1 -- 172.21.15.16:0/3543561872 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea10009a70 con 0x7fea1815d320 2023-08-25T04:45:50.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea1e837700 1 --2- 172.21.15.16:0/3543561872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1815d320 0x7fea180b2ec0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fea10014040 tx=0x7fea10004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea0effd700 1 -- 172.21.15.16:0/3543561872 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea100129f0 con 0x7fea1815d320 2023-08-25T04:45:50.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea0effd700 1 -- 172.21.15.16:0/3543561872 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea10020070 con 0x7fea1815d320 2023-08-25T04:45:50.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea2029a700 1 -- 172.21.15.16:0/3543561872 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea18155370 con 0x7fea1815d320 2023-08-25T04:45:50.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea0effd700 1 -- 172.21.15.16:0/3543561872 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10012d90 con 0x7fea1815d320 2023-08-25T04:45:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.783+0000 7fea2029a700 1 -- 172.21.15.16:0/3543561872 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea18155b70 con 0x7fea1815d320 2023-08-25T04:45:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.784+0000 7fea2029a700 1 -- 172.21.15.16:0/3543561872 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea18155890 con 0x7fea1815d320 2023-08-25T04:45:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.785+0000 7fea0effd700 1 -- 172.21.15.16:0/3543561872 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fea10004040 con 0x7fea1815d320 2023-08-25T04:45:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.785+0000 7fea0effd700 1 --2- 172.21.15.16:0/3543561872 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe9fc06a0e0 0x7fe9fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.785+0000 7fea0effd700 1 -- 172.21.15.16:0/3543561872 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fea10022070 con 0x7fea1815d320 2023-08-25T04:45:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.785+0000 7fea1e036700 1 --2- 172.21.15.16:0/3543561872 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe9fc06a0e0 0x7fe9fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.786+0000 7fea1e036700 1 --2- 172.21.15.16:0/3543561872 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe9fc06a0e0 0x7fe9fc06c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea08007fd0 tx=0x7fea08007dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.789+0000 7fea0effd700 1 -- 172.21.15.16:0/3543561872 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fea18155890 con 0x7fea1815d320 2023-08-25T04:45:50.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.990+0000 7fea2029a700 1 -- 172.21.15.16:0/3543561872 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fea18072020 con 0x7fe9fc06a0e0 2023-08-25T04:45:50.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.990+0000 7fea0effd700 1 -- 172.21.15.16:0/3543561872 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fea080058e0 con 0x7fe9fc06a0e0 2023-08-25T04:45:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.993+0000 7fea2029a700 1 -- 172.21.15.16:0/3543561872 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe9fc06a0e0 msgr2=0x7fe9fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.993+0000 7fea2029a700 1 --2- 172.21.15.16:0/3543561872 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe9fc06a0e0 0x7fe9fc06c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea08007fd0 tx=0x7fea08007dc0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.993+0000 7fea2029a700 1 -- 172.21.15.16:0/3543561872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1815d320 msgr2=0x7fea180b2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.993+0000 7fea2029a700 1 --2- 172.21.15.16:0/3543561872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1815d320 0x7fea180b2ec0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fea10014040 tx=0x7fea10004ad0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.993+0000 7fea2029a700 1 -- 172.21.15.16:0/3543561872 shutdown_connections 2023-08-25T04:45:50.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.993+0000 7fea2029a700 1 --2- 172.21.15.16:0/3543561872 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fe9fc06a0e0 0x7fe9fc06c5a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.993+0000 7fea2029a700 1 --2- 172.21.15.16:0/3543561872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1815d320 0x7fea180b2ec0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.993+0000 7fea2029a700 1 --2- 172.21.15.16:0/3543561872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180cf970 0x7fea181544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.993+0000 7fea2029a700 1 --2- 172.21.15.16:0/3543561872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea1815cf40 0x7fea180b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.993+0000 7fea2029a700 1 -- 172.21.15.16:0/3543561872 >> 172.21.15.16:0/3543561872 conn(0x7fea180b1a10 msgr2=0x7fea180b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.993+0000 7fea2029a700 1 -- 172.21.15.16:0/3543561872 shutdown_connections 2023-08-25T04:45:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:50.993+0000 7fea2029a700 1 -- 172.21.15.16:0/3543561872 wait complete. 2023-08-25T04:45:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 6 to deep-scrub 2023-08-25T04:45:51.007 INFO:tasks.ceph:Scrubbing osd.7 2023-08-25T04:45:51.008 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-08-25T04:45:51.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.136+0000 7fc23b0b5700 1 Processor -- start 2023-08-25T04:45:51.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.136+0000 7fc23b0b5700 1 -- start start 2023-08-25T04:45:51.139 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.137+0000 7fc23b0b5700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc23415ad60 0x7fc23415e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.137+0000 7fc23b0b5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2340cf660 0x7fc23406cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.137+0000 7fc23b0b5700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc234071060 con 0x7fc23406d490 2023-08-25T04:45:51.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.137+0000 7fc23b0b5700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2340cdb90 con 0x7fc23415ad60 2023-08-25T04:45:51.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.137+0000 7fc23b0b5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2340cde70 con 0x7fc2340cf660 2023-08-25T04:45:51.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.137+0000 7fc238e51700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc23415ad60 0x7fc23415e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.137+0000 7fc239652700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc23406d490 0x7fc23406a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40934/0 (socket says 172.21.15.16:40934) 2023-08-25T04:45:51.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.137+0000 7fc239652700 1 -- 172.21.15.16:0/2856918674 learned_addr learned my addr 172.21.15.16:0/2856918674 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:51.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.137+0000 7fc238e51700 1 -- 172.21.15.16:0/2856918674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2340cf660 msgr2=0x7fc23406cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:51.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.137+0000 7fc238e51700 1 --2- 172.21.15.16:0/2856918674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2340cf660 0x7fc23406cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.137+0000 7fc238e51700 1 -- 172.21.15.16:0/2856918674 >> v1:172.21.15.16:6789/0 conn(0x7fc23406d490 legacy=0x7fc23406a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.137+0000 7fc238e51700 1 -- 172.21.15.16:0/2856918674 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc234071300 con 0x7fc23415ad60 2023-08-25T04:45:51.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.137+0000 7fc238e51700 1 --2- 172.21.15.16:0/2856918674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc23415ad60 0x7fc23415e420 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc228009840 tx=0x7fc228009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c388564149b6857 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.138+0000 7fc2337fe700 1 -- 172.21.15.16:0/2856918674 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228011830 con 0x7fc23415ad60 2023-08-25T04:45:51.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.138+0000 7fc2337fe700 1 -- 172.21.15.16:0/2856918674 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc228011990 con 0x7fc23415ad60 2023-08-25T04:45:51.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.138+0000 7fc2337fe700 1 -- 172.21.15.16:0/2856918674 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228011d20 con 0x7fc23415ad60 2023-08-25T04:45:51.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.138+0000 7fc23b0b5700 1 -- 172.21.15.16:0/2856918674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc23415ad60 msgr2=0x7fc23415e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.138+0000 7fc23b0b5700 1 --2- 172.21.15.16:0/2856918674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc23415ad60 0x7fc23415e420 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc228009840 tx=0x7fc228009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:51.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.138+0000 7fc23b0b5700 1 -- 172.21.15.16:0/2856918674 shutdown_connections 2023-08-25T04:45:51.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.138+0000 7fc23b0b5700 1 --2- 172.21.15.16:0/2856918674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc23415ad60 0x7fc23415e420 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.138+0000 7fc23b0b5700 1 --2- 172.21.15.16:0/2856918674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2340cf660 0x7fc23406cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.138+0000 7fc23b0b5700 1 -- 172.21.15.16:0/2856918674 >> 172.21.15.16:0/2856918674 conn(0x7fc2340b19a0 msgr2=0x7fc2340b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:51.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.138+0000 7fc23b0b5700 1 -- 172.21.15.16:0/2856918674 shutdown_connections 2023-08-25T04:45:51.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.138+0000 7fc23b0b5700 1 -- 172.21.15.16:0/2856918674 wait complete. 2023-08-25T04:45:51.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.140+0000 7fc23b0b5700 1 Processor -- start 2023-08-25T04:45:51.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.140+0000 7fc23b0b5700 1 -- start start 2023-08-25T04:45:51.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc23b0b5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23406d490 0x7fc2340c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc23b0b5700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2340cf660 0x7fc2341f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc23b0b5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23415ad60 0x7fc2341f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc23b0b5700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2340c6480 con 0x7fc2340cf660 2023-08-25T04:45:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc23b0b5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2340cae80 con 0x7fc23415ad60 2023-08-25T04:45:51.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc23b0b5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2340cd320 con 0x7fc23406d490 2023-08-25T04:45:51.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc233fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2340cf660 0x7fc2341f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc233fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2340cf660 0x7fc2341f60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50524/0 (socket says 172.21.15.16:50524) 2023-08-25T04:45:51.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc233fff700 1 -- 172.21.15.16:0/3428938412 learned_addr learned my addr 172.21.15.16:0/3428938412 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:51.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc238e51700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23406d490 0x7fc2340c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc239652700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23415ad60 0x7fc2341f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc233fff700 1 -- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23406d490 msgr2=0x7fc2340c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc233fff700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc23406d490 0x7fc2340c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc233fff700 1 -- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23415ad60 msgr2=0x7fc2341f65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc233fff700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23415ad60 0x7fc2341f65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc233fff700 1 -- 172.21.15.16:0/3428938412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2280094a0 con 0x7fc2340cf660 2023-08-25T04:45:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.141+0000 7fc239652700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23415ad60 0x7fc2341f65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.142+0000 7fc233fff700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2340cf660 0x7fc2341f60b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc22000b530 tx=0x7fc22000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.142+0000 7fc2317fa700 1 -- 172.21.15.16:0/3428938412 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220011830 con 0x7fc2340cf660 2023-08-25T04:45:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.142+0000 7fc2317fa700 1 -- 172.21.15.16:0/3428938412 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2200119b0 con 0x7fc2340cf660 2023-08-25T04:45:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.142+0000 7fc2317fa700 1 -- 172.21.15.16:0/3428938412 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220011d60 con 0x7fc2340cf660 2023-08-25T04:45:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.142+0000 7fc23b0b5700 1 -- 172.21.15.16:0/3428938412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2340c5ec0 con 0x7fc2340cf660 2023-08-25T04:45:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.142+0000 7fc23b0b5700 1 -- 172.21.15.16:0/3428938412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2340cab10 con 0x7fc2340cf660 2023-08-25T04:45:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.143+0000 7fc23b0b5700 1 -- 172.21.15.16:0/3428938412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc23415b140 con 0x7fc2340cf660 2023-08-25T04:45:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.143+0000 7fc2317fa700 1 -- 172.21.15.16:0/3428938412 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc22001a400 con 0x7fc2340cf660 2023-08-25T04:45:51.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.144+0000 7fc2317fa700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc21806a0e0 0x7fc21806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.144+0000 7fc2317fa700 1 -- 172.21.15.16:0/3428938412 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc220088690 con 0x7fc2340cf660 2023-08-25T04:45:51.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.144+0000 7fc238e51700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc21806a0e0 0x7fc21806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.144+0000 7fc2317fa700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:6824/3606866589,v1:172.21.15.117:6825/3606866589] conn(0x7fc2180729e0 0x7fc218074e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.144+0000 7fc2317fa700 1 -- 172.21.15.16:0/3428938412 --> [v2:172.21.15.117:6824/3606866589,v1:172.21.15.117:6825/3606866589] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2180754f0 con 0x7fc2180729e0 2023-08-25T04:45:51.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.144+0000 7fc2317fa700 1 -- 172.21.15.16:0/3428938412 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc22008ad50 con 0x7fc2340cf660 2023-08-25T04:45:51.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.144+0000 7fc239652700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:6824/3606866589,v1:172.21.15.117:6825/3606866589] conn(0x7fc2180729e0 0x7fc218074e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.144+0000 7fc238e51700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc21806a0e0 0x7fc21806c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc228000c00 tx=0x7fc22801c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.145+0000 7fc239652700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:6824/3606866589,v1:172.21.15.117:6825/3606866589] conn(0x7fc2180729e0 0x7fc218074e20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.145+0000 7fc2317fa700 1 -- 172.21.15.16:0/3428938412 <== osd.7 v2:172.21.15.117:6824/3606866589 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc2180754f0 con 0x7fc2180729e0 2023-08-25T04:45:51.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.160+0000 7fc23b0b5700 1 -- 172.21.15.16:0/3428938412 --> [v2:172.21.15.117:6824/3606866589,v1:172.21.15.117:6825/3606866589] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc2340caca0 con 0x7fc2180729e0 2023-08-25T04:45:51.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.161+0000 7fc2317fa700 1 -- 172.21.15.16:0/3428938412 <== osd.7 v2:172.21.15.117:6824/3606866589 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc2340caca0 con 0x7fc2180729e0 2023-08-25T04:45:51.162 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-08-25T04:45:51.162 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T04:45:51.163 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-08-25T04:45:51.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.161+0000 7fc23b0b5700 1 -- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:6824/3606866589,v1:172.21.15.117:6825/3606866589] conn(0x7fc2180729e0 msgr2=0x7fc218074e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.161+0000 7fc23b0b5700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:6824/3606866589,v1:172.21.15.117:6825/3606866589] conn(0x7fc2180729e0 0x7fc218074e20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.161+0000 7fc23b0b5700 1 -- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc21806a0e0 msgr2=0x7fc21806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.161+0000 7fc23b0b5700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc21806a0e0 0x7fc21806c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc228000c00 tx=0x7fc22801c040 comp rx=0 tx=0).stop 2023-08-25T04:45:51.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.161+0000 7fc23b0b5700 1 -- 172.21.15.16:0/3428938412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2340cf660 msgr2=0x7fc2341f60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.161+0000 7fc23b0b5700 1 --2- 172.21.15.16:0/3428938412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2340cf660 0x7fc2341f60b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc22000b530 tx=0x7fc22000b8f0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.161+0000 7fc239652700 1 -- 172.21.15.16:0/3428938412 reap_dead start 2023-08-25T04:45:51.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.161+0000 7fc23b0b5700 1 -- 172.21.15.16:0/3428938412 shutdown_connections 2023-08-25T04:45:51.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.161+0000 7fc23b0b5700 1 -- 172.21.15.16:0/3428938412 >> 172.21.15.16:0/3428938412 conn(0x7fc2340b19a0 msgr2=0x7fc2341e4480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:51.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.161+0000 7fc23b0b5700 1 -- 172.21.15.16:0/3428938412 shutdown_connections 2023-08-25T04:45:51.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.161+0000 7fc23b0b5700 1 -- 172.21.15.16:0/3428938412 wait complete. 2023-08-25T04:45:51.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-08-25T04:45:51.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.300+0000 7f4f361d1700 1 Processor -- start 2023-08-25T04:45:51.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.300+0000 7f4f361d1700 1 -- start start 2023-08-25T04:45:51.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.301+0000 7f4f361d1700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4f300caf10 0x7f4f300cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.301+0000 7f4f361d1700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f300cbfe0 con 0x7f4f30070eb0 2023-08-25T04:45:51.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.301+0000 7f4f361d1700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f300cb3d0 con 0x7f4f300cc830 2023-08-25T04:45:51.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.301+0000 7f4f361d1700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f300cb6b0 con 0x7f4f300caf10 2023-08-25T04:45:51.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.301+0000 7f4f2effd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4f300caf10 0x7f4f300cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.301+0000 7f4f2ffff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4f30070eb0 0x7f4f300ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40950/0 (socket says 172.21.15.16:40950) 2023-08-25T04:45:51.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.301+0000 7f4f2ffff700 1 -- 172.21.15.16:0/791164062 learned_addr learned my addr 172.21.15.16:0/791164062 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:51.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.301+0000 7f4f2effd700 1 -- 172.21.15.16:0/791164062 >> v1:172.21.15.117:6789/0 conn(0x7f4f300cc830 legacy=0x7f4f300ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:51.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.301+0000 7f4f2effd700 1 -- 172.21.15.16:0/791164062 >> v1:172.21.15.16:6789/0 conn(0x7f4f30070eb0 legacy=0x7f4f300ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.301+0000 7f4f2effd700 1 -- 172.21.15.16:0/791164062 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f300cb990 con 0x7f4f300caf10 2023-08-25T04:45:51.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.301+0000 7f4f2e7fc700 1 -- 172.21.15.16:0/791164062 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240612139 0 0) 0x7f4f300cbfe0 con 0x7f4f30070eb0 2023-08-25T04:45:51.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.302+0000 7f4f2effd700 1 --2- 172.21.15.16:0/791164062 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f300caf10 0x7f4f300cddb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009840 tx=0x7f4f18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651080d5a8b42e20 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.302+0000 7f4f2e7fc700 1 -- 172.21.15.16:0/791164062 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18004230 con 0x7f4f300caf10 2023-08-25T04:45:51.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.302+0000 7f4f2e7fc700 1 -- 172.21.15.16:0/791164062 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f18004390 con 0x7f4f300caf10 2023-08-25T04:45:51.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.302+0000 7f4f2e7fc700 1 -- 172.21.15.16:0/791164062 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f180036a0 con 0x7f4f300caf10 2023-08-25T04:45:51.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.302+0000 7f4f361d1700 1 -- 172.21.15.16:0/791164062 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f300caf10 msgr2=0x7f4f300cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.302+0000 7f4f361d1700 1 --2- 172.21.15.16:0/791164062 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f300caf10 0x7f4f300cddb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009840 tx=0x7f4f18009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:51.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.302+0000 7f4f361d1700 1 -- 172.21.15.16:0/791164062 shutdown_connections 2023-08-25T04:45:51.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.302+0000 7f4f361d1700 1 --2- 172.21.15.16:0/791164062 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f300caf10 0x7f4f300cddb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.302+0000 7f4f361d1700 1 -- 172.21.15.16:0/791164062 >> 172.21.15.16:0/791164062 conn(0x7f4f300b1a10 msgr2=0x7f4f300b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:51.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.302+0000 7f4f361d1700 1 -- 172.21.15.16:0/791164062 shutdown_connections 2023-08-25T04:45:51.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.302+0000 7f4f361d1700 1 -- 172.21.15.16:0/791164062 wait complete. 2023-08-25T04:45:51.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.304+0000 7f4f361d1700 1 Processor -- start 2023-08-25T04:45:51.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.304+0000 7f4f361d1700 1 -- start start 2023-08-25T04:45:51.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f361d1700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f30070eb0 0x7f4f3014ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f361d1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f300caf10 0x7f4f30071630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f361d1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300cc830 0x7f4f300c2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f361d1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3014b1c0 con 0x7f4f300caf10 2023-08-25T04:45:51.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f361d1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f301486d0 con 0x7f4f300cc830 2023-08-25T04:45:51.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f361d1700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f300c18a0 con 0x7f4f30070eb0 2023-08-25T04:45:51.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f2effd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f300caf10 0x7f4f30071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f2effd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f300caf10 0x7f4f30071630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50538/0 (socket says 172.21.15.16:50538) 2023-08-25T04:45:51.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f2effd700 1 -- 172.21.15.16:0/3405899821 learned_addr learned my addr 172.21.15.16:0/3405899821 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:51.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f2ffff700 1 --2- 172.21.15.16:0/3405899821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300cc830 0x7f4f300c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f2f7fe700 1 --2- 172.21.15.16:0/3405899821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f30070eb0 0x7f4f3014ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f2effd700 1 -- 172.21.15.16:0/3405899821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f30070eb0 msgr2=0x7f4f3014ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f2effd700 1 --2- 172.21.15.16:0/3405899821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f30070eb0 0x7f4f3014ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f2effd700 1 -- 172.21.15.16:0/3405899821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300cc830 msgr2=0x7f4f300c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f2effd700 1 --2- 172.21.15.16:0/3405899821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300cc830 0x7f4f300c2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.305+0000 7f4f2effd700 1 -- 172.21.15.16:0/3405899821 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180094a0 con 0x7f4f300caf10 2023-08-25T04:45:51.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.306+0000 7f4f2effd700 1 --2- 172.21.15.16:0/3405899821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f300caf10 0x7f4f30071630 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4f180090b0 tx=0x7f4f180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.306+0000 7f4f27fff700 1 -- 172.21.15.16:0/3405899821 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18011630 con 0x7f4f300caf10 2023-08-25T04:45:51.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.306+0000 7f4f27fff700 1 -- 172.21.15.16:0/3405899821 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f18011790 con 0x7f4f300caf10 2023-08-25T04:45:51.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.306+0000 7f4f361d1700 1 -- 172.21.15.16:0/3405899821 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f30148920 con 0x7f4f300caf10 2023-08-25T04:45:51.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.306+0000 7f4f27fff700 1 -- 172.21.15.16:0/3405899821 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18011b40 con 0x7f4f300caf10 2023-08-25T04:45:51.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.306+0000 7f4f361d1700 1 -- 172.21.15.16:0/3405899821 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f300c1e20 con 0x7f4f300caf10 2023-08-25T04:45:51.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.307+0000 7f4f361d1700 1 -- 172.21.15.16:0/3405899821 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3004ee70 con 0x7f4f300caf10 2023-08-25T04:45:51.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.307+0000 7f4f27fff700 1 -- 172.21.15.16:0/3405899821 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4f18011ca0 con 0x7f4f300caf10 2023-08-25T04:45:51.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.308+0000 7f4f27fff700 1 --2- 172.21.15.16:0/3405899821 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4f1006a110 0x7f4f1006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.308+0000 7f4f27fff700 1 -- 172.21.15.16:0/3405899821 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4f18089df0 con 0x7f4f300caf10 2023-08-25T04:45:51.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.308+0000 7f4f2f7fe700 1 --2- 172.21.15.16:0/3405899821 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4f1006a110 0x7f4f1006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.308+0000 7f4f2f7fe700 1 --2- 172.21.15.16:0/3405899821 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4f1006a110 0x7f4f1006c5d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009870 tx=0x7f4f20008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.312+0000 7f4f27fff700 1 -- 172.21.15.16:0/3405899821 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4f18055530 con 0x7f4f300caf10 2023-08-25T04:45:51.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.513+0000 7f4f361d1700 1 -- 172.21.15.16:0/3405899821 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f300cbc70 con 0x7f4f1006a110 2023-08-25T04:45:51.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.514+0000 7f4f27fff700 1 -- 172.21.15.16:0/3405899821 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4f20014430 con 0x7f4f1006a110 2023-08-25T04:45:51.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.516+0000 7f4f361d1700 1 -- 172.21.15.16:0/3405899821 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4f1006a110 msgr2=0x7f4f1006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.516+0000 7f4f361d1700 1 --2- 172.21.15.16:0/3405899821 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4f1006a110 0x7f4f1006c5d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009870 tx=0x7f4f20008040 comp rx=0 tx=0).stop 2023-08-25T04:45:51.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.516+0000 7f4f361d1700 1 -- 172.21.15.16:0/3405899821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f300caf10 msgr2=0x7f4f30071630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.516+0000 7f4f361d1700 1 --2- 172.21.15.16:0/3405899821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f300caf10 0x7f4f30071630 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4f180090b0 tx=0x7f4f180047c0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.516+0000 7f4f361d1700 1 -- 172.21.15.16:0/3405899821 shutdown_connections 2023-08-25T04:45:51.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.516+0000 7f4f361d1700 1 --2- 172.21.15.16:0/3405899821 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f4f1006a110 0x7f4f1006c5d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.516+0000 7f4f361d1700 1 --2- 172.21.15.16:0/3405899821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300cc830 0x7f4f300c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.516+0000 7f4f361d1700 1 --2- 172.21.15.16:0/3405899821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f30070eb0 0x7f4f3014ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.516+0000 7f4f361d1700 1 --2- 172.21.15.16:0/3405899821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f300caf10 0x7f4f30071630 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.516+0000 7f4f361d1700 1 -- 172.21.15.16:0/3405899821 >> 172.21.15.16:0/3405899821 conn(0x7f4f300b1a10 msgr2=0x7f4f3014d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:51.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.516+0000 7f4f361d1700 1 -- 172.21.15.16:0/3405899821 shutdown_connections 2023-08-25T04:45:51.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.516+0000 7f4f361d1700 1 -- 172.21.15.16:0/3405899821 wait complete. 2023-08-25T04:45:51.522 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 7 to deep-scrub 2023-08-25T04:45:51.530 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:45:51.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.654+0000 7f770cbb4700 1 Processor -- start 2023-08-25T04:45:51.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.654+0000 7f770cbb4700 1 -- start start 2023-08-25T04:45:51.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.655+0000 7f770cbb4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77080caf10 0x7f77080cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.655+0000 7f770cbb4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7708070eb0 0x7f77080ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.655+0000 7f770cbb4700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77080cbfe0 con 0x7f77080cc830 2023-08-25T04:45:51.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.655+0000 7f770cbb4700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77080cb3d0 con 0x7f7708070eb0 2023-08-25T04:45:51.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.655+0000 7f770cbb4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77080cb6b0 con 0x7f77080caf10 2023-08-25T04:45:51.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.655+0000 7f7706d9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7708070eb0 0x7f77080ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.655+0000 7f770659c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f77080cc830 0x7f77080ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40960/0 (socket says 172.21.15.16:40960) 2023-08-25T04:45:51.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.655+0000 7f770659c700 1 -- 172.21.15.16:0/4160117466 learned_addr learned my addr 172.21.15.16:0/4160117466 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:45:51.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.655+0000 7f7705d9b700 1 --2- 172.21.15.16:0/4160117466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77080caf10 0x7f77080cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.655+0000 7f7706d9d700 1 -- 172.21.15.16:0/4160117466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77080caf10 msgr2=0x7f77080cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:51.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.655+0000 7f7706d9d700 1 --2- 172.21.15.16:0/4160117466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77080caf10 0x7f77080cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.655+0000 7f7706d9d700 1 -- 172.21.15.16:0/4160117466 >> v1:172.21.15.16:6789/0 conn(0x7f77080cc830 legacy=0x7f77080ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.655+0000 7f770559a700 1 -- 172.21.15.16:0/4160117466 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183905954 0 0) 0x7f77080cbfe0 con 0x7f77080cc830 2023-08-25T04:45:51.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.655+0000 7f7706d9d700 1 -- 172.21.15.16:0/4160117466 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77080cb990 con 0x7f7708070eb0 2023-08-25T04:45:51.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.656+0000 7f7706d9d700 1 --2- 172.21.15.16:0/4160117466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7708070eb0 0x7f77080ce2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7700009d90 tx=0x7f770000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e040457db6cfc4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.656+0000 7f770559a700 1 -- 172.21.15.16:0/4160117466 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770000e070 con 0x7f7708070eb0 2023-08-25T04:45:51.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.656+0000 7f770559a700 1 -- 172.21.15.16:0/4160117466 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770000bbd0 con 0x7f7708070eb0 2023-08-25T04:45:51.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.656+0000 7f770559a700 1 -- 172.21.15.16:0/4160117466 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7700012430 con 0x7f7708070eb0 2023-08-25T04:45:51.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.656+0000 7f770cbb4700 1 -- 172.21.15.16:0/4160117466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7708070eb0 msgr2=0x7f77080ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.656+0000 7f770cbb4700 1 --2- 172.21.15.16:0/4160117466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7708070eb0 0x7f77080ce2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7700009d90 tx=0x7f770000b330 comp rx=0 tx=0).stop 2023-08-25T04:45:51.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.656+0000 7f770cbb4700 1 -- 172.21.15.16:0/4160117466 shutdown_connections 2023-08-25T04:45:51.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.656+0000 7f770cbb4700 1 --2- 172.21.15.16:0/4160117466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7708070eb0 0x7f77080ce2f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.656+0000 7f770cbb4700 1 --2- 172.21.15.16:0/4160117466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77080caf10 0x7f77080cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.656+0000 7f770cbb4700 1 -- 172.21.15.16:0/4160117466 >> 172.21.15.16:0/4160117466 conn(0x7f77080b1a10 msgr2=0x7f77080b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:51.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.656+0000 7f770cbb4700 1 -- 172.21.15.16:0/4160117466 shutdown_connections 2023-08-25T04:45:51.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.656+0000 7f770cbb4700 1 -- 172.21.15.16:0/4160117466 wait complete. 2023-08-25T04:45:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.658+0000 7f770cbb4700 1 Processor -- start 2023-08-25T04:45:51.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.658+0000 7f770cbb4700 1 -- start start 2023-08-25T04:45:51.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.659+0000 7f770cbb4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7708070eb0 0x7f77080c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.659+0000 7f770cbb4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77080caf10 0x7f77081edba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.659+0000 7f770cbb4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77080cc830 0x7f7708157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.659+0000 7f770cbb4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770815aa70 con 0x7f77080caf10 2023-08-25T04:45:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.659+0000 7f770cbb4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77080c48c0 con 0x7f77080cc830 2023-08-25T04:45:51.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.659+0000 7f770cbb4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770815acc0 con 0x7f7708070eb0 2023-08-25T04:45:51.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.659+0000 7f7705d9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77080caf10 0x7f77081edba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.659+0000 7f7705d9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77080caf10 0x7f77081edba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50554/0 (socket says 172.21.15.16:50554) 2023-08-25T04:45:51.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.659+0000 7f7705d9b700 1 -- 172.21.15.16:0/4245313045 learned_addr learned my addr 172.21.15.16:0/4245313045 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:45:51.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.659+0000 7f770659c700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7708070eb0 0x7f77080c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.659+0000 7f7706d9d700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77080cc830 0x7f7708157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.660+0000 7f7705d9b700 1 -- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7708070eb0 msgr2=0x7f77080c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.660+0000 7f7705d9b700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7708070eb0 0x7f77080c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.660+0000 7f7705d9b700 1 -- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77080cc830 msgr2=0x7f7708157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.660+0000 7f7705d9b700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77080cc830 0x7f7708157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.660+0000 7f7705d9b700 1 -- 172.21.15.16:0/4245313045 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7700009a70 con 0x7f77080caf10 2023-08-25T04:45:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.660+0000 7f770659c700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7708070eb0 0x7f77080c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.660+0000 7f7705d9b700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77080caf10 0x7f77081edba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f76f800d800 tx=0x7f76f800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.660+0000 7f76f6ffd700 1 -- 172.21.15.16:0/4245313045 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f80125f0 con 0x7f77080caf10 2023-08-25T04:45:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.660+0000 7f76f6ffd700 1 -- 172.21.15.16:0/4245313045 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f8012750 con 0x7f77080caf10 2023-08-25T04:45:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.660+0000 7f770cbb4700 1 -- 172.21.15.16:0/4245313045 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770815afa0 con 0x7f77080caf10 2023-08-25T04:45:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.660+0000 7f76f6ffd700 1 -- 172.21.15.16:0/4245313045 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8012b00 con 0x7f77080caf10 2023-08-25T04:45:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.660+0000 7f770cbb4700 1 -- 172.21.15.16:0/4245313045 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770815b560 con 0x7f77080caf10 2023-08-25T04:45:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.661+0000 7f770cbb4700 1 -- 172.21.15.16:0/4245313045 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770804ee70 con 0x7f77080caf10 2023-08-25T04:45:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.661+0000 7f76f6ffd700 1 -- 172.21.15.16:0/4245313045 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f76f8012c60 con 0x7f77080caf10 2023-08-25T04:45:51.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.662+0000 7f76f6ffd700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f76e806a0e0 0x7f76e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.662+0000 7f76f6ffd700 1 -- 172.21.15.16:0/4245313045 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f76f8088910 con 0x7f77080caf10 2023-08-25T04:45:51.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.662+0000 7f770659c700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f76e806a0e0 0x7f76e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.662+0000 7f770659c700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f76e806a0e0 0x7f76e806c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f76fc000f60 tx=0x7f76fc007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.666+0000 7f76f6ffd700 1 -- 172.21.15.16:0/4245313045 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f76f8053fc0 con 0x7f77080caf10 2023-08-25T04:45:51.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.863+0000 7f770cbb4700 1 -- 172.21.15.16:0/4245313045 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77080cbc70 con 0x7f76e806a0e0 2023-08-25T04:45:51.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.872+0000 7f76f6ffd700 1 -- 172.21.15.16:0/4245313045 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309915 (secure 0 0 0) 0x7f76fc004870 con 0x7f76e806a0e0 2023-08-25T04:45:51.875 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:45:51.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.875+0000 7f770cbb4700 1 -- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f76e806a0e0 msgr2=0x7f76e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.875+0000 7f770cbb4700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f76e806a0e0 0x7f76e806c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f76fc000f60 tx=0x7f76fc007d30 comp rx=0 tx=0).stop 2023-08-25T04:45:51.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.875+0000 7f770cbb4700 1 -- 172.21.15.16:0/4245313045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77080caf10 msgr2=0x7f77081edba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.875+0000 7f770cbb4700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77080caf10 0x7f77081edba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f76f800d800 tx=0x7f76f800dbc0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.875+0000 7f770cbb4700 1 -- 172.21.15.16:0/4245313045 shutdown_connections 2023-08-25T04:45:51.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.875+0000 7f770cbb4700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f76e806a0e0 0x7f76e806c5a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.875+0000 7f770cbb4700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77080cc830 0x7f7708157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.875+0000 7f770cbb4700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7708070eb0 0x7f77080c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.875+0000 7f770cbb4700 1 --2- 172.21.15.16:0/4245313045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77080caf10 0x7f77081edba0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.875+0000 7f770cbb4700 1 -- 172.21.15.16:0/4245313045 >> 172.21.15.16:0/4245313045 conn(0x7f77080b1a10 msgr2=0x7f77080af980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:51.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.875+0000 7f770cbb4700 1 -- 172.21.15.16:0/4245313045 shutdown_connections 2023-08-25T04:45:51.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:45:51.875+0000 7f770cbb4700 1 -- 172.21.15.16:0/4245313045 wait complete. 2023-08-25T04:45:51.893 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-08-25T04:45:51.894 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-08-25T04:45:51.406904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102697983,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":129,"num_read_kb":115,"num_write":1119,"num_write_kb":1105939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17516,"ondisk_log_size":17516,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":481060,"kb_used_data":202532,"kb_used_omap":13,"kb_used_meta":278450,"kb_avail":754493660,"statfs":{"total":773094113280,"available":772601507840,"internally_reserved":0,"allocated":207392768,"data_stored":206129973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":285132888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-259737693,"num_objects":-62,"num_object_clones":0,"num_object_copies":-124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-62,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":436,"num_write_kb":524663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002879"},"pg_stats":[{"pgid":"4.3f","version":"23'232","reported_seq":249,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.905474+0000","last_change":"2023-08-25T04:43:42.895145+0000","last_active":"2023-08-25T04:45:48.905474+0000","last_peered":"2023-08-25T04:45:48.905474+0000","last_clean":"2023-08-25T04:45:48.905474+0000","last_became_active":"2023-08-25T04:43:42.894831+0000","last_became_peered":"2023-08-25T04:43:42.894831+0000","last_unstale":"2023-08-25T04:45:48.905474+0000","last_undegraded":"2023-08-25T04:45:48.905474+0000","last_fullsized":"2023-08-25T04:45:48.905474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'220","reported_seq":236,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.085938+0000","last_change":"2023-08-25T04:43:42.895503+0000","last_active":"2023-08-25T04:45:44.085938+0000","last_peered":"2023-08-25T04:45:44.085938+0000","last_clean":"2023-08-25T04:45:44.085938+0000","last_became_active":"2023-08-25T04:43:42.895245+0000","last_became_peered":"2023-08-25T04:43:42.895245+0000","last_unstale":"2023-08-25T04:45:44.085938+0000","last_undegraded":"2023-08-25T04:45:44.085938+0000","last_fullsized":"2023-08-25T04:45:44.085938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:39:50.519838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"23'276","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.067445+0000","last_change":"2023-08-25T04:43:42.888920+0000","last_active":"2023-08-25T04:45:44.067445+0000","last_peered":"2023-08-25T04:45:44.067445+0000","last_clean":"2023-08-25T04:45:44.067445+0000","last_became_active":"2023-08-25T04:43:42.888568+0000","last_became_peered":"2023-08-25T04:43:42.888568+0000","last_unstale":"2023-08-25T04:45:44.067445+0000","last_undegraded":"2023-08-25T04:45:44.067445+0000","last_fullsized":"2023-08-25T04:45:44.067445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:55:39.359039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"23'253","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.950989+0000","last_change":"2023-08-25T04:43:42.893868+0000","last_active":"2023-08-25T04:45:43.950989+0000","last_peered":"2023-08-25T04:45:43.950989+0000","last_clean":"2023-08-25T04:45:43.950989+0000","last_became_active":"2023-08-25T04:43:42.893534+0000","last_became_peered":"2023-08-25T04:43:42.893534+0000","last_unstale":"2023-08-25T04:45:43.950989+0000","last_undegraded":"2023-08-25T04:45:43.950989+0000","last_fullsized":"2023-08-25T04:45:43.950989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:20.295263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"23'256","reported_seq":272,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.951168+0000","last_change":"2023-08-25T04:43:42.902297+0000","last_active":"2023-08-25T04:45:43.951168+0000","last_peered":"2023-08-25T04:45:43.951168+0000","last_clean":"2023-08-25T04:45:43.951168+0000","last_became_active":"2023-08-25T04:43:42.901963+0000","last_became_peered":"2023-08-25T04:43:42.901963+0000","last_unstale":"2023-08-25T04:45:43.951168+0000","last_undegraded":"2023-08-25T04:45:43.951168+0000","last_fullsized":"2023-08-25T04:45:43.951168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'278","reported_seq":293,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.954382+0000","last_change":"2023-08-25T04:43:42.888877+0000","last_active":"2023-08-25T04:45:43.954382+0000","last_peered":"2023-08-25T04:45:43.954382+0000","last_clean":"2023-08-25T04:45:43.954382+0000","last_became_active":"2023-08-25T04:43:42.888567+0000","last_became_peered":"2023-08-25T04:43:42.888567+0000","last_unstale":"2023-08-25T04:45:43.954382+0000","last_undegraded":"2023-08-25T04:45:43.954382+0000","last_fullsized":"2023-08-25T04:45:43.954382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:15:07.375032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"23'293","reported_seq":308,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.949275+0000","last_change":"2023-08-25T04:43:42.902469+0000","last_active":"2023-08-25T04:45:43.949275+0000","last_peered":"2023-08-25T04:45:43.949275+0000","last_clean":"2023-08-25T04:45:43.949275+0000","last_became_active":"2023-08-25T04:43:42.902156+0000","last_became_peered":"2023-08-25T04:43:42.902156+0000","last_unstale":"2023-08-25T04:45:43.949275+0000","last_undegraded":"2023-08-25T04:45:43.949275+0000","last_fullsized":"2023-08-25T04:45:43.949275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:59.175818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"23'270","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.074470+0000","last_change":"2023-08-25T04:43:42.895697+0000","last_active":"2023-08-25T04:45:44.074470+0000","last_peered":"2023-08-25T04:45:44.074470+0000","last_clean":"2023-08-25T04:45:44.074470+0000","last_became_active":"2023-08-25T04:43:42.895410+0000","last_became_peered":"2023-08-25T04:43:42.895410+0000","last_unstale":"2023-08-25T04:45:44.074470+0000","last_undegraded":"2023-08-25T04:45:44.074470+0000","last_fullsized":"2023-08-25T04:45:44.074470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:17:01.748486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"23'248","reported_seq":264,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947284+0000","last_change":"2023-08-25T04:43:42.897483+0000","last_active":"2023-08-25T04:45:43.947284+0000","last_peered":"2023-08-25T04:45:43.947284+0000","last_clean":"2023-08-25T04:45:43.947284+0000","last_became_active":"2023-08-25T04:43:42.896949+0000","last_became_peered":"2023-08-25T04:43:42.896949+0000","last_unstale":"2023-08-25T04:45:43.947284+0000","last_undegraded":"2023-08-25T04:45:43.947284+0000","last_fullsized":"2023-08-25T04:45:43.947284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'282","reported_seq":297,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.088318+0000","last_change":"2023-08-25T04:43:42.895115+0000","last_active":"2023-08-25T04:45:44.088318+0000","last_peered":"2023-08-25T04:45:44.088318+0000","last_clean":"2023-08-25T04:45:44.088318+0000","last_became_active":"2023-08-25T04:43:42.894786+0000","last_became_peered":"2023-08-25T04:43:42.894786+0000","last_unstale":"2023-08-25T04:45:44.088318+0000","last_undegraded":"2023-08-25T04:45:44.088318+0000","last_fullsized":"2023-08-25T04:45:44.088318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:04:31.758204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"23'244","reported_seq":259,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.955622+0000","last_change":"2023-08-25T04:43:42.892793+0000","last_active":"2023-08-25T04:45:43.955622+0000","last_peered":"2023-08-25T04:45:43.955622+0000","last_clean":"2023-08-25T04:45:43.955622+0000","last_became_active":"2023-08-25T04:43:42.892558+0000","last_became_peered":"2023-08-25T04:43:42.892558+0000","last_unstale":"2023-08-25T04:45:43.955622+0000","last_undegraded":"2023-08-25T04:45:43.955622+0000","last_fullsized":"2023-08-25T04:45:43.955622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:35:57.269293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"23'260","reported_seq":276,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.095096+0000","last_change":"2023-08-25T04:43:42.892113+0000","last_active":"2023-08-25T04:45:44.095096+0000","last_peered":"2023-08-25T04:45:44.095096+0000","last_clean":"2023-08-25T04:45:44.095096+0000","last_became_active":"2023-08-25T04:43:42.891782+0000","last_became_peered":"2023-08-25T04:43:42.891782+0000","last_unstale":"2023-08-25T04:45:44.095096+0000","last_undegraded":"2023-08-25T04:45:44.095096+0000","last_fullsized":"2023-08-25T04:45:44.095096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'253","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.090294+0000","last_change":"2023-08-25T04:43:42.896635+0000","last_active":"2023-08-25T04:45:44.090294+0000","last_peered":"2023-08-25T04:45:44.090294+0000","last_clean":"2023-08-25T04:45:44.090294+0000","last_became_active":"2023-08-25T04:43:42.896334+0000","last_became_peered":"2023-08-25T04:43:42.896334+0000","last_unstale":"2023-08-25T04:45:44.090294+0000","last_undegraded":"2023-08-25T04:45:44.090294+0000","last_fullsized":"2023-08-25T04:45:44.090294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'273","reported_seq":288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947016+0000","last_change":"2023-08-25T04:43:42.894765+0000","last_active":"2023-08-25T04:45:43.947016+0000","last_peered":"2023-08-25T04:45:43.947016+0000","last_clean":"2023-08-25T04:45:43.947016+0000","last_became_active":"2023-08-25T04:43:42.894472+0000","last_became_peered":"2023-08-25T04:43:42.894472+0000","last_unstale":"2023-08-25T04:45:43.947016+0000","last_undegraded":"2023-08-25T04:45:43.947016+0000","last_fullsized":"2023-08-25T04:45:43.947016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:30:27.322745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"23'267","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.948843+0000","last_change":"2023-08-25T04:43:42.902458+0000","last_active":"2023-08-25T04:45:43.948843+0000","last_peered":"2023-08-25T04:45:43.948843+0000","last_clean":"2023-08-25T04:45:43.948843+0000","last_became_active":"2023-08-25T04:43:42.902184+0000","last_became_peered":"2023-08-25T04:43:42.902184+0000","last_unstale":"2023-08-25T04:45:43.948843+0000","last_undegraded":"2023-08-25T04:45:43.948843+0000","last_fullsized":"2023-08-25T04:45:43.948843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:07.315621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"23'258","reported_seq":273,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.093285+0000","last_change":"2023-08-25T04:43:42.889087+0000","last_active":"2023-08-25T04:45:44.093285+0000","last_peered":"2023-08-25T04:45:44.093285+0000","last_clean":"2023-08-25T04:45:44.093285+0000","last_became_active":"2023-08-25T04:43:42.888730+0000","last_became_peered":"2023-08-25T04:43:42.888730+0000","last_unstale":"2023-08-25T04:45:44.093285+0000","last_undegraded":"2023-08-25T04:45:44.093285+0000","last_fullsized":"2023-08-25T04:45:44.093285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:56.162169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"23'266","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.097288+0000","last_change":"2023-08-25T04:43:42.898466+0000","last_active":"2023-08-25T04:45:44.097288+0000","last_peered":"2023-08-25T04:45:44.097288+0000","last_clean":"2023-08-25T04:45:44.097288+0000","last_became_active":"2023-08-25T04:43:42.898103+0000","last_became_peered":"2023-08-25T04:43:42.898103+0000","last_unstale":"2023-08-25T04:45:44.097288+0000","last_undegraded":"2023-08-25T04:45:44.097288+0000","last_fullsized":"2023-08-25T04:45:44.097288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'250","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947372+0000","last_change":"2023-08-25T04:43:42.892153+0000","last_active":"2023-08-25T04:45:43.947372+0000","last_peered":"2023-08-25T04:45:43.947372+0000","last_clean":"2023-08-25T04:45:43.947372+0000","last_became_active":"2023-08-25T04:43:42.891874+0000","last_became_peered":"2023-08-25T04:43:42.891874+0000","last_unstale":"2023-08-25T04:45:43.947372+0000","last_undegraded":"2023-08-25T04:45:43.947372+0000","last_fullsized":"2023-08-25T04:45:43.947372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:08:00.896369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"23'237","reported_seq":253,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.076694+0000","last_change":"2023-08-25T04:43:42.895594+0000","last_active":"2023-08-25T04:45:44.076694+0000","last_peered":"2023-08-25T04:45:44.076694+0000","last_clean":"2023-08-25T04:45:44.076694+0000","last_became_active":"2023-08-25T04:43:42.895114+0000","last_became_peered":"2023-08-25T04:43:42.895114+0000","last_unstale":"2023-08-25T04:45:44.076694+0000","last_undegraded":"2023-08-25T04:45:44.076694+0000","last_fullsized":"2023-08-25T04:45:44.076694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'267","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.952396+0000","last_change":"2023-08-25T04:43:42.896149+0000","last_active":"2023-08-25T04:45:43.952396+0000","last_peered":"2023-08-25T04:45:43.952396+0000","last_clean":"2023-08-25T04:45:43.952396+0000","last_became_active":"2023-08-25T04:43:42.895893+0000","last_became_peered":"2023-08-25T04:43:42.895893+0000","last_unstale":"2023-08-25T04:45:43.952396+0000","last_undegraded":"2023-08-25T04:45:43.952396+0000","last_fullsized":"2023-08-25T04:45:43.952396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:26:47.525605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"23'266","reported_seq":281,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.943626+0000","last_change":"2023-08-25T04:43:42.905467+0000","last_active":"2023-08-25T04:45:43.943626+0000","last_peered":"2023-08-25T04:45:43.943626+0000","last_clean":"2023-08-25T04:45:43.943626+0000","last_became_active":"2023-08-25T04:43:42.905157+0000","last_became_peered":"2023-08-25T04:43:42.905157+0000","last_unstale":"2023-08-25T04:45:43.943626+0000","last_undegraded":"2023-08-25T04:45:43.943626+0000","last_fullsized":"2023-08-25T04:45:43.943626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:35.214306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"23'278","reported_seq":294,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.951164+0000","last_change":"2023-08-25T04:43:42.881107+0000","last_active":"2023-08-25T04:45:43.951164+0000","last_peered":"2023-08-25T04:45:43.951164+0000","last_clean":"2023-08-25T04:45:43.951164+0000","last_became_active":"2023-08-25T04:43:42.879881+0000","last_became_peered":"2023-08-25T04:43:42.879881+0000","last_unstale":"2023-08-25T04:45:43.951164+0000","last_undegraded":"2023-08-25T04:45:43.951164+0000","last_fullsized":"2023-08-25T04:45:43.951164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'246","reported_seq":257,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.089187+0000","last_change":"2023-08-25T04:44:30.818677+0000","last_active":"2023-08-25T04:45:44.089187+0000","last_peered":"2023-08-25T04:45:44.089187+0000","last_clean":"2023-08-25T04:45:44.089187+0000","last_became_active":"2023-08-25T04:44:30.818308+0000","last_became_peered":"2023-08-25T04:44:30.818308+0000","last_unstale":"2023-08-25T04:45:44.089187+0000","last_undegraded":"2023-08-25T04:45:44.089187+0000","last_fullsized":"2023-08-25T04:45:44.089187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"23'239","reported_seq":254,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.943417+0000","last_change":"2023-08-25T04:43:42.897136+0000","last_active":"2023-08-25T04:45:43.943417+0000","last_peered":"2023-08-25T04:45:43.943417+0000","last_clean":"2023-08-25T04:45:43.943417+0000","last_became_active":"2023-08-25T04:43:42.896869+0000","last_became_peered":"2023-08-25T04:43:42.896869+0000","last_unstale":"2023-08-25T04:45:43.943417+0000","last_undegraded":"2023-08-25T04:45:43.943417+0000","last_fullsized":"2023-08-25T04:45:43.943417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:04.986803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"23'255","reported_seq":271,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.090624+0000","last_change":"2023-08-25T04:43:42.893954+0000","last_active":"2023-08-25T04:45:44.090624+0000","last_peered":"2023-08-25T04:45:44.090624+0000","last_clean":"2023-08-25T04:45:44.090624+0000","last_became_active":"2023-08-25T04:43:42.893673+0000","last_became_peered":"2023-08-25T04:43:42.893673+0000","last_unstale":"2023-08-25T04:45:44.090624+0000","last_undegraded":"2023-08-25T04:45:44.090624+0000","last_fullsized":"2023-08-25T04:45:44.090624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'273","reported_seq":289,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.108038+0000","last_change":"2023-08-25T04:43:42.888116+0000","last_active":"2023-08-25T04:45:44.108038+0000","last_peered":"2023-08-25T04:45:44.108038+0000","last_clean":"2023-08-25T04:45:44.108038+0000","last_became_active":"2023-08-25T04:43:42.887831+0000","last_became_peered":"2023-08-25T04:43:42.887831+0000","last_unstale":"2023-08-25T04:45:44.108038+0000","last_undegraded":"2023-08-25T04:45:44.108038+0000","last_fullsized":"2023-08-25T04:45:44.108038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'237","reported_seq":252,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.072546+0000","last_change":"2023-08-25T04:43:42.894954+0000","last_active":"2023-08-25T04:45:44.072546+0000","last_peered":"2023-08-25T04:45:44.072546+0000","last_clean":"2023-08-25T04:45:44.072546+0000","last_became_active":"2023-08-25T04:43:42.894302+0000","last_became_peered":"2023-08-25T04:43:42.894302+0000","last_unstale":"2023-08-25T04:45:44.072546+0000","last_undegraded":"2023-08-25T04:45:44.072546+0000","last_fullsized":"2023-08-25T04:45:44.072546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:05:02.005895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282331+0000","last_change":"2023-08-25T04:43:41.888584+0000","last_active":"2023-08-25T04:44:31.282331+0000","last_peered":"2023-08-25T04:44:31.282331+0000","last_clean":"2023-08-25T04:44:31.282331+0000","last_became_active":"2023-08-25T04:43:41.888339+0000","last_became_peered":"2023-08-25T04:43:41.888339+0000","last_unstale":"2023-08-25T04:44:31.282331+0000","last_undegraded":"2023-08-25T04:44:31.282331+0000","last_fullsized":"2023-08-25T04:44:31.282331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:37.980335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'271","reported_seq":286,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947167+0000","last_change":"2023-08-25T04:43:42.897739+0000","last_active":"2023-08-25T04:45:43.947167+0000","last_peered":"2023-08-25T04:45:43.947167+0000","last_clean":"2023-08-25T04:45:43.947167+0000","last_became_active":"2023-08-25T04:43:42.897425+0000","last_became_peered":"2023-08-25T04:43:42.897425+0000","last_unstale":"2023-08-25T04:45:43.947167+0000","last_undegraded":"2023-08-25T04:45:43.947167+0000","last_fullsized":"2023-08-25T04:45:43.947167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:46:26.445143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475729+0000","last_change":"2023-08-25T04:43:41.886122+0000","last_active":"2023-08-25T04:44:30.475729+0000","last_peered":"2023-08-25T04:44:30.475729+0000","last_clean":"2023-08-25T04:44:30.475729+0000","last_became_active":"2023-08-25T04:43:41.885184+0000","last_became_peered":"2023-08-25T04:43:41.885184+0000","last_unstale":"2023-08-25T04:44:30.475729+0000","last_undegraded":"2023-08-25T04:44:30.475729+0000","last_fullsized":"2023-08-25T04:44:30.475729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'291","reported_seq":308,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.397689+0000","last_change":"2023-08-25T04:43:42.890854+0000","last_active":"2023-08-25T04:45:44.397689+0000","last_peered":"2023-08-25T04:45:44.397689+0000","last_clean":"2023-08-25T04:45:44.397689+0000","last_became_active":"2023-08-25T04:43:42.890575+0000","last_became_peered":"2023-08-25T04:43:42.890575+0000","last_unstale":"2023-08-25T04:45:44.397689+0000","last_undegraded":"2023-08-25T04:45:44.397689+0000","last_fullsized":"2023-08-25T04:45:44.397689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.477781+0000","last_change":"2023-08-25T04:43:41.885567+0000","last_active":"2023-08-25T04:44:30.477781+0000","last_peered":"2023-08-25T04:44:30.477781+0000","last_clean":"2023-08-25T04:44:30.477781+0000","last_became_active":"2023-08-25T04:43:41.885299+0000","last_became_peered":"2023-08-25T04:43:41.885299+0000","last_unstale":"2023-08-25T04:44:30.477781+0000","last_undegraded":"2023-08-25T04:44:30.477781+0000","last_fullsized":"2023-08-25T04:44:30.477781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:14:12.640506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'269","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.069986+0000","last_change":"2023-08-25T04:43:42.899190+0000","last_active":"2023-08-25T04:45:44.069986+0000","last_peered":"2023-08-25T04:45:44.069986+0000","last_clean":"2023-08-25T04:45:44.069986+0000","last_became_active":"2023-08-25T04:43:42.898874+0000","last_became_peered":"2023-08-25T04:43:42.898874+0000","last_unstale":"2023-08-25T04:45:44.069986+0000","last_undegraded":"2023-08-25T04:45:44.069986+0000","last_fullsized":"2023-08-25T04:45:44.069986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:07.786286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:30.051815+0000","last_change":"2023-08-25T04:43:41.883055+0000","last_active":"2023-08-25T04:45:30.051815+0000","last_peered":"2023-08-25T04:45:30.051815+0000","last_clean":"2023-08-25T04:45:30.051815+0000","last_became_active":"2023-08-25T04:43:41.882381+0000","last_became_peered":"2023-08-25T04:43:41.882381+0000","last_unstale":"2023-08-25T04:45:30.051815+0000","last_undegraded":"2023-08-25T04:45:30.051815+0000","last_fullsized":"2023-08-25T04:45:30.051815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'261","reported_seq":281,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.074319+0000","last_change":"2023-08-25T04:44:30.481564+0000","last_active":"2023-08-25T04:45:44.074319+0000","last_peered":"2023-08-25T04:45:44.074319+0000","last_clean":"2023-08-25T04:45:44.074319+0000","last_became_active":"2023-08-25T04:44:30.481273+0000","last_became_peered":"2023-08-25T04:44:30.481273+0000","last_unstale":"2023-08-25T04:45:44.074319+0000","last_undegraded":"2023-08-25T04:45:44.074319+0000","last_fullsized":"2023-08-25T04:45:44.074319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:35.214306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475622+0000","last_change":"2023-08-25T04:43:41.882339+0000","last_active":"2023-08-25T04:44:30.475622+0000","last_peered":"2023-08-25T04:44:30.475622+0000","last_clean":"2023-08-25T04:44:30.475622+0000","last_became_active":"2023-08-25T04:43:41.882055+0000","last_became_peered":"2023-08-25T04:43:41.882055+0000","last_unstale":"2023-08-25T04:44:30.475622+0000","last_undegraded":"2023-08-25T04:44:30.475622+0000","last_fullsized":"2023-08-25T04:44:30.475622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:19.884687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"23'268","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.090214+0000","last_change":"2023-08-25T04:43:42.891741+0000","last_active":"2023-08-25T04:45:44.090214+0000","last_peered":"2023-08-25T04:45:44.090214+0000","last_clean":"2023-08-25T04:45:44.090214+0000","last_became_active":"2023-08-25T04:43:42.890100+0000","last_became_peered":"2023-08-25T04:43:42.890100+0000","last_unstale":"2023-08-25T04:45:44.090214+0000","last_undegraded":"2023-08-25T04:45:44.090214+0000","last_fullsized":"2023-08-25T04:45:44.090214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:09.859531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'12","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:42.091016+0000","last_change":"2023-08-25T04:43:41.887924+0000","last_active":"2023-08-25T04:45:42.091016+0000","last_peered":"2023-08-25T04:45:42.091016+0000","last_clean":"2023-08-25T04:45:42.091016+0000","last_became_active":"2023-08-25T04:43:41.887622+0000","last_became_peered":"2023-08-25T04:43:41.887622+0000","last_unstale":"2023-08-25T04:45:42.091016+0000","last_undegraded":"2023-08-25T04:45:42.091016+0000","last_fullsized":"2023-08-25T04:45:42.091016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:37:55.965513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"23'273","reported_seq":289,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.095921+0000","last_change":"2023-08-25T04:43:42.891006+0000","last_active":"2023-08-25T04:45:44.095921+0000","last_peered":"2023-08-25T04:45:44.095921+0000","last_clean":"2023-08-25T04:45:44.095921+0000","last_became_active":"2023-08-25T04:43:42.890648+0000","last_became_peered":"2023-08-25T04:43:42.890648+0000","last_unstale":"2023-08-25T04:45:44.095921+0000","last_undegraded":"2023-08-25T04:45:44.095921+0000","last_fullsized":"2023-08-25T04:45:44.095921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'359","reported_seq":376,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:46.945756+0000","last_change":"2023-08-25T04:43:41.887033+0000","last_active":"2023-08-25T04:45:46.945756+0000","last_peered":"2023-08-25T04:45:46.945756+0000","last_clean":"2023-08-25T04:45:46.945756+0000","last_became_active":"2023-08-25T04:43:41.886491+0000","last_became_peered":"2023-08-25T04:43:41.886491+0000","last_unstale":"2023-08-25T04:45:46.945756+0000","last_undegraded":"2023-08-25T04:45:46.945756+0000","last_fullsized":"2023-08-25T04:45:46.945756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:55.292210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436249,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":1652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"23'297","reported_seq":312,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.954956+0000","last_change":"2023-08-25T04:43:42.893709+0000","last_active":"2023-08-25T04:45:43.954956+0000","last_peered":"2023-08-25T04:45:43.954956+0000","last_clean":"2023-08-25T04:45:43.954956+0000","last_became_active":"2023-08-25T04:43:42.893525+0000","last_became_peered":"2023-08-25T04:43:42.893525+0000","last_unstale":"2023-08-25T04:45:43.954956+0000","last_undegraded":"2023-08-25T04:45:43.954956+0000","last_fullsized":"2023-08-25T04:45:43.954956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:36:05.985843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138242+0000","last_change":"2023-08-25T04:43:41.890946+0000","last_active":"2023-08-25T04:44:31.138242+0000","last_peered":"2023-08-25T04:44:31.138242+0000","last_clean":"2023-08-25T04:44:31.138242+0000","last_became_active":"2023-08-25T04:43:41.890673+0000","last_became_peered":"2023-08-25T04:43:41.890673+0000","last_unstale":"2023-08-25T04:44:31.138242+0000","last_undegraded":"2023-08-25T04:44:31.138242+0000","last_fullsized":"2023-08-25T04:44:31.138242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:21:24.093061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"23'269","reported_seq":284,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.097987+0000","last_change":"2023-08-25T04:43:42.897809+0000","last_active":"2023-08-25T04:45:44.097987+0000","last_peered":"2023-08-25T04:45:44.097987+0000","last_clean":"2023-08-25T04:45:44.097987+0000","last_became_active":"2023-08-25T04:43:42.897204+0000","last_became_peered":"2023-08-25T04:43:42.897204+0000","last_unstale":"2023-08-25T04:45:44.097987+0000","last_undegraded":"2023-08-25T04:45:44.097987+0000","last_fullsized":"2023-08-25T04:45:44.097987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:25:20.195553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.817257+0000","last_change":"2023-08-25T04:43:41.881387+0000","last_active":"2023-08-25T04:44:30.817257+0000","last_peered":"2023-08-25T04:44:30.817257+0000","last_clean":"2023-08-25T04:44:30.817257+0000","last_became_active":"2023-08-25T04:43:41.881067+0000","last_became_peered":"2023-08-25T04:43:41.881067+0000","last_unstale":"2023-08-25T04:44:30.817257+0000","last_undegraded":"2023-08-25T04:44:30.817257+0000","last_fullsized":"2023-08-25T04:44:30.817257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'253","reported_seq":268,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.937984+0000","last_change":"2023-08-25T04:43:42.895088+0000","last_active":"2023-08-25T04:45:43.937984+0000","last_peered":"2023-08-25T04:45:43.937984+0000","last_clean":"2023-08-25T04:45:43.937984+0000","last_became_active":"2023-08-25T04:43:42.894807+0000","last_became_peered":"2023-08-25T04:43:42.894807+0000","last_unstale":"2023-08-25T04:45:43.937984+0000","last_undegraded":"2023-08-25T04:45:43.937984+0000","last_fullsized":"2023-08-25T04:45:43.937984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:46:42.145657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138466+0000","last_change":"2023-08-25T04:43:41.890995+0000","last_active":"2023-08-25T04:44:31.138466+0000","last_peered":"2023-08-25T04:44:31.138466+0000","last_clean":"2023-08-25T04:44:31.138466+0000","last_became_active":"2023-08-25T04:43:41.890706+0000","last_became_peered":"2023-08-25T04:43:41.890706+0000","last_unstale":"2023-08-25T04:44:31.138466+0000","last_undegraded":"2023-08-25T04:44:31.138466+0000","last_fullsized":"2023-08-25T04:44:31.138466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:08.854411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"23'288","reported_seq":304,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.091771+0000","last_change":"2023-08-25T04:43:42.897775+0000","last_active":"2023-08-25T04:45:44.091771+0000","last_peered":"2023-08-25T04:45:44.091771+0000","last_clean":"2023-08-25T04:45:44.091771+0000","last_became_active":"2023-08-25T04:43:42.897476+0000","last_became_peered":"2023-08-25T04:43:42.897476+0000","last_unstale":"2023-08-25T04:45:44.091771+0000","last_undegraded":"2023-08-25T04:45:44.091771+0000","last_fullsized":"2023-08-25T04:45:44.091771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500563+0000","last_change":"2023-08-25T04:43:41.892829+0000","last_active":"2023-08-25T04:44:31.500563+0000","last_peered":"2023-08-25T04:44:31.500563+0000","last_clean":"2023-08-25T04:44:31.500563+0000","last_became_active":"2023-08-25T04:43:41.892517+0000","last_became_peered":"2023-08-25T04:43:41.892517+0000","last_unstale":"2023-08-25T04:44:31.500563+0000","last_undegraded":"2023-08-25T04:44:31.500563+0000","last_fullsized":"2023-08-25T04:44:31.500563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:57:37.072728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"23'268","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.939447+0000","last_change":"2023-08-25T04:43:42.905276+0000","last_active":"2023-08-25T04:45:43.939447+0000","last_peered":"2023-08-25T04:45:43.939447+0000","last_clean":"2023-08-25T04:45:43.939447+0000","last_became_active":"2023-08-25T04:43:42.904736+0000","last_became_peered":"2023-08-25T04:43:42.904736+0000","last_unstale":"2023-08-25T04:45:43.939447+0000","last_undegraded":"2023-08-25T04:45:43.939447+0000","last_fullsized":"2023-08-25T04:45:43.939447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:38.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138672+0000","last_change":"2023-08-25T04:43:41.891246+0000","last_active":"2023-08-25T04:44:31.138672+0000","last_peered":"2023-08-25T04:44:31.138672+0000","last_clean":"2023-08-25T04:44:31.138672+0000","last_became_active":"2023-08-25T04:43:41.890942+0000","last_became_peered":"2023-08-25T04:43:41.890942+0000","last_unstale":"2023-08-25T04:44:31.138672+0000","last_undegraded":"2023-08-25T04:44:31.138672+0000","last_fullsized":"2023-08-25T04:44:31.138672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:33:59.579978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"23'238","reported_seq":253,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.068264+0000","last_change":"2023-08-25T04:43:42.895071+0000","last_active":"2023-08-25T04:45:44.068264+0000","last_peered":"2023-08-25T04:45:44.068264+0000","last_clean":"2023-08-25T04:45:44.068264+0000","last_became_active":"2023-08-25T04:43:42.894285+0000","last_became_peered":"2023-08-25T04:43:42.894285+0000","last_unstale":"2023-08-25T04:45:44.068264+0000","last_undegraded":"2023-08-25T04:45:44.068264+0000","last_fullsized":"2023-08-25T04:45:44.068264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:12.206120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138636+0000","last_change":"2023-08-25T04:43:41.891175+0000","last_active":"2023-08-25T04:44:31.138636+0000","last_peered":"2023-08-25T04:44:31.138636+0000","last_clean":"2023-08-25T04:44:31.138636+0000","last_became_active":"2023-08-25T04:43:41.890883+0000","last_became_peered":"2023-08-25T04:43:41.890883+0000","last_unstale":"2023-08-25T04:44:31.138636+0000","last_undegraded":"2023-08-25T04:44:31.138636+0000","last_fullsized":"2023-08-25T04:44:31.138636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:38.632609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"23'265","reported_seq":280,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.955269+0000","last_change":"2023-08-25T04:43:42.891686+0000","last_active":"2023-08-25T04:45:43.955269+0000","last_peered":"2023-08-25T04:45:43.955269+0000","last_clean":"2023-08-25T04:45:43.955269+0000","last_became_active":"2023-08-25T04:43:42.891443+0000","last_became_peered":"2023-08-25T04:43:42.891443+0000","last_unstale":"2023-08-25T04:45:43.955269+0000","last_undegraded":"2023-08-25T04:45:43.955269+0000","last_fullsized":"2023-08-25T04:45:43.955269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:18:58.719117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138361+0000","last_change":"2023-08-25T04:43:41.888723+0000","last_active":"2023-08-25T04:44:31.138361+0000","last_peered":"2023-08-25T04:44:31.138361+0000","last_clean":"2023-08-25T04:44:31.138361+0000","last_became_active":"2023-08-25T04:43:41.888447+0000","last_became_peered":"2023-08-25T04:43:41.888447+0000","last_unstale":"2023-08-25T04:44:31.138361+0000","last_undegraded":"2023-08-25T04:44:31.138361+0000","last_fullsized":"2023-08-25T04:44:31.138361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:42.712431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"23'270","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.086705+0000","last_change":"2023-08-25T04:43:42.892447+0000","last_active":"2023-08-25T04:45:44.086705+0000","last_peered":"2023-08-25T04:45:44.086705+0000","last_clean":"2023-08-25T04:45:44.086705+0000","last_became_active":"2023-08-25T04:43:42.892191+0000","last_became_peered":"2023-08-25T04:43:42.892191+0000","last_unstale":"2023-08-25T04:45:44.086705+0000","last_undegraded":"2023-08-25T04:45:44.086705+0000","last_fullsized":"2023-08-25T04:45:44.086705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:18.265853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475964+0000","last_change":"2023-08-25T04:43:41.884395+0000","last_active":"2023-08-25T04:44:30.475964+0000","last_peered":"2023-08-25T04:44:30.475964+0000","last_clean":"2023-08-25T04:44:30.475964+0000","last_became_active":"2023-08-25T04:43:41.884098+0000","last_became_peered":"2023-08-25T04:43:41.884098+0000","last_unstale":"2023-08-25T04:44:30.475964+0000","last_undegraded":"2023-08-25T04:44:30.475964+0000","last_fullsized":"2023-08-25T04:44:30.475964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:20.449241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"23'269","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.112194+0000","last_change":"2023-08-25T04:43:42.881050+0000","last_active":"2023-08-25T04:45:44.112194+0000","last_peered":"2023-08-25T04:45:44.112194+0000","last_clean":"2023-08-25T04:45:44.112194+0000","last_became_active":"2023-08-25T04:43:42.880104+0000","last_became_peered":"2023-08-25T04:43:42.880104+0000","last_unstale":"2023-08-25T04:45:44.112194+0000","last_undegraded":"2023-08-25T04:45:44.112194+0000","last_fullsized":"2023-08-25T04:45:44.112194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:30.051992+0000","last_change":"2023-08-25T04:43:41.885729+0000","last_active":"2023-08-25T04:45:30.051992+0000","last_peered":"2023-08-25T04:45:30.051992+0000","last_clean":"2023-08-25T04:45:30.051992+0000","last_became_active":"2023-08-25T04:43:41.885433+0000","last_became_peered":"2023-08-25T04:43:41.885433+0000","last_unstale":"2023-08-25T04:45:30.051992+0000","last_undegraded":"2023-08-25T04:45:30.051992+0000","last_fullsized":"2023-08-25T04:45:30.051992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:38.632609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'243","reported_seq":258,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.090177+0000","last_change":"2023-08-25T04:43:42.896701+0000","last_active":"2023-08-25T04:45:44.090177+0000","last_peered":"2023-08-25T04:45:44.090177+0000","last_clean":"2023-08-25T04:45:44.090177+0000","last_became_active":"2023-08-25T04:43:42.896440+0000","last_became_peered":"2023-08-25T04:43:42.896440+0000","last_unstale":"2023-08-25T04:45:44.090177+0000","last_undegraded":"2023-08-25T04:45:44.090177+0000","last_fullsized":"2023-08-25T04:45:44.090177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:15.437547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"23'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500655+0000","last_change":"2023-08-25T04:43:41.891087+0000","last_active":"2023-08-25T04:44:31.500655+0000","last_peered":"2023-08-25T04:44:31.500655+0000","last_clean":"2023-08-25T04:44:31.500655+0000","last_became_active":"2023-08-25T04:43:41.890827+0000","last_became_peered":"2023-08-25T04:43:41.890827+0000","last_unstale":"2023-08-25T04:44:31.500655+0000","last_undegraded":"2023-08-25T04:44:31.500655+0000","last_fullsized":"2023-08-25T04:44:31.500655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:00:12.731255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"23'288","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.955555+0000","last_change":"2023-08-25T04:43:42.897377+0000","last_active":"2023-08-25T04:45:43.955555+0000","last_peered":"2023-08-25T04:45:43.955555+0000","last_clean":"2023-08-25T04:45:43.955555+0000","last_became_active":"2023-08-25T04:43:42.897108+0000","last_became_peered":"2023-08-25T04:43:42.897108+0000","last_unstale":"2023-08-25T04:45:43.955555+0000","last_undegraded":"2023-08-25T04:45:43.955555+0000","last_fullsized":"2023-08-25T04:45:43.955555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:59.768622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282280+0000","last_change":"2023-08-25T04:43:41.888568+0000","last_active":"2023-08-25T04:44:31.282280+0000","last_peered":"2023-08-25T04:44:31.282280+0000","last_clean":"2023-08-25T04:44:31.282280+0000","last_became_active":"2023-08-25T04:43:41.888323+0000","last_became_peered":"2023-08-25T04:43:41.888323+0000","last_unstale":"2023-08-25T04:44:31.282280+0000","last_undegraded":"2023-08-25T04:44:31.282280+0000","last_fullsized":"2023-08-25T04:44:31.282280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:53:53.170122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"23'285","reported_seq":300,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.954940+0000","last_change":"2023-08-25T04:43:42.897222+0000","last_active":"2023-08-25T04:45:43.954940+0000","last_peered":"2023-08-25T04:45:43.954940+0000","last_clean":"2023-08-25T04:45:43.954940+0000","last_became_active":"2023-08-25T04:43:42.896943+0000","last_became_peered":"2023-08-25T04:43:42.896943+0000","last_unstale":"2023-08-25T04:45:43.954940+0000","last_undegraded":"2023-08-25T04:45:43.954940+0000","last_fullsized":"2023-08-25T04:45:43.954940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:39.531589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.477627+0000","last_change":"2023-08-25T04:43:41.887489+0000","last_active":"2023-08-25T04:44:30.477627+0000","last_peered":"2023-08-25T04:44:30.477627+0000","last_clean":"2023-08-25T04:44:30.477627+0000","last_became_active":"2023-08-25T04:43:41.886846+0000","last_became_peered":"2023-08-25T04:43:41.886846+0000","last_unstale":"2023-08-25T04:44:30.477627+0000","last_undegraded":"2023-08-25T04:44:30.477627+0000","last_fullsized":"2023-08-25T04:44:30.477627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:06.310501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'280","reported_seq":296,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.094714+0000","last_change":"2023-08-25T04:43:42.903030+0000","last_active":"2023-08-25T04:45:44.094714+0000","last_peered":"2023-08-25T04:45:44.094714+0000","last_clean":"2023-08-25T04:45:44.094714+0000","last_became_active":"2023-08-25T04:43:42.902123+0000","last_became_peered":"2023-08-25T04:43:42.902123+0000","last_unstale":"2023-08-25T04:45:44.094714+0000","last_undegraded":"2023-08-25T04:45:44.094714+0000","last_fullsized":"2023-08-25T04:45:44.094714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478851+0000","last_change":"2023-08-25T04:43:41.883173+0000","last_active":"2023-08-25T04:44:30.478851+0000","last_peered":"2023-08-25T04:44:30.478851+0000","last_clean":"2023-08-25T04:44:30.478851+0000","last_became_active":"2023-08-25T04:43:41.882776+0000","last_became_peered":"2023-08-25T04:43:41.882776+0000","last_unstale":"2023-08-25T04:44:30.478851+0000","last_undegraded":"2023-08-25T04:44:30.478851+0000","last_fullsized":"2023-08-25T04:44:30.478851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:43.055214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282709+0000","last_change":"2023-08-25T04:43:36.786045+0000","last_active":"2023-08-25T04:44:31.282709+0000","last_peered":"2023-08-25T04:44:31.282709+0000","last_clean":"2023-08-25T04:44:31.282709+0000","last_became_active":"2023-08-25T04:43:36.785725+0000","last_became_peered":"2023-08-25T04:43:36.785725+0000","last_unstale":"2023-08-25T04:44:31.282709+0000","last_undegraded":"2023-08-25T04:44:31.282709+0000","last_fullsized":"2023-08-25T04:44:31.282709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:13.214839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"23'253","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.095457+0000","last_change":"2023-08-25T04:43:42.890044+0000","last_active":"2023-08-25T04:45:44.095457+0000","last_peered":"2023-08-25T04:45:44.095457+0000","last_clean":"2023-08-25T04:45:44.095457+0000","last_became_active":"2023-08-25T04:43:42.889721+0000","last_became_peered":"2023-08-25T04:43:42.889721+0000","last_unstale":"2023-08-25T04:45:44.095457+0000","last_undegraded":"2023-08-25T04:45:44.095457+0000","last_fullsized":"2023-08-25T04:45:44.095457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:59.175818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478654+0000","last_change":"2023-08-25T04:43:36.782928+0000","last_active":"2023-08-25T04:44:30.478654+0000","last_peered":"2023-08-25T04:44:30.478654+0000","last_clean":"2023-08-25T04:44:30.478654+0000","last_became_active":"2023-08-25T04:43:36.782680+0000","last_became_peered":"2023-08-25T04:43:36.782680+0000","last_unstale":"2023-08-25T04:44:30.478654+0000","last_undegraded":"2023-08-25T04:44:30.478654+0000","last_fullsized":"2023-08-25T04:44:30.478654+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:33:54.492649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'10","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:46.929441+0000","last_change":"2023-08-25T04:43:41.888878+0000","last_active":"2023-08-25T04:45:46.929441+0000","last_peered":"2023-08-25T04:45:46.929441+0000","last_clean":"2023-08-25T04:45:46.929441+0000","last_became_active":"2023-08-25T04:43:41.885363+0000","last_became_peered":"2023-08-25T04:43:41.885363+0000","last_unstale":"2023-08-25T04:45:46.929441+0000","last_undegraded":"2023-08-25T04:45:46.929441+0000","last_fullsized":"2023-08-25T04:45:46.929441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'246","reported_seq":262,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.073343+0000","last_change":"2023-08-25T04:43:42.899201+0000","last_active":"2023-08-25T04:45:44.073343+0000","last_peered":"2023-08-25T04:45:44.073343+0000","last_clean":"2023-08-25T04:45:44.073343+0000","last_became_active":"2023-08-25T04:43:42.898942+0000","last_became_peered":"2023-08-25T04:43:42.898942+0000","last_unstale":"2023-08-25T04:45:44.073343+0000","last_undegraded":"2023-08-25T04:45:44.073343+0000","last_fullsized":"2023-08-25T04:45:44.073343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:57:45.095370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.401842+0000","last_change":"2023-08-25T04:43:36.785266+0000","last_active":"2023-08-25T04:45:44.401842+0000","last_peered":"2023-08-25T04:45:44.401842+0000","last_clean":"2023-08-25T04:45:44.401842+0000","last_became_active":"2023-08-25T04:43:36.784937+0000","last_became_peered":"2023-08-25T04:43:36.784937+0000","last_unstale":"2023-08-25T04:45:44.401842+0000","last_undegraded":"2023-08-25T04:45:44.401842+0000","last_fullsized":"2023-08-25T04:45:44.401842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138986+0000","last_change":"2023-08-25T04:43:36.785867+0000","last_active":"2023-08-25T04:44:31.138986+0000","last_peered":"2023-08-25T04:44:31.138986+0000","last_clean":"2023-08-25T04:44:31.138986+0000","last_became_active":"2023-08-25T04:43:36.785451+0000","last_became_peered":"2023-08-25T04:43:36.785451+0000","last_unstale":"2023-08-25T04:44:31.138986+0000","last_undegraded":"2023-08-25T04:44:31.138986+0000","last_fullsized":"2023-08-25T04:44:31.138986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:10.216462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'14","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:47.861160+0000","last_change":"2023-08-25T04:43:41.886451+0000","last_active":"2023-08-25T04:45:47.861160+0000","last_peered":"2023-08-25T04:45:47.861160+0000","last_clean":"2023-08-25T04:45:47.861160+0000","last_became_active":"2023-08-25T04:43:41.885029+0000","last_became_peered":"2023-08-25T04:43:41.885029+0000","last_unstale":"2023-08-25T04:45:47.861160+0000","last_undegraded":"2023-08-25T04:45:47.861160+0000","last_fullsized":"2023-08-25T04:45:47.861160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7272,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":13,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'275","reported_seq":291,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.094925+0000","last_change":"2023-08-25T04:43:42.881048+0000","last_active":"2023-08-25T04:45:44.094925+0000","last_peered":"2023-08-25T04:45:44.094925+0000","last_clean":"2023-08-25T04:45:44.094925+0000","last_became_active":"2023-08-25T04:43:42.880591+0000","last_became_peered":"2023-08-25T04:43:42.880591+0000","last_unstale":"2023-08-25T04:45:44.094925+0000","last_undegraded":"2023-08-25T04:45:44.094925+0000","last_fullsized":"2023-08-25T04:45:44.094925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138202+0000","last_change":"2023-08-25T04:43:37.192872+0000","last_active":"2023-08-25T04:44:31.138202+0000","last_peered":"2023-08-25T04:44:31.138202+0000","last_clean":"2023-08-25T04:44:31.138202+0000","last_became_active":"2023-08-25T04:43:37.192594+0000","last_became_peered":"2023-08-25T04:43:37.192594+0000","last_unstale":"2023-08-25T04:44:31.138202+0000","last_undegraded":"2023-08-25T04:44:31.138202+0000","last_fullsized":"2023-08-25T04:44:31.138202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:14:07.553177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.401802+0000","last_change":"2023-08-25T04:43:41.888507+0000","last_active":"2023-08-25T04:45:44.401802+0000","last_peered":"2023-08-25T04:45:44.401802+0000","last_clean":"2023-08-25T04:45:44.401802+0000","last_became_active":"2023-08-25T04:43:41.888158+0000","last_became_peered":"2023-08-25T04:43:41.888158+0000","last_unstale":"2023-08-25T04:45:44.401802+0000","last_undegraded":"2023-08-25T04:45:44.401802+0000","last_fullsized":"2023-08-25T04:45:44.401802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'249","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.089110+0000","last_change":"2023-08-25T04:43:42.902440+0000","last_active":"2023-08-25T04:45:44.089110+0000","last_peered":"2023-08-25T04:45:44.089110+0000","last_clean":"2023-08-25T04:45:44.089110+0000","last_became_active":"2023-08-25T04:43:42.901657+0000","last_became_peered":"2023-08-25T04:43:42.901657+0000","last_unstale":"2023-08-25T04:45:44.089110+0000","last_undegraded":"2023-08-25T04:45:44.089110+0000","last_fullsized":"2023-08-25T04:45:44.089110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.138904+0000","last_change":"2023-08-25T04:43:37.192977+0000","last_active":"2023-08-25T04:44:31.138904+0000","last_peered":"2023-08-25T04:44:31.138904+0000","last_clean":"2023-08-25T04:44:31.138904+0000","last_became_active":"2023-08-25T04:43:37.192427+0000","last_became_peered":"2023-08-25T04:43:37.192427+0000","last_unstale":"2023-08-25T04:44:31.138904+0000","last_undegraded":"2023-08-25T04:44:31.138904+0000","last_fullsized":"2023-08-25T04:44:31.138904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:25:14.103104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478312+0000","last_change":"2023-08-25T04:43:41.883960+0000","last_active":"2023-08-25T04:44:30.478312+0000","last_peered":"2023-08-25T04:44:30.478312+0000","last_clean":"2023-08-25T04:44:30.478312+0000","last_became_active":"2023-08-25T04:43:41.883621+0000","last_became_peered":"2023-08-25T04:43:41.883621+0000","last_unstale":"2023-08-25T04:44:30.478312+0000","last_undegraded":"2023-08-25T04:44:30.478312+0000","last_fullsized":"2023-08-25T04:44:30.478312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:37:55.965513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'267","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.955409+0000","last_change":"2023-08-25T04:43:42.893639+0000","last_active":"2023-08-25T04:45:43.955409+0000","last_peered":"2023-08-25T04:45:43.955409+0000","last_clean":"2023-08-25T04:45:43.955409+0000","last_became_active":"2023-08-25T04:43:42.893333+0000","last_became_peered":"2023-08-25T04:43:42.893333+0000","last_unstale":"2023-08-25T04:45:43.955409+0000","last_undegraded":"2023-08-25T04:45:43.955409+0000","last_fullsized":"2023-08-25T04:45:43.955409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:37.784121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475519+0000","last_change":"2023-08-25T04:43:37.192780+0000","last_active":"2023-08-25T04:44:30.475519+0000","last_peered":"2023-08-25T04:44:30.475519+0000","last_clean":"2023-08-25T04:44:30.475519+0000","last_became_active":"2023-08-25T04:43:37.192432+0000","last_became_peered":"2023-08-25T04:43:37.192432+0000","last_unstale":"2023-08-25T04:44:30.475519+0000","last_undegraded":"2023-08-25T04:44:30.475519+0000","last_fullsized":"2023-08-25T04:44:30.475519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:00.352042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282491+0000","last_change":"2023-08-25T04:43:41.889966+0000","last_active":"2023-08-25T04:44:31.282491+0000","last_peered":"2023-08-25T04:44:31.282491+0000","last_clean":"2023-08-25T04:44:31.282491+0000","last_became_active":"2023-08-25T04:43:41.889717+0000","last_became_peered":"2023-08-25T04:43:41.889717+0000","last_unstale":"2023-08-25T04:44:31.282491+0000","last_undegraded":"2023-08-25T04:44:31.282491+0000","last_fullsized":"2023-08-25T04:44:31.282491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:46:39.529025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"23'260","reported_seq":277,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.380328+0000","last_change":"2023-08-25T04:43:42.885970+0000","last_active":"2023-08-25T04:45:48.380328+0000","last_peered":"2023-08-25T04:45:48.380328+0000","last_clean":"2023-08-25T04:45:48.380328+0000","last_became_active":"2023-08-25T04:43:42.885671+0000","last_became_peered":"2023-08-25T04:43:42.885671+0000","last_unstale":"2023-08-25T04:45:48.380328+0000","last_undegraded":"2023-08-25T04:45:48.380328+0000","last_fullsized":"2023-08-25T04:45:48.380328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500874+0000","last_change":"2023-08-25T04:43:37.192768+0000","last_active":"2023-08-25T04:44:31.500874+0000","last_peered":"2023-08-25T04:44:31.500874+0000","last_clean":"2023-08-25T04:44:31.500874+0000","last_became_active":"2023-08-25T04:43:37.192429+0000","last_became_peered":"2023-08-25T04:43:37.192429+0000","last_unstale":"2023-08-25T04:44:31.500874+0000","last_undegraded":"2023-08-25T04:44:31.500874+0000","last_fullsized":"2023-08-25T04:44:31.500874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:26.497020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"23'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.380253+0000","last_change":"2023-08-25T04:43:41.888493+0000","last_active":"2023-08-25T04:45:48.380253+0000","last_peered":"2023-08-25T04:45:48.380253+0000","last_clean":"2023-08-25T04:45:48.380253+0000","last_became_active":"2023-08-25T04:43:41.888207+0000","last_became_peered":"2023-08-25T04:43:41.888207+0000","last_unstale":"2023-08-25T04:45:48.380253+0000","last_undegraded":"2023-08-25T04:45:48.380253+0000","last_fullsized":"2023-08-25T04:45:48.380253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'310","reported_seq":327,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:47.861231+0000","last_change":"2023-08-25T04:43:42.900866+0000","last_active":"2023-08-25T04:45:47.861231+0000","last_peered":"2023-08-25T04:45:47.861231+0000","last_clean":"2023-08-25T04:45:47.861231+0000","last_became_active":"2023-08-25T04:43:42.900470+0000","last_became_peered":"2023-08-25T04:43:42.900470+0000","last_unstale":"2023-08-25T04:45:47.861231+0000","last_undegraded":"2023-08-25T04:45:47.861231+0000","last_fullsized":"2023-08-25T04:45:47.861231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.500918+0000","last_change":"2023-08-25T04:43:36.785280+0000","last_active":"2023-08-25T04:44:31.500918+0000","last_peered":"2023-08-25T04:44:31.500918+0000","last_clean":"2023-08-25T04:44:31.500918+0000","last_became_active":"2023-08-25T04:43:36.784943+0000","last_became_peered":"2023-08-25T04:43:36.784943+0000","last_unstale":"2023-08-25T04:44:31.500918+0000","last_undegraded":"2023-08-25T04:44:31.500918+0000","last_fullsized":"2023-08-25T04:44:31.500918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.996393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"23'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:37.668818+0000","last_change":"2023-08-25T04:43:41.884839+0000","last_active":"2023-08-25T04:45:37.668818+0000","last_peered":"2023-08-25T04:45:37.668818+0000","last_clean":"2023-08-25T04:45:37.668818+0000","last_became_active":"2023-08-25T04:43:41.884535+0000","last_became_peered":"2023-08-25T04:43:41.884535+0000","last_unstale":"2023-08-25T04:45:37.668818+0000","last_undegraded":"2023-08-25T04:45:37.668818+0000","last_fullsized":"2023-08-25T04:45:37.668818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:57:40.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"23'272","reported_seq":289,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.380281+0000","last_change":"2023-08-25T04:43:42.903007+0000","last_active":"2023-08-25T04:45:48.380281+0000","last_peered":"2023-08-25T04:45:48.380281+0000","last_clean":"2023-08-25T04:45:48.380281+0000","last_became_active":"2023-08-25T04:43:42.902721+0000","last_became_peered":"2023-08-25T04:43:42.902721+0000","last_unstale":"2023-08-25T04:45:48.380281+0000","last_undegraded":"2023-08-25T04:45:48.380281+0000","last_fullsized":"2023-08-25T04:45:48.380281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.817871+0000","last_change":"2023-08-25T04:43:41.889969+0000","last_active":"2023-08-25T04:44:30.817871+0000","last_peered":"2023-08-25T04:44:30.817871+0000","last_clean":"2023-08-25T04:44:30.817871+0000","last_became_active":"2023-08-25T04:43:41.889659+0000","last_became_peered":"2023-08-25T04:43:41.889659+0000","last_unstale":"2023-08-25T04:44:30.817871+0000","last_undegraded":"2023-08-25T04:44:30.817871+0000","last_fullsized":"2023-08-25T04:44:30.817871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'274","reported_seq":290,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.949087+0000","last_change":"2023-08-25T04:43:42.894953+0000","last_active":"2023-08-25T04:45:43.949087+0000","last_peered":"2023-08-25T04:45:43.949087+0000","last_clean":"2023-08-25T04:45:43.949087+0000","last_became_active":"2023-08-25T04:43:42.894618+0000","last_became_peered":"2023-08-25T04:43:42.894618+0000","last_unstale":"2023-08-25T04:45:43.949087+0000","last_undegraded":"2023-08-25T04:45:43.949087+0000","last_fullsized":"2023-08-25T04:45:43.949087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.475832+0000","last_change":"2023-08-25T04:43:41.886470+0000","last_active":"2023-08-25T04:44:30.475832+0000","last_peered":"2023-08-25T04:44:30.475832+0000","last_clean":"2023-08-25T04:44:30.475832+0000","last_became_active":"2023-08-25T04:43:41.886063+0000","last_became_peered":"2023-08-25T04:43:41.886063+0000","last_unstale":"2023-08-25T04:44:30.475832+0000","last_undegraded":"2023-08-25T04:44:30.475832+0000","last_fullsized":"2023-08-25T04:44:30.475832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:33.855942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'263","reported_seq":278,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.952687+0000","last_change":"2023-08-25T04:43:42.900475+0000","last_active":"2023-08-25T04:45:43.952687+0000","last_peered":"2023-08-25T04:45:43.952687+0000","last_clean":"2023-08-25T04:45:43.952687+0000","last_became_active":"2023-08-25T04:43:42.900135+0000","last_became_peered":"2023-08-25T04:43:42.900135+0000","last_unstale":"2023-08-25T04:45:43.952687+0000","last_undegraded":"2023-08-25T04:45:43.952687+0000","last_fullsized":"2023-08-25T04:45:43.952687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:38.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.476228+0000","last_change":"2023-08-25T04:43:41.891609+0000","last_active":"2023-08-25T04:44:30.476228+0000","last_peered":"2023-08-25T04:44:30.476228+0000","last_clean":"2023-08-25T04:44:30.476228+0000","last_became_active":"2023-08-25T04:43:41.891306+0000","last_became_peered":"2023-08-25T04:43:41.891306+0000","last_unstale":"2023-08-25T04:44:30.476228+0000","last_undegraded":"2023-08-25T04:44:30.476228+0000","last_fullsized":"2023-08-25T04:44:30.476228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:03.981683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'257","reported_seq":272,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.953493+0000","last_change":"2023-08-25T04:43:42.894647+0000","last_active":"2023-08-25T04:45:43.953493+0000","last_peered":"2023-08-25T04:45:43.953493+0000","last_clean":"2023-08-25T04:45:43.953493+0000","last_became_active":"2023-08-25T04:43:42.894386+0000","last_became_peered":"2023-08-25T04:43:42.894386+0000","last_unstale":"2023-08-25T04:45:43.953493+0000","last_undegraded":"2023-08-25T04:45:43.953493+0000","last_fullsized":"2023-08-25T04:45:43.953493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:41:20.742718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:30.478873+0000","last_change":"2023-08-25T04:43:41.893331+0000","last_active":"2023-08-25T04:44:30.478873+0000","last_peered":"2023-08-25T04:44:30.478873+0000","last_clean":"2023-08-25T04:44:30.478873+0000","last_became_active":"2023-08-25T04:43:41.892929+0000","last_became_peered":"2023-08-25T04:43:41.892929+0000","last_unstale":"2023-08-25T04:44:30.478873+0000","last_undegraded":"2023-08-25T04:44:30.478873+0000","last_fullsized":"2023-08-25T04:44:30.478873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:58:44.113433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'252","reported_seq":267,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.948860+0000","last_change":"2023-08-25T04:43:42.894553+0000","last_active":"2023-08-25T04:45:43.948860+0000","last_peered":"2023-08-25T04:45:43.948860+0000","last_clean":"2023-08-25T04:45:43.948860+0000","last_became_active":"2023-08-25T04:43:42.894239+0000","last_became_peered":"2023-08-25T04:43:42.894239+0000","last_unstale":"2023-08-25T04:45:43.948860+0000","last_undegraded":"2023-08-25T04:45:43.948860+0000","last_fullsized":"2023-08-25T04:45:43.948860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:43.717551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'5","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:47.861226+0000","last_change":"2023-08-25T04:43:41.883254+0000","last_active":"2023-08-25T04:45:47.861226+0000","last_peered":"2023-08-25T04:45:47.861226+0000","last_clean":"2023-08-25T04:45:47.861226+0000","last_became_active":"2023-08-25T04:43:41.882756+0000","last_became_peered":"2023-08-25T04:43:41.882756+0000","last_unstale":"2023-08-25T04:45:47.861226+0000","last_undegraded":"2023-08-25T04:45:47.861226+0000","last_fullsized":"2023-08-25T04:45:47.861226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'285","reported_seq":300,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.953917+0000","last_change":"2023-08-25T04:43:42.895154+0000","last_active":"2023-08-25T04:45:43.953917+0000","last_peered":"2023-08-25T04:45:43.953917+0000","last_clean":"2023-08-25T04:45:43.953917+0000","last_became_active":"2023-08-25T04:43:42.894912+0000","last_became_peered":"2023-08-25T04:43:42.894912+0000","last_unstale":"2023-08-25T04:45:43.953917+0000","last_undegraded":"2023-08-25T04:45:43.953917+0000","last_fullsized":"2023-08-25T04:45:43.953917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:53.893508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"23'260","reported_seq":276,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.947244+0000","last_change":"2023-08-25T04:43:42.893541+0000","last_active":"2023-08-25T04:45:43.947244+0000","last_peered":"2023-08-25T04:45:43.947244+0000","last_clean":"2023-08-25T04:45:43.947244+0000","last_became_active":"2023-08-25T04:43:42.893255+0000","last_became_peered":"2023-08-25T04:43:42.893255+0000","last_unstale":"2023-08-25T04:45:43.947244+0000","last_undegraded":"2023-08-25T04:45:43.947244+0000","last_fullsized":"2023-08-25T04:45:43.947244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:43:44.192741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"23'306","reported_seq":322,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.090127+0000","last_change":"2023-08-25T04:43:42.897868+0000","last_active":"2023-08-25T04:45:44.090127+0000","last_peered":"2023-08-25T04:45:44.090127+0000","last_clean":"2023-08-25T04:45:44.090127+0000","last_became_active":"2023-08-25T04:43:42.897394+0000","last_became_peered":"2023-08-25T04:43:42.897394+0000","last_unstale":"2023-08-25T04:45:44.090127+0000","last_undegraded":"2023-08-25T04:45:44.090127+0000","last_fullsized":"2023-08-25T04:45:44.090127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:21:25.098181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'286","reported_seq":302,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.952008+0000","last_change":"2023-08-25T04:43:42.894698+0000","last_active":"2023-08-25T04:45:43.952008+0000","last_peered":"2023-08-25T04:45:43.952008+0000","last_clean":"2023-08-25T04:45:43.952008+0000","last_became_active":"2023-08-25T04:43:42.894176+0000","last_became_peered":"2023-08-25T04:43:42.894176+0000","last_unstale":"2023-08-25T04:45:43.952008+0000","last_undegraded":"2023-08-25T04:45:43.952008+0000","last_fullsized":"2023-08-25T04:45:43.952008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:57:17.411245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"23'256","reported_seq":272,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.088530+0000","last_change":"2023-08-25T04:43:42.899435+0000","last_active":"2023-08-25T04:45:44.088530+0000","last_peered":"2023-08-25T04:45:44.088530+0000","last_clean":"2023-08-25T04:45:44.088530+0000","last_became_active":"2023-08-25T04:43:42.898842+0000","last_became_peered":"2023-08-25T04:43:42.898842+0000","last_unstale":"2023-08-25T04:45:44.088530+0000","last_undegraded":"2023-08-25T04:45:44.088530+0000","last_fullsized":"2023-08-25T04:45:44.088530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:43:16.308912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'267","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.950013+0000","last_change":"2023-08-25T04:43:42.890136+0000","last_active":"2023-08-25T04:45:43.950013+0000","last_peered":"2023-08-25T04:45:43.950013+0000","last_clean":"2023-08-25T04:45:43.950013+0000","last_became_active":"2023-08-25T04:43:42.889849+0000","last_became_peered":"2023-08-25T04:43:42.889849+0000","last_unstale":"2023-08-25T04:45:43.950013+0000","last_undegraded":"2023-08-25T04:45:43.950013+0000","last_fullsized":"2023-08-25T04:45:43.950013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":524,"num_write_kb":1101824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16961,"ondisk_log_size":16961,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1444319,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":436,"num_write_kb":1699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2949120,"data_stored":2888638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":438,"ondisk_log_size":438,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66316,"kb_used_data":26820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94305524,"statfs":{"total":96636764160,"available":96568856576,"internally_reserved":0,"allocated":27463680,"data_stored":27284528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.9349999999999996,"5min":1.8160000000000001,"15min":0.96299999999999997},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":18.02,"5min":18.02,"15min":18.02},"last":0.59599999999999997},{"interface":"front","average":{"1min":7.6100000000000003,"5min":1.954,"15min":1.012},"min":{"1min":0.48299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":22.920999999999999,"5min":22.920999999999999,"15min":22.920999999999999},"last":0.36799999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.5759999999999996,"5min":2.0209999999999999,"15min":1.095},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":21.199999999999999,"5min":21.199999999999999,"15min":21.199999999999999},"last":0.439},{"interface":"front","average":{"1min":7.585,"5min":1.968,"15min":1.032},"min":{"1min":0.46600000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":22.437999999999999,"5min":22.437999999999999,"15min":22.437999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.3620000000000001,"5min":1.806,"15min":1.0469999999999999},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":17.844000000000001,"5min":17.844000000000001,"15min":17.844000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":7.2610000000000001,"5min":2.0910000000000002,"15min":1.2290000000000001},"min":{"1min":0.42699999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":19.690999999999999,"5min":19.690999999999999,"15min":19.690999999999999},"last":0.52900000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.7789999999999999,"5min":1.823,"15min":0.997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":17.731000000000002,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":7.0229999999999997,"5min":2.0950000000000002,"15min":1.2729999999999999},"min":{"1min":0.45700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":21.143999999999998,"5min":21.143999999999998,"15min":21.143999999999998},"last":0.64800000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":5.4710000000000001,"5min":1.4690000000000001,"15min":0.80200000000000005},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":22.465,"5min":22.465,"15min":22.465},"last":0.42399999999999999},{"interface":"front","average":{"1min":4.8609999999999998,"5min":1.373,"15min":0.79100000000000004},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":14.042999999999999,"5min":14.042999999999999,"15min":14.042999999999999},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":3.9830000000000001,"5min":1.238,"15min":0.78000000000000003},"min":{"1min":0.33600000000000002,"5min":0.307,"15min":0.307},"max":{"1min":14.117000000000001,"5min":14.117000000000001,"15min":14.117000000000001},"last":0.625},{"interface":"front","average":{"1min":5.8049999999999997,"5min":1.617,"15min":0.91900000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":22.334,"5min":22.334,"15min":22.334},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.8259999999999996,"5min":2.0169999999999999,"15min":1.0489999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":22.385000000000002,"5min":22.385000000000002,"15min":22.385000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":3.907,"5min":1.2529999999999999,"15min":0.81100000000000005},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":17.623000000000001,"5min":17.623000000000001,"15min":17.623000000000001},"last":0.58399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47924,"kb_used_data":8428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323916,"statfs":{"total":96636764160,"available":96587689984,"internally_reserved":0,"allocated":8630272,"data_stored":8480479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":6.2830000000000004,"5min":1.708,"15min":0.94599999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":21.954999999999998,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":6.2729999999999997,"5min":1.7330000000000001,"15min":0.97699999999999998},"min":{"1min":0.35599999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":21.109000000000002,"5min":21.109000000000002,"15min":21.109000000000002},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.7000000000000002,"5min":1.7889999999999999,"15min":1.304},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":16.664999999999999,"5min":16.664999999999999,"15min":16.664999999999999},"last":0.434},{"interface":"front","average":{"1min":5.1100000000000003,"5min":1.6619999999999999,"15min":1.0880000000000001},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":22.042000000000002,"5min":22.042000000000002,"15min":22.042000000000002},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.75,"5min":1.827,"15min":1.3400000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":19.658000000000001,"5min":19.658000000000001,"15min":19.658000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":4.891,"5min":1.4790000000000001,"15min":0.91000000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":21.138999999999999,"5min":21.138999999999999,"15min":21.138999999999999},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":6.1159999999999997,"5min":1.7210000000000001,"15min":0.98899999999999999},"min":{"1min":0.39200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":21.971,"5min":21.971,"15min":21.971},"last":0.71699999999999997},{"interface":"front","average":{"1min":6.274,"5min":2.1110000000000002,"15min":1.417},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":23.931000000000001,"5min":23.931000000000001,"15min":23.931000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.468,"5min":1.302,"15min":0.77400000000000002},"min":{"1min":0.29399999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":14.532999999999999,"5min":14.532999999999999,"15min":14.532999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":4.1900000000000004,"5min":1.27,"15min":0.78300000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":21.081,"5min":21.081,"15min":21.081},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":2.5649999999999999,"5min":0.94599999999999995,"15min":0.67600000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":12.946,"5min":12.946,"15min":12.946},"last":0.53000000000000003},{"interface":"front","average":{"1min":2.6429999999999998,"5min":0.97999999999999998,"15min":0.70299999999999996},"min":{"1min":0.35199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":19.597000000000001,"5min":19.597000000000001,"15min":19.597000000000001},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":2.633,"5min":1.006,"15min":0.73499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.266999999999999,"5min":11.266999999999999,"15min":11.266999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":4.2560000000000002,"5min":1.3320000000000001,"15min":0.84499999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":16.693000000000001,"5min":16.693000000000001,"15min":16.693000000000001},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76984,"kb_used_data":49968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94294856,"statfs":{"total":96636764160,"available":96557932544,"internally_reserved":0,"allocated":51167232,"data_stored":51013887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.7160000000000002,"5min":1.427,"15min":0.71199999999999997},"min":{"1min":0.245,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":23.989999999999998,"5min":23.989999999999998,"15min":23.989999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":5.024,"5min":1.3009999999999999,"15min":0.68100000000000005},"min":{"1min":0.255,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":15.622,"5min":15.622,"15min":15.622},"last":0.501}]},{"osd":2,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.6580000000000004,"5min":1.4430000000000001,"15min":0.74099999999999999},"min":{"1min":0.29899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":23.954000000000001,"5min":23.954000000000001,"15min":23.954000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":5.4690000000000003,"5min":1.4530000000000001,"15min":0.78400000000000003},"min":{"1min":0.34499999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":20.946000000000002,"5min":20.946000000000002,"15min":20.946000000000002},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.2939999999999996,"5min":1.4059999999999999,"15min":0.75800000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":27.884,"5min":27.884,"15min":27.884},"last":0.32400000000000001},{"interface":"front","average":{"1min":5.6310000000000002,"5min":1.4450000000000001,"15min":0.747},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":23.018000000000001,"5min":23.018000000000001,"15min":23.018000000000001},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.2439999999999998,"5min":1.952,"15min":1.0700000000000001},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":24.044,"5min":24.044,"15min":24.044},"last":0.441},{"interface":"front","average":{"1min":7.9050000000000002,"5min":2.0840000000000001,"15min":1.1140000000000001},"min":{"1min":0.501,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":27.940000000000001,"5min":27.940000000000001,"15min":27.940000000000001},"last":0.46500000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":8.516,"5min":2.2000000000000002,"15min":1.147},"min":{"1min":0.44,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":26.969999999999999,"5min":26.969999999999999,"15min":26.969999999999999},"last":0.433},{"interface":"front","average":{"1min":7.0430000000000001,"5min":1.923,"15min":1.0700000000000001},"min":{"1min":0.42399999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":24.018000000000001,"5min":24.018000000000001,"15min":24.018000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.899,"5min":2.0950000000000002,"15min":1.127},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":22.899999999999999,"5min":22.899999999999999,"15min":22.899999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":7.0890000000000004,"5min":1.9550000000000001,"15min":1.099},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":23.898,"5min":23.898,"15min":23.898},"last":0.48299999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.718,"5min":2.0779999999999998,"15min":1.1379999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":21.010999999999999,"5min":21.010999999999999,"15min":21.010999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":6.2210000000000001,"5min":1.7669999999999999,"15min":1.0249999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":23.053999999999998,"5min":23.053999999999998,"15min":23.053999999999998},"last":0.54200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64316,"kb_used_data":24820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94307524,"statfs":{"total":96636764160,"available":96570904576,"internally_reserved":0,"allocated":25415680,"data_stored":25264588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":3.8849999999999998,"5min":1.0649999999999999,"15min":0.59499999999999997},"min":{"1min":0.32800000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":19.956,"5min":19.956,"15min":19.956},"last":0.46600000000000003},{"interface":"front","average":{"1min":4.4450000000000003,"5min":1.2150000000000001,"15min":0.67700000000000005},"min":{"1min":0.29599999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":14.029999999999999,"5min":14.029999999999999,"15min":14.029999999999999},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":6.3410000000000002,"5min":1.627,"15min":0.84099999999999997},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":22.942,"5min":22.942,"15min":22.942},"last":0.54200000000000004},{"interface":"front","average":{"1min":2.7879999999999998,"5min":0.87,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.016,"5min":11.016,"15min":11.016},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":4.9039999999999999,"5min":1.3069999999999999,"15min":0.70699999999999996},"min":{"1min":0.35899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":19.997,"5min":19.997,"15min":19.997},"last":0.52700000000000002},{"interface":"front","average":{"1min":5.9139999999999997,"5min":1.522,"15min":0.79000000000000004},"min":{"1min":0.40400000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":17.045999999999999,"5min":17.045999999999999,"15min":17.045999999999999},"last":0.622}]},{"osd":4,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":4.484,"5min":1.786,"15min":1.3360000000000001},"min":{"1min":0.49199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":21.001000000000001,"5min":21.001000000000001,"15min":21.001000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":8.2750000000000004,"5min":2.1640000000000001,"15min":1.1459999999999999},"min":{"1min":0.46400000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":9.8439999999999994,"5min":2.4820000000000002,"15min":1.2549999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":23.93,"5min":23.93,"15min":23.93},"last":0.81699999999999995},{"interface":"front","average":{"1min":6.6479999999999997,"5min":1.8500000000000001,"15min":1.05},"min":{"1min":0.51600000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":17.010000000000002,"5min":17.010000000000002,"15min":17.010000000000002},"last":0.745}]},{"osd":6,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":7.6139999999999999,"5min":2.0379999999999998,"15min":1.109},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":27.701000000000001,"5min":27.701000000000001,"15min":27.701000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":4.758,"5min":1.5029999999999999,"15min":0.96099999999999997},"min":{"1min":0.62,"5min":0.443,"15min":0.443},"max":{"1min":20.942,"5min":20.942,"15min":20.942},"last":0.80300000000000005}]},{"osd":7,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":5.657,"5min":1.6879999999999999,"15min":1.026},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":21.030999999999999,"5min":21.030999999999999,"15min":21.030999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":7.9189999999999996,"5min":2.125,"15min":1.159},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":20.902999999999999,"5min":20.902999999999999,"15min":20.902999999999999},"last":0.78400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56116,"kb_used_data":16620,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315724,"statfs":{"total":96636764160,"available":96579301376,"internally_reserved":0,"allocated":17018880,"data_stored":16869087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":4.1100000000000003,"5min":1.1180000000000001,"15min":0.61899999999999999},"min":{"1min":0.33900000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":18.98,"5min":18.98,"15min":18.98},"last":0.47899999999999998},{"interface":"front","average":{"1min":4.9240000000000004,"5min":1.302,"15min":0.69799999999999995},"min":{"1min":0.27300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":20.966999999999999,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":3.899,"5min":1.127,"15min":0.66500000000000004},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":20.995999999999999,"5min":20.995999999999999,"15min":20.995999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":3.6629999999999998,"5min":1.0680000000000001,"15min":0.63600000000000001},"min":{"1min":0.34499999999999997,"5min":0.307,"15min":0.307},"max":{"1min":12.052,"5min":12.052,"15min":12.052},"last":0.57299999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.0149999999999997,"5min":1.341,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":19.925999999999998,"5min":19.925999999999998,"15min":19.925999999999998},"last":0.626},{"interface":"front","average":{"1min":4.4059999999999997,"5min":1.2589999999999999,"15min":0.73499999999999999},"min":{"1min":0.373,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":20.916,"5min":20.916,"15min":20.916},"last":0.65800000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.2930000000000001,"5min":1.982,"15min":1.097},"min":{"1min":0.46600000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":19.940999999999999,"5min":19.940999999999999,"15min":19.940999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":8.3059999999999992,"5min":2.1480000000000001,"15min":1.1220000000000001},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":22.038,"5min":22.038,"15min":22.038},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":6.3300000000000001,"5min":1.8140000000000001,"15min":1.0609999999999999},"min":{"1min":0.59499999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":19.98,"5min":19.98,"15min":19.98},"last":0.60599999999999998},{"interface":"front","average":{"1min":7.8689999999999998,"5min":2.0790000000000002,"15min":1.1140000000000001},"min":{"1min":0.53500000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":21.050999999999998,"5min":21.050999999999998,"15min":21.050999999999998},"last":0.97599999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.3419999999999996,"5min":1.9910000000000001,"15min":1.099},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":22.021999999999998,"5min":22.021999999999998,"15min":22.021999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":6.9569999999999999,"5min":1.921,"15min":1.0820000000000001},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.498},"max":{"1min":19.007999999999999,"5min":19.007999999999999,"15min":19.007999999999999},"last":0.76400000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":6.8129999999999997,"5min":1.885,"15min":1.0640000000000001},"min":{"1min":0.49199999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":21.023,"5min":21.023,"15min":21.023},"last":1.0069999999999999},{"interface":"front","average":{"1min":9.3469999999999995,"5min":2.411,"15min":1.2549999999999999},"min":{"1min":0.498,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":28.928000000000001,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.78800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64120,"kb_used_data":37104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94307720,"statfs":{"total":96636764160,"available":96571105280,"internally_reserved":0,"allocated":37994496,"data_stored":37840697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.6289999999999996,"5min":1.266,"15min":0.70599999999999996},"min":{"1min":0.28399999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":23.542000000000002,"5min":23.542000000000002,"15min":23.542000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":4.4550000000000001,"5min":1.2949999999999999,"15min":0.76800000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":20.547000000000001,"5min":20.547000000000001,"15min":20.547000000000001},"last":0.30199999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.3869999999999996,"5min":1.2709999999999999,"15min":0.752},"min":{"1min":0.31900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":18.984999999999999,"5min":18.984999999999999,"15min":18.984999999999999},"last":0.24099999999999999},{"interface":"front","average":{"1min":4.9550000000000001,"5min":1.3380000000000001,"15min":0.73499999999999999},"min":{"1min":0.32300000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":20.052,"5min":20.052,"15min":20.052},"last":0.372}]},{"osd":2,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":5.7050000000000001,"5min":1.5329999999999999,"15min":0.83799999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":20.861000000000001,"5min":20.861000000000001,"15min":20.861000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":5.0060000000000002,"5min":1.405,"15min":0.80500000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":21.984000000000002,"5min":21.984000000000002,"15min":21.984000000000002},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.6619999999999999,"5min":2.1160000000000001,"15min":1.1919999999999999},"min":{"1min":0.40300000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":22.015999999999998,"5min":22.015999999999998,"15min":22.015999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":6.4500000000000002,"5min":1.8380000000000001,"15min":1.0700000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":20.934999999999999,"5min":20.934999999999999,"15min":20.934999999999999},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.859,"5min":1.9039999999999999,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":23.474,"5min":23.474,"15min":23.474},"last":0.50700000000000001},{"interface":"front","average":{"1min":7.242,"5min":2.069,"15min":1.2070000000000001},"min":{"1min":0.441,"5min":0.376,"15min":0.376},"max":{"1min":21.975999999999999,"5min":21.975999999999999,"15min":21.975999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.9580000000000002,"5min":2.1429999999999998,"15min":1.1739999999999999},"min":{"1min":0.45400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":20.898,"5min":20.898,"15min":20.898},"last":0.623},{"interface":"front","average":{"1min":6.3879999999999999,"5min":1.8169999999999999,"15min":1.0549999999999999},"min":{"1min":0.48799999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":23.513000000000002,"5min":23.513000000000002,"15min":23.513000000000002},"last":0.748}]},{"osd":7,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.843,"5min":2.2029999999999998,"15min":1.2629999999999999},"min":{"1min":0.432,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":22.039999999999999,"5min":22.039999999999999,"15min":22.039999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":7.2370000000000001,"5min":2.0449999999999999,"15min":1.179},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.905000000000001,"5min":20.905000000000001,"15min":20.905000000000001},"last":0.57199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53256,"kb_used_data":26240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94318584,"statfs":{"total":96636764160,"available":96582230016,"internally_reserved":0,"allocated":26869760,"data_stored":26701272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.2069999999999999,"5min":1.657,"15min":0.89900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":17.920000000000002,"5min":17.920000000000002,"15min":17.920000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":6.46,"5min":1.7130000000000001,"15min":0.92200000000000004},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":20.904,"5min":20.904,"15min":20.904},"last":0.437}]},{"osd":1,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.3390000000000004,"5min":1.7170000000000001,"15min":0.94699999999999995},"min":{"1min":0.503,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":23.911000000000001,"5min":23.911000000000001,"15min":23.911000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":6.5750000000000002,"5min":1.756,"15min":0.95299999999999996},"min":{"1min":0.375,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":21.952999999999999,"5min":21.952999999999999,"15min":21.952999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.9210000000000003,"5min":1.833,"15min":0.98499999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":21.847999999999999,"5min":21.847999999999999,"15min":21.847999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":8.0950000000000006,"5min":2.0750000000000002,"15min":1.0720000000000001},"min":{"1min":0.504,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":33.182000000000002,"5min":33.182000000000002,"15min":33.182000000000002},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.1100000000000003,"5min":1.8660000000000001,"15min":0.99199999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":17.010999999999999,"5min":17.010999999999999,"15min":17.010999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":5.5220000000000002,"5min":1.575,"15min":0.91700000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":15.022,"5min":15.022,"15min":15.022},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":4.0679999999999996,"5min":1.1919999999999999,"15min":0.71299999999999997},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":5.1680000000000001,"5min":1.4570000000000001,"15min":0.83899999999999997},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":30.946999999999999,"5min":30.946999999999999,"15min":30.946999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":5.859,"5min":1.5800000000000001,"15min":0.86699999999999999},"min":{"1min":0.42399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":15.936999999999999,"5min":15.936999999999999,"15min":15.936999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":5.0999999999999996,"5min":1.464,"15min":0.85799999999999998},"min":{"1min":0.42399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":20.937000000000001,"5min":20.937000000000001,"15min":20.937000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":4.4710000000000001,"5min":1.339,"15min":0.81699999999999995},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":12.914,"5min":12.914,"15min":12.914},"last":0.625},{"interface":"front","average":{"1min":5.6820000000000004,"5min":1.6080000000000001,"15min":0.92900000000000005},"min":{"1min":0.48999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":15.045999999999999,"5min":15.045999999999999,"15min":15.045999999999999},"last":0.65000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52028,"kb_used_data":12532,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319812,"statfs":{"total":96636764160,"available":96583487488,"internally_reserved":0,"allocated":12832768,"data_stored":12675435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.2850000000000001,"5min":1.877,"15min":0.97499999999999998},"min":{"1min":0.34699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":27.048999999999999,"5min":27.048999999999999,"15min":27.048999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":6.5140000000000002,"5min":1.7290000000000001,"15min":0.93100000000000005},"min":{"1min":0.40100000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":20.956,"5min":20.956,"15min":20.956},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.9500000000000002,"5min":1.8089999999999999,"15min":0.95199999999999996},"min":{"1min":0.307,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":20.923999999999999,"5min":20.923999999999999,"15min":20.923999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":6.6459999999999999,"5min":1.782,"15min":0.97199999999999998},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":24.927,"5min":24.927,"15min":24.927},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.6070000000000002,"5min":1.978,"15min":1.04},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":18.602,"5min":18.602,"15min":18.602},"last":0.66500000000000004},{"interface":"front","average":{"1min":6.1580000000000004,"5min":1.722,"15min":0.98199999999999998},"min":{"1min":0.42699999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":15.946999999999999,"5min":15.946999999999999,"15min":15.946999999999999},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.8200000000000003,"5min":2.008,"15min":1.0389999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":17.782,"5min":17.782,"15min":17.782},"last":0.58999999999999997},{"interface":"front","average":{"1min":7.7779999999999996,"5min":2.0699999999999998,"15min":1.119},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":27.077000000000002,"5min":27.077000000000002,"15min":27.077000000000002},"last":0.70499999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.1859999999999999,"5min":1.214,"15min":0.71799999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":19.172999999999998,"5min":19.172999999999998,"15min":19.172999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":5.2329999999999997,"5min":1.4810000000000001,"15min":0.85599999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.693999999999999,"5min":17.693999999999999,"15min":17.693999999999999},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.056,"5min":1.6140000000000001,"15min":0.874},"min":{"1min":0.33700000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":27.103000000000002,"5min":27.103000000000002,"15min":27.103000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":4.9829999999999997,"5min":1.4399999999999999,"15min":0.84999999999999998},"min":{"1min":0.35299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":22.154,"5min":22.154,"15min":22.154},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.0890000000000004,"5min":1.2849999999999999,"15min":0.81799999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":19.253,"5min":19.253,"15min":19.253},"last":0.502},{"interface":"front","average":{"1min":4.0060000000000002,"5min":1.238,"15min":0.77700000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":27.001000000000001,"5min":27.001000000000001,"15min":27.001000000000001},"last":0.48099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":7854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1462272,"data_stored":1443577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1462272,"data_stored":1436465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50331648,"data_stored":50331648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37748736,"data_stored":37748736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:45:51.904 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.905 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.905 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.905 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.906 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.906 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.906 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.907 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.907 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.907 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.908 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.909 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.909 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.909 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.910 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.910 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.910 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.911 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.912 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.912 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.912 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.913 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.913 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.913 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.914 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.914 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.914 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.914 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.915 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.915 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.915 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.916 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.916 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.916 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.917 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.917 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.917 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.917 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.918 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.918 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.918 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.919 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.919 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.919 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.919 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.920 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.920 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.920 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.921 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.921 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.922 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.922 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.922 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.923 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.923 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.923 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.924 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.924 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.924 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.925 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.925 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.925 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.926 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.926 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.926 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.926 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.927 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-08-25T04:43:35.771473+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.927 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.927 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-08-25T04:43:35.771473+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.928 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.928 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.928 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-08-25T04:43:35.771473+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.929 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-08-25T04:43:35.771473+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.929 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.929 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.929 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-08-25T04:43:35.771473+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.930 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.930 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.930 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-25T04:43:35.771473+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.931 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.931 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.931 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-08-25T04:43:35.771473+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.932 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.932 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.932 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-08-25T04:43:35.771473+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.932 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.933 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.933 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-08-25T04:43:35.771473+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.933 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.934 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.934 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.934 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.935 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.935 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.935 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.935 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.936 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.936 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.936 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.937 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.937 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.937 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.937 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.938 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.938 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:45:51.938 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-25T04:46:11.939 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:46:12.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.079+0000 7fc4bf3f0700 1 Processor -- start 2023-08-25T04:46:12.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.079+0000 7fc4bf3f0700 1 -- start start 2023-08-25T04:46:12.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bf3f0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4b80cc830 0x7fc4b80ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bf3f0700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc4b80caf10 0x7fc4b806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bf3f0700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc4b8070eb0 0x7fc4b806d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bf3f0700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b80cbfe0 con 0x7fc4b80caf10 2023-08-25T04:46:12.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bf3f0700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b80cd150 con 0x7fc4b8070eb0 2023-08-25T04:46:12.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bf3f0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80cb3d0 con 0x7fc4b80cc830 2023-08-25T04:46:12.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bc98b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc4b80caf10 0x7fc4b806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bc98b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc4b80caf10 0x7fc4b806ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50562/0 (socket says 172.21.15.16:50562) 2023-08-25T04:46:12.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bc98b700 1 -- 172.21.15.16:0/3330394763 learned_addr learned my addr 172.21.15.16:0/3330394763 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:46:12.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bd98d700 1 --2- 172.21.15.16:0/3330394763 >> v2:172.21.15.117:3300/0 conn(0x7fc4b8070eb0 0x7fc4b806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bd18c700 1 --2- 172.21.15.16:0/3330394763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4b80cc830 0x7fc4b80ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bc98b700 1 -- 172.21.15.16:0/3330394763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4b80cc830 msgr2=0x7fc4b80ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:12.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bc98b700 1 --2- 172.21.15.16:0/3330394763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4b80cc830 0x7fc4b80ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bc98b700 1 -- 172.21.15.16:0/3330394763 >> v2:172.21.15.117:3300/0 conn(0x7fc4b8070eb0 msgr2=0x7fc4b806d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:12.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bc98b700 1 --2- 172.21.15.16:0/3330394763 >> v2:172.21.15.117:3300/0 conn(0x7fc4b8070eb0 0x7fc4b806d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bc98b700 1 -- 172.21.15.16:0/3330394763 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b80cb6b0 con 0x7fc4b80caf10 2023-08-25T04:46:12.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.080+0000 7fc4bd18c700 1 --2- 172.21.15.16:0/3330394763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4b80cc830 0x7fc4b80ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:12.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.081+0000 7fc4bc98b700 1 --2- 172.21.15.16:0/3330394763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4b80caf10 0x7fc4b806ced0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80d0f00 tx=0x7fc4ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb76e35206bfc85 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:12.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.081+0000 7fc4abfff700 1 -- 172.21.15.16:0/3330394763 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00b870 con 0x7fc4b80caf10 2023-08-25T04:46:12.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.081+0000 7fc4abfff700 1 -- 172.21.15.16:0/3330394763 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac00b9d0 con 0x7fc4b80caf10 2023-08-25T04:46:12.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.081+0000 7fc4abfff700 1 -- 172.21.15.16:0/3330394763 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00bd60 con 0x7fc4b80caf10 2023-08-25T04:46:12.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.081+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3330394763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4b80caf10 msgr2=0x7fc4b806ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.081+0000 7fc4bf3f0700 1 --2- 172.21.15.16:0/3330394763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4b80caf10 0x7fc4b806ced0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80d0f00 tx=0x7fc4ac009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.081+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3330394763 shutdown_connections 2023-08-25T04:46:12.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.081+0000 7fc4bf3f0700 1 --2- 172.21.15.16:0/3330394763 >> v2:172.21.15.117:3300/0 conn(0x7fc4b8070eb0 0x7fc4b806d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.081+0000 7fc4bf3f0700 1 --2- 172.21.15.16:0/3330394763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4b80cc830 0x7fc4b80ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.081+0000 7fc4bf3f0700 1 --2- 172.21.15.16:0/3330394763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4b80caf10 0x7fc4b806ced0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.081+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3330394763 >> 172.21.15.16:0/3330394763 conn(0x7fc4b80b1a10 msgr2=0x7fc4b80b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:12.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.082+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3330394763 shutdown_connections 2023-08-25T04:46:12.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.082+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3330394763 wait complete. 2023-08-25T04:46:12.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.083+0000 7fc4bf3f0700 1 Processor -- start 2023-08-25T04:46:12.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.083+0000 7fc4bf3f0700 1 -- start start 2023-08-25T04:46:12.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bf3f0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4b8070eb0 0x7fc4b80c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bf3f0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4b80caf10 0x7fc4b814e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bf3f0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4b80cc830 0x7fc4b814eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bf3f0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80c9870 con 0x7fc4b80cc830 2023-08-25T04:46:12.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bf3f0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80c7870 con 0x7fc4b8070eb0 2023-08-25T04:46:12.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bf3f0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80c7b50 con 0x7fc4b80caf10 2023-08-25T04:46:12.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bd98d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4b80cc830 0x7fc4b814eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bd98d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4b80cc830 0x7fc4b814eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50570/0 (socket says 172.21.15.16:50570) 2023-08-25T04:46:12.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bd98d700 1 -- 172.21.15.16:0/3482376206 learned_addr learned my addr 172.21.15.16:0/3482376206 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:46:12.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bc98b700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4b80caf10 0x7fc4b814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bd18c700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4b8070eb0 0x7fc4b80c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bd98d700 1 -- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4b80caf10 msgr2=0x7fc4b814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bd98d700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4b80caf10 0x7fc4b814e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bd98d700 1 -- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4b8070eb0 msgr2=0x7fc4b80c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bd98d700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4b8070eb0 0x7fc4b80c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bd98d700 1 -- 172.21.15.16:0/3482376206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac009550 con 0x7fc4b80cc830 2023-08-25T04:46:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bd18c700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4b8070eb0 0x7fc4b80c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:12.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bd98d700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4b80cc830 0x7fc4b814eab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0007e60 tx=0x7fc4b000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:12.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4a9ffb700 1 -- 172.21.15.16:0/3482376206 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000ede0 con 0x7fc4b80cc830 2023-08-25T04:46:12.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4a9ffb700 1 -- 172.21.15.16:0/3482376206 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b0014420 con 0x7fc4b80cc830 2023-08-25T04:46:12.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3482376206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b80c9500 con 0x7fc4b80cc830 2023-08-25T04:46:12.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.084+0000 7fc4a9ffb700 1 -- 172.21.15.16:0/3482376206 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00147d0 con 0x7fc4b80cc830 2023-08-25T04:46:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.085+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3482376206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b80c9d00 con 0x7fc4b80cc830 2023-08-25T04:46:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.086+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3482376206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b80c9360 con 0x7fc4b80cc830 2023-08-25T04:46:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.086+0000 7fc4a9ffb700 1 -- 172.21.15.16:0/3482376206 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc4b0014930 con 0x7fc4b80cc830 2023-08-25T04:46:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.086+0000 7fc4a9ffb700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc49c06a0e0 0x7fc49c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.086+0000 7fc4a9ffb700 1 -- 172.21.15.16:0/3482376206 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc4b0088c70 con 0x7fc4b80cc830 2023-08-25T04:46:12.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.087+0000 7fc4bd18c700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc49c06a0e0 0x7fc49c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.087+0000 7fc4bd18c700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc49c06a0e0 0x7fc49c06c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400aa20 tx=0x7fc4b4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:12.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.091+0000 7fc4a9ffb700 1 -- 172.21.15.16:0/3482376206 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc4b80c9360 con 0x7fc4b80cc830 2023-08-25T04:46:12.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.287+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3482376206 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4b80cbc70 con 0x7fc49c06a0e0 2023-08-25T04:46:12.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.296+0000 7fc4a9ffb700 1 -- 172.21.15.16:0/3482376206 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309993 (secure 0 0 0) 0x7fc4b400a6f0 con 0x7fc49c06a0e0 2023-08-25T04:46:12.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:46:12.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.299+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc49c06a0e0 msgr2=0x7fc49c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.300+0000 7fc4bf3f0700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc49c06a0e0 0x7fc49c06c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400aa20 tx=0x7fc4b4008040 comp rx=0 tx=0).stop 2023-08-25T04:46:12.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.300+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3482376206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4b80cc830 msgr2=0x7fc4b814eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.300+0000 7fc4bf3f0700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4b80cc830 0x7fc4b814eab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0007e60 tx=0x7fc4b000e3c0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.300+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3482376206 shutdown_connections 2023-08-25T04:46:12.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.300+0000 7fc4bf3f0700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7fc49c06a0e0 0x7fc49c06c5a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.300+0000 7fc4bf3f0700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4b80cc830 0x7fc4b814eab0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.300+0000 7fc4bf3f0700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4b8070eb0 0x7fc4b80c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.300+0000 7fc4bf3f0700 1 --2- 172.21.15.16:0/3482376206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4b80caf10 0x7fc4b814e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.300+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3482376206 >> 172.21.15.16:0/3482376206 conn(0x7fc4b80b1a10 msgr2=0x7fc4b806ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:12.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.300+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3482376206 shutdown_connections 2023-08-25T04:46:12.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:12.300+0000 7fc4bf3f0700 1 -- 172.21.15.16:0/3482376206 wait complete. 2023-08-25T04:46:12.306 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-08-25T04:46:12.315 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-08-25T04:46:11.412072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102772623,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":129,"num_read_kb":115,"num_write":1146,"num_write_kb":1106025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17556,"ondisk_log_size":17556,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":481204,"kb_used_data":202676,"kb_used_omap":13,"kb_used_meta":278450,"kb_avail":754493516,"statfs":{"total":773094113280,"available":772601360384,"internally_reserved":0,"allocated":207540224,"data_stored":206279253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":285132888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33860,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003025"},"pg_stats":[{"pgid":"4.3f","version":"23'232","reported_seq":257,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.038106+0000","last_change":"2023-08-25T04:46:01.038166+0000","last_active":"2023-08-25T04:46:01.038106+0000","last_peered":"2023-08-25T04:46:01.038106+0000","last_clean":"2023-08-25T04:46:01.038106+0000","last_became_active":"2023-08-25T04:43:42.894831+0000","last_became_peered":"2023-08-25T04:43:42.894831+0000","last_unstale":"2023-08-25T04:46:01.038106+0000","last_undegraded":"2023-08-25T04:46:01.038106+0000","last_fullsized":"2023-08-25T04:46:01.038106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'232","last_scrub_stamp":"2023-08-25T04:46:01.037985+0000","last_deep_scrub":"23'232","last_deep_scrub_stamp":"2023-08-25T04:46:01.037985+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.037985+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:36:57.880910+0000","scrub_duration":0.0016765160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'220","reported_seq":237,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.407589+0000","last_change":"2023-08-25T04:43:42.895503+0000","last_active":"2023-08-25T04:45:49.407589+0000","last_peered":"2023-08-25T04:45:49.407589+0000","last_clean":"2023-08-25T04:45:49.407589+0000","last_became_active":"2023-08-25T04:43:42.895245+0000","last_became_peered":"2023-08-25T04:43:42.895245+0000","last_unstale":"2023-08-25T04:45:49.407589+0000","last_undegraded":"2023-08-25T04:45:49.407589+0000","last_fullsized":"2023-08-25T04:45:49.407589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"23'276","reported_seq":293,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.408261+0000","last_change":"2023-08-25T04:43:42.888920+0000","last_active":"2023-08-25T04:45:49.408261+0000","last_peered":"2023-08-25T04:45:49.408261+0000","last_clean":"2023-08-25T04:45:49.408261+0000","last_became_active":"2023-08-25T04:43:42.888568+0000","last_became_peered":"2023-08-25T04:43:42.888568+0000","last_unstale":"2023-08-25T04:45:49.408261+0000","last_undegraded":"2023-08-25T04:45:49.408261+0000","last_fullsized":"2023-08-25T04:45:49.408261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"23'253","reported_seq":278,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:04.727265+0000","last_change":"2023-08-25T04:46:04.727316+0000","last_active":"2023-08-25T04:46:04.727265+0000","last_peered":"2023-08-25T04:46:04.727265+0000","last_clean":"2023-08-25T04:46:04.727265+0000","last_became_active":"2023-08-25T04:43:42.893534+0000","last_became_peered":"2023-08-25T04:43:42.893534+0000","last_unstale":"2023-08-25T04:46:04.727265+0000","last_undegraded":"2023-08-25T04:46:04.727265+0000","last_fullsized":"2023-08-25T04:46:04.727265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'253","last_scrub_stamp":"2023-08-25T04:46:04.727143+0000","last_deep_scrub":"23'253","last_deep_scrub_stamp":"2023-08-25T04:46:04.727143+0000","last_clean_scrub_stamp":"2023-08-25T04:46:04.727143+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:48:03.426061+0000","scrub_duration":0.0023240380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"23'256","reported_seq":280,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.953900+0000","last_change":"2023-08-25T04:46:03.953954+0000","last_active":"2023-08-25T04:46:03.953900+0000","last_peered":"2023-08-25T04:46:03.953900+0000","last_clean":"2023-08-25T04:46:03.953900+0000","last_became_active":"2023-08-25T04:43:42.901963+0000","last_became_peered":"2023-08-25T04:43:42.901963+0000","last_unstale":"2023-08-25T04:46:03.953900+0000","last_undegraded":"2023-08-25T04:46:03.953900+0000","last_fullsized":"2023-08-25T04:46:03.953900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'256","last_scrub_stamp":"2023-08-25T04:46:03.953767+0000","last_deep_scrub":"23'256","last_deep_scrub_stamp":"2023-08-25T04:46:03.953767+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.953767+0000","objects_scrubbed":1,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:06.097285+0000","scrub_duration":0.0078404019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'278","reported_seq":294,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.104034+0000","last_change":"2023-08-25T04:43:42.888877+0000","last_active":"2023-08-25T04:45:44.104034+0000","last_peered":"2023-08-25T04:45:44.104034+0000","last_clean":"2023-08-25T04:45:44.104034+0000","last_became_active":"2023-08-25T04:43:42.888567+0000","last_became_peered":"2023-08-25T04:43:42.888567+0000","last_unstale":"2023-08-25T04:45:44.104034+0000","last_undegraded":"2023-08-25T04:45:44.104034+0000","last_fullsized":"2023-08-25T04:45:44.104034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"23'293","reported_seq":309,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.949404+0000","last_change":"2023-08-25T04:43:42.902469+0000","last_active":"2023-08-25T04:45:43.949404+0000","last_peered":"2023-08-25T04:45:43.949404+0000","last_clean":"2023-08-25T04:45:43.949404+0000","last_became_active":"2023-08-25T04:43:42.902156+0000","last_became_peered":"2023-08-25T04:43:42.902156+0000","last_unstale":"2023-08-25T04:45:43.949404+0000","last_undegraded":"2023-08-25T04:45:43.949404+0000","last_fullsized":"2023-08-25T04:45:43.949404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"23'270","reported_seq":286,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.074768+0000","last_change":"2023-08-25T04:43:42.895697+0000","last_active":"2023-08-25T04:45:44.074768+0000","last_peered":"2023-08-25T04:45:44.074768+0000","last_clean":"2023-08-25T04:45:44.074768+0000","last_became_active":"2023-08-25T04:43:42.895410+0000","last_became_peered":"2023-08-25T04:43:42.895410+0000","last_unstale":"2023-08-25T04:45:44.074768+0000","last_undegraded":"2023-08-25T04:45:44.074768+0000","last_fullsized":"2023-08-25T04:45:44.074768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"23'248","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:47.861349+0000","last_change":"2023-08-25T04:43:42.897483+0000","last_active":"2023-08-25T04:45:47.861349+0000","last_peered":"2023-08-25T04:45:47.861349+0000","last_clean":"2023-08-25T04:45:47.861349+0000","last_became_active":"2023-08-25T04:43:42.896949+0000","last_became_peered":"2023-08-25T04:43:42.896949+0000","last_unstale":"2023-08-25T04:45:47.861349+0000","last_undegraded":"2023-08-25T04:45:47.861349+0000","last_fullsized":"2023-08-25T04:45:47.861349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'282","reported_seq":299,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:50.463810+0000","last_change":"2023-08-25T04:43:42.895115+0000","last_active":"2023-08-25T04:45:50.463810+0000","last_peered":"2023-08-25T04:45:50.463810+0000","last_clean":"2023-08-25T04:45:50.463810+0000","last_became_active":"2023-08-25T04:43:42.894786+0000","last_became_peered":"2023-08-25T04:43:42.894786+0000","last_unstale":"2023-08-25T04:45:50.463810+0000","last_undegraded":"2023-08-25T04:45:50.463810+0000","last_fullsized":"2023-08-25T04:45:50.463810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"23'244","reported_seq":261,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944607+0000","last_change":"2023-08-25T04:43:42.892793+0000","last_active":"2023-08-25T04:45:49.944607+0000","last_peered":"2023-08-25T04:45:49.944607+0000","last_clean":"2023-08-25T04:45:49.944607+0000","last_became_active":"2023-08-25T04:43:42.892558+0000","last_became_peered":"2023-08-25T04:43:42.892558+0000","last_unstale":"2023-08-25T04:45:49.944607+0000","last_undegraded":"2023-08-25T04:45:49.944607+0000","last_fullsized":"2023-08-25T04:45:49.944607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"23'260","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.103144+0000","last_change":"2023-08-25T04:45:57.103144+0000","last_active":"2023-08-25T04:45:57.103144+0000","last_peered":"2023-08-25T04:45:57.103144+0000","last_clean":"2023-08-25T04:45:57.103144+0000","last_became_active":"2023-08-25T04:43:42.891782+0000","last_became_peered":"2023-08-25T04:43:42.891782+0000","last_unstale":"2023-08-25T04:45:57.103144+0000","last_undegraded":"2023-08-25T04:45:57.103144+0000","last_fullsized":"2023-08-25T04:45:57.103144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'260","last_scrub_stamp":"2023-08-25T04:45:57.102967+0000","last_deep_scrub":"23'260","last_deep_scrub_stamp":"2023-08-25T04:45:57.102967+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.102967+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:11:20.262318+0000","scrub_duration":0.0024717099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'253","reported_seq":278,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.229483+0000","last_change":"2023-08-25T04:45:51.229483+0000","last_active":"2023-08-25T04:45:51.229483+0000","last_peered":"2023-08-25T04:45:51.229483+0000","last_clean":"2023-08-25T04:45:51.229483+0000","last_became_active":"2023-08-25T04:43:42.896334+0000","last_became_peered":"2023-08-25T04:43:42.896334+0000","last_unstale":"2023-08-25T04:45:51.229483+0000","last_undegraded":"2023-08-25T04:45:51.229483+0000","last_fullsized":"2023-08-25T04:45:51.229483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'253","last_scrub_stamp":"2023-08-25T04:45:51.229299+0000","last_deep_scrub":"23'253","last_deep_scrub_stamp":"2023-08-25T04:45:51.229299+0000","last_clean_scrub_stamp":"2023-08-25T04:45:51.229299+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:07:04.578619+0000","scrub_duration":0.001452009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'273","reported_seq":298,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:05.288862+0000","last_change":"2023-08-25T04:46:05.288910+0000","last_active":"2023-08-25T04:46:05.288862+0000","last_peered":"2023-08-25T04:46:05.288862+0000","last_clean":"2023-08-25T04:46:05.288862+0000","last_became_active":"2023-08-25T04:43:42.894472+0000","last_became_peered":"2023-08-25T04:43:42.894472+0000","last_unstale":"2023-08-25T04:46:05.288862+0000","last_undegraded":"2023-08-25T04:46:05.288862+0000","last_fullsized":"2023-08-25T04:46:05.288862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'273","last_scrub_stamp":"2023-08-25T04:46:05.288764+0000","last_deep_scrub":"23'273","last_deep_scrub_stamp":"2023-08-25T04:46:05.288764+0000","last_clean_scrub_stamp":"2023-08-25T04:46:05.288764+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:07.432282+0000","scrub_duration":0.0024051290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"23'267","reported_seq":284,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.515444+0000","last_change":"2023-08-25T04:43:42.902458+0000","last_active":"2023-08-25T04:45:51.515444+0000","last_peered":"2023-08-25T04:45:51.515444+0000","last_clean":"2023-08-25T04:45:51.515444+0000","last_became_active":"2023-08-25T04:43:42.902184+0000","last_became_peered":"2023-08-25T04:43:42.902184+0000","last_unstale":"2023-08-25T04:45:51.515444+0000","last_undegraded":"2023-08-25T04:45:51.515444+0000","last_fullsized":"2023-08-25T04:45:51.515444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"23'258","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:08.143464+0000","last_change":"2023-08-25T04:46:08.143515+0000","last_active":"2023-08-25T04:46:08.143464+0000","last_peered":"2023-08-25T04:46:08.143464+0000","last_clean":"2023-08-25T04:46:08.143464+0000","last_became_active":"2023-08-25T04:43:42.888730+0000","last_became_peered":"2023-08-25T04:43:42.888730+0000","last_unstale":"2023-08-25T04:46:08.143464+0000","last_undegraded":"2023-08-25T04:46:08.143464+0000","last_fullsized":"2023-08-25T04:46:08.143464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'258","last_scrub_stamp":"2023-08-25T04:46:08.143341+0000","last_deep_scrub":"23'258","last_deep_scrub_stamp":"2023-08-25T04:46:08.143341+0000","last_clean_scrub_stamp":"2023-08-25T04:46:08.143341+0000","objects_scrubbed":1,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:07.464282+0000","scrub_duration":0.0087248789999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"23'266","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:47.861319+0000","last_change":"2023-08-25T04:43:42.898466+0000","last_active":"2023-08-25T04:45:47.861319+0000","last_peered":"2023-08-25T04:45:47.861319+0000","last_clean":"2023-08-25T04:45:47.861319+0000","last_became_active":"2023-08-25T04:43:42.898103+0000","last_became_peered":"2023-08-25T04:43:42.898103+0000","last_unstale":"2023-08-25T04:45:47.861319+0000","last_undegraded":"2023-08-25T04:45:47.861319+0000","last_fullsized":"2023-08-25T04:45:47.861319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'250","reported_seq":267,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944526+0000","last_change":"2023-08-25T04:43:42.892153+0000","last_active":"2023-08-25T04:45:49.944526+0000","last_peered":"2023-08-25T04:45:49.944526+0000","last_clean":"2023-08-25T04:45:49.944526+0000","last_became_active":"2023-08-25T04:43:42.891874+0000","last_became_peered":"2023-08-25T04:43:42.891874+0000","last_unstale":"2023-08-25T04:45:49.944526+0000","last_undegraded":"2023-08-25T04:45:49.944526+0000","last_fullsized":"2023-08-25T04:45:49.944526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"23'237","reported_seq":262,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.059523+0000","last_change":"2023-08-25T04:46:00.059576+0000","last_active":"2023-08-25T04:46:00.059523+0000","last_peered":"2023-08-25T04:46:00.059523+0000","last_clean":"2023-08-25T04:46:00.059523+0000","last_became_active":"2023-08-25T04:43:42.895114+0000","last_became_peered":"2023-08-25T04:43:42.895114+0000","last_unstale":"2023-08-25T04:46:00.059523+0000","last_undegraded":"2023-08-25T04:46:00.059523+0000","last_fullsized":"2023-08-25T04:46:00.059523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'237","last_scrub_stamp":"2023-08-25T04:46:00.059425+0000","last_deep_scrub":"23'237","last_deep_scrub_stamp":"2023-08-25T04:46:00.059425+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.059425+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:47:08.428439+0000","scrub_duration":0.0021392239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:02.208337+0000","last_change":"2023-08-25T04:46:02.208395+0000","last_active":"2023-08-25T04:46:02.208337+0000","last_peered":"2023-08-25T04:46:02.208337+0000","last_clean":"2023-08-25T04:46:02.208337+0000","last_became_active":"2023-08-25T04:43:42.895893+0000","last_became_peered":"2023-08-25T04:43:42.895893+0000","last_unstale":"2023-08-25T04:46:02.208337+0000","last_undegraded":"2023-08-25T04:46:02.208337+0000","last_fullsized":"2023-08-25T04:46:02.208337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:02.208224+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:02.208224+0000","last_clean_scrub_stamp":"2023-08-25T04:46:02.208224+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:28:50.652408+0000","scrub_duration":0.001791534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"23'266","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.515456+0000","last_change":"2023-08-25T04:43:42.905467+0000","last_active":"2023-08-25T04:45:51.515456+0000","last_peered":"2023-08-25T04:45:51.515456+0000","last_clean":"2023-08-25T04:45:51.515456+0000","last_became_active":"2023-08-25T04:43:42.905157+0000","last_became_peered":"2023-08-25T04:43:42.905157+0000","last_unstale":"2023-08-25T04:45:51.515456+0000","last_undegraded":"2023-08-25T04:45:51.515456+0000","last_fullsized":"2023-08-25T04:45:51.515456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"23'278","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.991834+0000","last_change":"2023-08-25T04:46:00.991883+0000","last_active":"2023-08-25T04:46:00.991834+0000","last_peered":"2023-08-25T04:46:00.991834+0000","last_clean":"2023-08-25T04:46:00.991834+0000","last_became_active":"2023-08-25T04:43:42.879881+0000","last_became_peered":"2023-08-25T04:43:42.879881+0000","last_unstale":"2023-08-25T04:46:00.991834+0000","last_undegraded":"2023-08-25T04:46:00.991834+0000","last_fullsized":"2023-08-25T04:46:00.991834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'278","last_scrub_stamp":"2023-08-25T04:46:00.991708+0000","last_deep_scrub":"23'278","last_deep_scrub_stamp":"2023-08-25T04:46:00.991708+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.991708+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:59:59.525971+0000","scrub_duration":0.001818802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'246","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.998363+0000","last_change":"2023-08-25T04:46:03.998431+0000","last_active":"2023-08-25T04:46:03.998363+0000","last_peered":"2023-08-25T04:46:03.998363+0000","last_clean":"2023-08-25T04:46:03.998363+0000","last_became_active":"2023-08-25T04:44:30.818308+0000","last_became_peered":"2023-08-25T04:44:30.818308+0000","last_unstale":"2023-08-25T04:46:03.998363+0000","last_undegraded":"2023-08-25T04:46:03.998363+0000","last_fullsized":"2023-08-25T04:46:03.998363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'246","last_scrub_stamp":"2023-08-25T04:46:03.998242+0000","last_deep_scrub":"23'246","last_deep_scrub_stamp":"2023-08-25T04:46:03.998242+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.998242+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:16:04.323429+0000","scrub_duration":0.001734148,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"23'239","reported_seq":256,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.515411+0000","last_change":"2023-08-25T04:43:42.897136+0000","last_active":"2023-08-25T04:45:51.515411+0000","last_peered":"2023-08-25T04:45:51.515411+0000","last_clean":"2023-08-25T04:45:51.515411+0000","last_became_active":"2023-08-25T04:43:42.896869+0000","last_became_peered":"2023-08-25T04:43:42.896869+0000","last_unstale":"2023-08-25T04:45:51.515411+0000","last_undegraded":"2023-08-25T04:45:51.515411+0000","last_fullsized":"2023-08-25T04:45:51.515411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"23'255","reported_seq":272,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.380401+0000","last_change":"2023-08-25T04:43:42.893954+0000","last_active":"2023-08-25T04:45:48.380401+0000","last_peered":"2023-08-25T04:45:48.380401+0000","last_clean":"2023-08-25T04:45:48.380401+0000","last_became_active":"2023-08-25T04:43:42.893673+0000","last_became_peered":"2023-08-25T04:43:42.893673+0000","last_unstale":"2023-08-25T04:45:48.380401+0000","last_undegraded":"2023-08-25T04:45:48.380401+0000","last_fullsized":"2023-08-25T04:45:48.380401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'273","reported_seq":290,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.380352+0000","last_change":"2023-08-25T04:43:42.888116+0000","last_active":"2023-08-25T04:45:48.380352+0000","last_peered":"2023-08-25T04:45:48.380352+0000","last_clean":"2023-08-25T04:45:48.380352+0000","last_became_active":"2023-08-25T04:43:42.887831+0000","last_became_peered":"2023-08-25T04:43:42.887831+0000","last_unstale":"2023-08-25T04:45:48.380352+0000","last_undegraded":"2023-08-25T04:45:48.380352+0000","last_fullsized":"2023-08-25T04:45:48.380352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'237","reported_seq":262,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:02.351329+0000","last_change":"2023-08-25T04:46:02.351387+0000","last_active":"2023-08-25T04:46:02.351329+0000","last_peered":"2023-08-25T04:46:02.351329+0000","last_clean":"2023-08-25T04:46:02.351329+0000","last_became_active":"2023-08-25T04:43:42.894302+0000","last_became_peered":"2023-08-25T04:43:42.894302+0000","last_unstale":"2023-08-25T04:46:02.351329+0000","last_undegraded":"2023-08-25T04:46:02.351329+0000","last_fullsized":"2023-08-25T04:46:02.351329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'237","last_scrub_stamp":"2023-08-25T04:46:02.351216+0000","last_deep_scrub":"23'237","last_deep_scrub_stamp":"2023-08-25T04:46:02.351216+0000","last_clean_scrub_stamp":"2023-08-25T04:46:02.351216+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:00.885478+0000","scrub_duration":0.0016876969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:44:31.282364+0000","last_change":"2023-08-25T04:43:41.888584+0000","last_active":"2023-08-25T04:44:31.282364+0000","last_peered":"2023-08-25T04:44:31.282364+0000","last_clean":"2023-08-25T04:44:31.282364+0000","last_became_active":"2023-08-25T04:43:41.888339+0000","last_became_peered":"2023-08-25T04:43:41.888339+0000","last_unstale":"2023-08-25T04:44:31.282364+0000","last_undegraded":"2023-08-25T04:44:31.282364+0000","last_fullsized":"2023-08-25T04:44:31.282364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'271","reported_seq":287,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.090658+0000","last_change":"2023-08-25T04:43:42.897739+0000","last_active":"2023-08-25T04:45:44.090658+0000","last_peered":"2023-08-25T04:45:44.090658+0000","last_clean":"2023-08-25T04:45:44.090658+0000","last_became_active":"2023-08-25T04:43:42.897425+0000","last_became_peered":"2023-08-25T04:43:42.897425+0000","last_unstale":"2023-08-25T04:45:44.090658+0000","last_undegraded":"2023-08-25T04:45:44.090658+0000","last_fullsized":"2023-08-25T04:45:44.090658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:08.410533+0000","last_change":"2023-08-25T04:46:08.410533+0000","last_active":"2023-08-25T04:46:08.410533+0000","last_peered":"2023-08-25T04:46:08.410533+0000","last_clean":"2023-08-25T04:46:08.410533+0000","last_became_active":"2023-08-25T04:43:41.885184+0000","last_became_peered":"2023-08-25T04:43:41.885184+0000","last_unstale":"2023-08-25T04:46:08.410533+0000","last_undegraded":"2023-08-25T04:46:08.410533+0000","last_fullsized":"2023-08-25T04:46:08.410533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:08.410308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:08.410308+0000","last_clean_scrub_stamp":"2023-08-25T04:46:08.410308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:17.174121+0000","scrub_duration":0.001705238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'291","reported_seq":308,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.397689+0000","last_change":"2023-08-25T04:43:42.890854+0000","last_active":"2023-08-25T04:45:44.397689+0000","last_peered":"2023-08-25T04:45:44.397689+0000","last_clean":"2023-08-25T04:45:44.397689+0000","last_became_active":"2023-08-25T04:43:42.890575+0000","last_became_peered":"2023-08-25T04:43:42.890575+0000","last_unstale":"2023-08-25T04:45:44.397689+0000","last_undegraded":"2023-08-25T04:45:44.397689+0000","last_fullsized":"2023-08-25T04:45:44.397689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.805506+0000","last_change":"2023-08-25T04:45:52.805506+0000","last_active":"2023-08-25T04:45:52.805506+0000","last_peered":"2023-08-25T04:45:52.805506+0000","last_clean":"2023-08-25T04:45:52.805506+0000","last_became_active":"2023-08-25T04:43:41.885299+0000","last_became_peered":"2023-08-25T04:43:41.885299+0000","last_unstale":"2023-08-25T04:45:52.805506+0000","last_undegraded":"2023-08-25T04:45:52.805506+0000","last_fullsized":"2023-08-25T04:45:52.805506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:45:52.805353+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:45:52.805353+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.805353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:28.630344+0000","scrub_duration":0.0017761649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'269","reported_seq":294,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.678926+0000","last_change":"2023-08-25T04:46:03.678987+0000","last_active":"2023-08-25T04:46:03.678926+0000","last_peered":"2023-08-25T04:46:03.678926+0000","last_clean":"2023-08-25T04:46:03.678926+0000","last_became_active":"2023-08-25T04:43:42.898874+0000","last_became_peered":"2023-08-25T04:43:42.898874+0000","last_unstale":"2023-08-25T04:46:03.678926+0000","last_undegraded":"2023-08-25T04:46:03.678926+0000","last_fullsized":"2023-08-25T04:46:03.678926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'269","last_scrub_stamp":"2023-08-25T04:46:03.678818+0000","last_deep_scrub":"23'269","last_deep_scrub_stamp":"2023-08-25T04:46:03.678818+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.678818+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:44.606031+0000","scrub_duration":0.0016713940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.002914+0000","last_change":"2023-08-25T04:46:00.002914+0000","last_active":"2023-08-25T04:46:00.002914+0000","last_peered":"2023-08-25T04:46:00.002914+0000","last_clean":"2023-08-25T04:46:00.002914+0000","last_became_active":"2023-08-25T04:43:41.882381+0000","last_became_peered":"2023-08-25T04:43:41.882381+0000","last_unstale":"2023-08-25T04:46:00.002914+0000","last_undegraded":"2023-08-25T04:46:00.002914+0000","last_fullsized":"2023-08-25T04:46:00.002914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:46:00.002750+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:46:00.002750+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.002750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:35.827741+0000","scrub_duration":0.0019692830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'261","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.423235+0000","last_change":"2023-08-25T04:44:30.481564+0000","last_active":"2023-08-25T04:45:49.423235+0000","last_peered":"2023-08-25T04:45:49.423235+0000","last_clean":"2023-08-25T04:45:49.423235+0000","last_became_active":"2023-08-25T04:44:30.481273+0000","last_became_peered":"2023-08-25T04:44:30.481273+0000","last_unstale":"2023-08-25T04:45:49.423235+0000","last_undegraded":"2023-08-25T04:45:49.423235+0000","last_fullsized":"2023-08-25T04:45:49.423235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.353165+0000","last_change":"2023-08-25T04:46:01.353165+0000","last_active":"2023-08-25T04:46:01.353165+0000","last_peered":"2023-08-25T04:46:01.353165+0000","last_clean":"2023-08-25T04:46:01.353165+0000","last_became_active":"2023-08-25T04:43:41.882055+0000","last_became_peered":"2023-08-25T04:43:41.882055+0000","last_unstale":"2023-08-25T04:46:01.353165+0000","last_undegraded":"2023-08-25T04:46:01.353165+0000","last_fullsized":"2023-08-25T04:46:01.353165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:01.352985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:01.352985+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.352985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:37.177976+0000","scrub_duration":0.001474939,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"23'268","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.423204+0000","last_change":"2023-08-25T04:43:42.891741+0000","last_active":"2023-08-25T04:45:49.423204+0000","last_peered":"2023-08-25T04:45:49.423204+0000","last_clean":"2023-08-25T04:45:49.423204+0000","last_became_active":"2023-08-25T04:43:42.890100+0000","last_became_peered":"2023-08-25T04:43:42.890100+0000","last_unstale":"2023-08-25T04:45:49.423204+0000","last_undegraded":"2023-08-25T04:45:49.423204+0000","last_fullsized":"2023-08-25T04:45:49.423204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'12","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.515411+0000","last_change":"2023-08-25T04:43:41.887924+0000","last_active":"2023-08-25T04:45:51.515411+0000","last_peered":"2023-08-25T04:45:51.515411+0000","last_clean":"2023-08-25T04:45:51.515411+0000","last_became_active":"2023-08-25T04:43:41.887622+0000","last_became_peered":"2023-08-25T04:43:41.887622+0000","last_unstale":"2023-08-25T04:45:51.515411+0000","last_undegraded":"2023-08-25T04:45:51.515411+0000","last_fullsized":"2023-08-25T04:45:51.515411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"23'273","reported_seq":290,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.380301+0000","last_change":"2023-08-25T04:43:42.891006+0000","last_active":"2023-08-25T04:45:48.380301+0000","last_peered":"2023-08-25T04:45:48.380301+0000","last_clean":"2023-08-25T04:45:48.380301+0000","last_became_active":"2023-08-25T04:43:42.890648+0000","last_became_peered":"2023-08-25T04:43:42.890648+0000","last_unstale":"2023-08-25T04:45:48.380301+0000","last_undegraded":"2023-08-25T04:45:48.380301+0000","last_fullsized":"2023-08-25T04:45:48.380301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'386","reported_seq":405,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:04.410159+0000","last_change":"2023-08-25T04:43:41.887033+0000","last_active":"2023-08-25T04:46:04.410159+0000","last_peered":"2023-08-25T04:46:04.410159+0000","last_clean":"2023-08-25T04:46:04.410159+0000","last_became_active":"2023-08-25T04:43:41.886491+0000","last_became_peered":"2023-08-25T04:43:41.886491+0000","last_unstale":"2023-08-25T04:46:04.410159+0000","last_undegraded":"2023-08-25T04:46:04.410159+0000","last_fullsized":"2023-08-25T04:46:04.410159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1510889,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":385,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"23'297","reported_seq":314,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944486+0000","last_change":"2023-08-25T04:43:42.893709+0000","last_active":"2023-08-25T04:45:49.944486+0000","last_peered":"2023-08-25T04:45:49.944486+0000","last_clean":"2023-08-25T04:45:49.944486+0000","last_became_active":"2023-08-25T04:43:42.893525+0000","last_became_peered":"2023-08-25T04:43:42.893525+0000","last_unstale":"2023-08-25T04:45:49.944486+0000","last_undegraded":"2023-08-25T04:45:49.944486+0000","last_fullsized":"2023-08-25T04:45:49.944486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.515397+0000","last_change":"2023-08-25T04:43:41.890946+0000","last_active":"2023-08-25T04:45:51.515397+0000","last_peered":"2023-08-25T04:45:51.515397+0000","last_clean":"2023-08-25T04:45:51.515397+0000","last_became_active":"2023-08-25T04:43:41.890673+0000","last_became_peered":"2023-08-25T04:43:41.890673+0000","last_unstale":"2023-08-25T04:45:51.515397+0000","last_undegraded":"2023-08-25T04:45:51.515397+0000","last_fullsized":"2023-08-25T04:45:51.515397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"23'269","reported_seq":286,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.423236+0000","last_change":"2023-08-25T04:43:42.897809+0000","last_active":"2023-08-25T04:45:49.423236+0000","last_peered":"2023-08-25T04:45:49.423236+0000","last_clean":"2023-08-25T04:45:49.423236+0000","last_became_active":"2023-08-25T04:43:42.897204+0000","last_became_peered":"2023-08-25T04:43:42.897204+0000","last_unstale":"2023-08-25T04:45:49.423236+0000","last_undegraded":"2023-08-25T04:45:49.423236+0000","last_fullsized":"2023-08-25T04:45:49.423236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.983964+0000","last_change":"2023-08-25T04:45:52.983964+0000","last_active":"2023-08-25T04:45:52.983964+0000","last_peered":"2023-08-25T04:45:52.983964+0000","last_clean":"2023-08-25T04:45:52.983964+0000","last_became_active":"2023-08-25T04:43:41.881067+0000","last_became_peered":"2023-08-25T04:43:41.881067+0000","last_unstale":"2023-08-25T04:45:52.983964+0000","last_undegraded":"2023-08-25T04:45:52.983964+0000","last_fullsized":"2023-08-25T04:45:52.983964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:52.983794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:52.983794+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.983794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:28:30.719694+0000","scrub_duration":0.0024229049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'253","reported_seq":270,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:50.463788+0000","last_change":"2023-08-25T04:43:42.895088+0000","last_active":"2023-08-25T04:45:50.463788+0000","last_peered":"2023-08-25T04:45:50.463788+0000","last_clean":"2023-08-25T04:45:50.463788+0000","last_became_active":"2023-08-25T04:43:42.894807+0000","last_became_peered":"2023-08-25T04:43:42.894807+0000","last_unstale":"2023-08-25T04:45:50.463788+0000","last_undegraded":"2023-08-25T04:45:50.463788+0000","last_fullsized":"2023-08-25T04:45:50.463788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"23'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.515441+0000","last_change":"2023-08-25T04:43:41.890995+0000","last_active":"2023-08-25T04:45:51.515441+0000","last_peered":"2023-08-25T04:45:51.515441+0000","last_clean":"2023-08-25T04:45:51.515441+0000","last_became_active":"2023-08-25T04:43:41.890706+0000","last_became_peered":"2023-08-25T04:43:41.890706+0000","last_unstale":"2023-08-25T04:45:51.515441+0000","last_undegraded":"2023-08-25T04:45:51.515441+0000","last_fullsized":"2023-08-25T04:45:51.515441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"23'288","reported_seq":305,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:47.861270+0000","last_change":"2023-08-25T04:43:42.897775+0000","last_active":"2023-08-25T04:45:47.861270+0000","last_peered":"2023-08-25T04:45:47.861270+0000","last_clean":"2023-08-25T04:45:47.861270+0000","last_became_active":"2023-08-25T04:43:42.897476+0000","last_became_peered":"2023-08-25T04:43:42.897476+0000","last_unstale":"2023-08-25T04:45:47.861270+0000","last_undegraded":"2023-08-25T04:45:47.861270+0000","last_fullsized":"2023-08-25T04:45:47.861270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'12","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:58.712516+0000","last_change":"2023-08-25T04:45:58.712516+0000","last_active":"2023-08-25T04:45:58.712516+0000","last_peered":"2023-08-25T04:45:58.712516+0000","last_clean":"2023-08-25T04:45:58.712516+0000","last_became_active":"2023-08-25T04:43:41.892517+0000","last_became_peered":"2023-08-25T04:43:41.892517+0000","last_unstale":"2023-08-25T04:45:58.712516+0000","last_undegraded":"2023-08-25T04:45:58.712516+0000","last_fullsized":"2023-08-25T04:45:58.712516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2023-08-25T04:45:58.712345+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2023-08-25T04:45:58.712345+0000","last_clean_scrub_stamp":"2023-08-25T04:45:58.712345+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:37:12.386852+0000","scrub_duration":0.0051496449999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"23'268","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.423312+0000","last_change":"2023-08-25T04:43:42.905276+0000","last_active":"2023-08-25T04:45:49.423312+0000","last_peered":"2023-08-25T04:45:49.423312+0000","last_clean":"2023-08-25T04:45:49.423312+0000","last_became_active":"2023-08-25T04:43:42.904736+0000","last_became_peered":"2023-08-25T04:43:42.904736+0000","last_unstale":"2023-08-25T04:45:49.423312+0000","last_undegraded":"2023-08-25T04:45:49.423312+0000","last_fullsized":"2023-08-25T04:45:49.423312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.515395+0000","last_change":"2023-08-25T04:43:41.891246+0000","last_active":"2023-08-25T04:45:51.515395+0000","last_peered":"2023-08-25T04:45:51.515395+0000","last_clean":"2023-08-25T04:45:51.515395+0000","last_became_active":"2023-08-25T04:43:41.890942+0000","last_became_peered":"2023-08-25T04:43:41.890942+0000","last_unstale":"2023-08-25T04:45:51.515395+0000","last_undegraded":"2023-08-25T04:45:51.515395+0000","last_fullsized":"2023-08-25T04:45:51.515395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"23'238","reported_seq":255,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:50.463799+0000","last_change":"2023-08-25T04:43:42.895071+0000","last_active":"2023-08-25T04:45:50.463799+0000","last_peered":"2023-08-25T04:45:50.463799+0000","last_clean":"2023-08-25T04:45:50.463799+0000","last_became_active":"2023-08-25T04:43:42.894285+0000","last_became_peered":"2023-08-25T04:43:42.894285+0000","last_unstale":"2023-08-25T04:45:50.463799+0000","last_undegraded":"2023-08-25T04:45:50.463799+0000","last_fullsized":"2023-08-25T04:45:50.463799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.515442+0000","last_change":"2023-08-25T04:43:41.891175+0000","last_active":"2023-08-25T04:45:51.515442+0000","last_peered":"2023-08-25T04:45:51.515442+0000","last_clean":"2023-08-25T04:45:51.515442+0000","last_became_active":"2023-08-25T04:43:41.890883+0000","last_became_peered":"2023-08-25T04:43:41.890883+0000","last_unstale":"2023-08-25T04:45:51.515442+0000","last_undegraded":"2023-08-25T04:45:51.515442+0000","last_fullsized":"2023-08-25T04:45:51.515442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"23'265","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944660+0000","last_change":"2023-08-25T04:43:42.891686+0000","last_active":"2023-08-25T04:45:49.944660+0000","last_peered":"2023-08-25T04:45:49.944660+0000","last_clean":"2023-08-25T04:45:49.944660+0000","last_became_active":"2023-08-25T04:43:42.891443+0000","last_became_peered":"2023-08-25T04:43:42.891443+0000","last_unstale":"2023-08-25T04:45:49.944660+0000","last_undegraded":"2023-08-25T04:45:49.944660+0000","last_fullsized":"2023-08-25T04:45:49.944660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:02.258330+0000","last_change":"2023-08-25T04:46:02.258387+0000","last_active":"2023-08-25T04:46:02.258330+0000","last_peered":"2023-08-25T04:46:02.258330+0000","last_clean":"2023-08-25T04:46:02.258330+0000","last_became_active":"2023-08-25T04:43:41.888447+0000","last_became_peered":"2023-08-25T04:43:41.888447+0000","last_unstale":"2023-08-25T04:46:02.258330+0000","last_undegraded":"2023-08-25T04:46:02.258330+0000","last_fullsized":"2023-08-25T04:46:02.258330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-08-25T04:46:02.258220+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-08-25T04:46:02.258220+0000","last_clean_scrub_stamp":"2023-08-25T04:46:02.258220+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:50.337360+0000","scrub_duration":0.0030581060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"23'270","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.667962+0000","last_change":"2023-08-25T04:46:00.668030+0000","last_active":"2023-08-25T04:46:00.667962+0000","last_peered":"2023-08-25T04:46:00.667962+0000","last_clean":"2023-08-25T04:46:00.667962+0000","last_became_active":"2023-08-25T04:43:42.892191+0000","last_became_peered":"2023-08-25T04:43:42.892191+0000","last_unstale":"2023-08-25T04:46:00.667962+0000","last_undegraded":"2023-08-25T04:46:00.667962+0000","last_fullsized":"2023-08-25T04:46:00.667962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'270","last_scrub_stamp":"2023-08-25T04:46:00.667852+0000","last_deep_scrub":"23'270","last_deep_scrub_stamp":"2023-08-25T04:46:00.667852+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.667852+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:25:37.904637+0000","scrub_duration":0.002178714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:54.495493+0000","last_change":"2023-08-25T04:45:54.495493+0000","last_active":"2023-08-25T04:45:54.495493+0000","last_peered":"2023-08-25T04:45:54.495493+0000","last_clean":"2023-08-25T04:45:54.495493+0000","last_became_active":"2023-08-25T04:43:41.884098+0000","last_became_peered":"2023-08-25T04:43:41.884098+0000","last_unstale":"2023-08-25T04:45:54.495493+0000","last_undegraded":"2023-08-25T04:45:54.495493+0000","last_fullsized":"2023-08-25T04:45:54.495493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:45:54.495284+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:45:54.495284+0000","last_clean_scrub_stamp":"2023-08-25T04:45:54.495284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:35.422497+0000","scrub_duration":0.0022346089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"23'269","reported_seq":286,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:47.861261+0000","last_change":"2023-08-25T04:43:42.881050+0000","last_active":"2023-08-25T04:45:47.861261+0000","last_peered":"2023-08-25T04:45:47.861261+0000","last_clean":"2023-08-25T04:45:47.861261+0000","last_became_active":"2023-08-25T04:43:42.880104+0000","last_became_peered":"2023-08-25T04:43:42.880104+0000","last_unstale":"2023-08-25T04:45:47.861261+0000","last_undegraded":"2023-08-25T04:45:47.861261+0000","last_fullsized":"2023-08-25T04:45:47.861261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'5","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.831129+0000","last_change":"2023-08-25T04:45:57.831129+0000","last_active":"2023-08-25T04:45:57.831129+0000","last_peered":"2023-08-25T04:45:57.831129+0000","last_clean":"2023-08-25T04:45:57.831129+0000","last_became_active":"2023-08-25T04:43:41.885433+0000","last_became_peered":"2023-08-25T04:43:41.885433+0000","last_unstale":"2023-08-25T04:45:57.831129+0000","last_undegraded":"2023-08-25T04:45:57.831129+0000","last_fullsized":"2023-08-25T04:45:57.831129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2023-08-25T04:45:57.830944+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2023-08-25T04:45:57.830944+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.830944+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:45.910084+0000","scrub_duration":0.0028335420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'243","reported_seq":260,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944457+0000","last_change":"2023-08-25T04:43:42.896701+0000","last_active":"2023-08-25T04:45:49.944457+0000","last_peered":"2023-08-25T04:45:49.944457+0000","last_clean":"2023-08-25T04:45:49.944457+0000","last_became_active":"2023-08-25T04:43:42.896440+0000","last_became_peered":"2023-08-25T04:43:42.896440+0000","last_unstale":"2023-08-25T04:45:49.944457+0000","last_undegraded":"2023-08-25T04:45:49.944457+0000","last_fullsized":"2023-08-25T04:45:49.944457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.718106+0000","last_change":"2023-08-25T04:45:57.718160+0000","last_active":"2023-08-25T04:45:57.718106+0000","last_peered":"2023-08-25T04:45:57.718106+0000","last_clean":"2023-08-25T04:45:57.718106+0000","last_became_active":"2023-08-25T04:43:41.890827+0000","last_became_peered":"2023-08-25T04:43:41.890827+0000","last_unstale":"2023-08-25T04:45:57.718106+0000","last_undegraded":"2023-08-25T04:45:57.718106+0000","last_fullsized":"2023-08-25T04:45:57.718106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:45:57.717976+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:45:57.717976+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.717976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:15:58.043163+0000","scrub_duration":0.0018100639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"23'288","reported_seq":305,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944535+0000","last_change":"2023-08-25T04:43:42.897377+0000","last_active":"2023-08-25T04:45:49.944535+0000","last_peered":"2023-08-25T04:45:49.944535+0000","last_clean":"2023-08-25T04:45:49.944535+0000","last_became_active":"2023-08-25T04:43:42.897108+0000","last_became_peered":"2023-08-25T04:43:42.897108+0000","last_unstale":"2023-08-25T04:45:49.944535+0000","last_undegraded":"2023-08-25T04:45:49.944535+0000","last_fullsized":"2023-08-25T04:45:49.944535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944404+0000","last_change":"2023-08-25T04:43:41.888568+0000","last_active":"2023-08-25T04:45:49.944404+0000","last_peered":"2023-08-25T04:45:49.944404+0000","last_clean":"2023-08-25T04:45:49.944404+0000","last_became_active":"2023-08-25T04:43:41.888323+0000","last_became_peered":"2023-08-25T04:43:41.888323+0000","last_unstale":"2023-08-25T04:45:49.944404+0000","last_undegraded":"2023-08-25T04:45:49.944404+0000","last_fullsized":"2023-08-25T04:45:49.944404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"23'285","reported_seq":310,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:04.217438+0000","last_change":"2023-08-25T04:46:04.217487+0000","last_active":"2023-08-25T04:46:04.217438+0000","last_peered":"2023-08-25T04:46:04.217438+0000","last_clean":"2023-08-25T04:46:04.217438+0000","last_became_active":"2023-08-25T04:43:42.896943+0000","last_became_peered":"2023-08-25T04:43:42.896943+0000","last_unstale":"2023-08-25T04:46:04.217438+0000","last_undegraded":"2023-08-25T04:46:04.217438+0000","last_fullsized":"2023-08-25T04:46:04.217438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'285","last_scrub_stamp":"2023-08-25T04:46:04.217330+0000","last_deep_scrub":"23'285","last_deep_scrub_stamp":"2023-08-25T04:46:04.217330+0000","last_clean_scrub_stamp":"2023-08-25T04:46:04.217330+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:11.803128+0000","scrub_duration":0.0016762509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.423152+0000","last_change":"2023-08-25T04:43:41.887489+0000","last_active":"2023-08-25T04:45:49.423152+0000","last_peered":"2023-08-25T04:45:49.423152+0000","last_clean":"2023-08-25T04:45:49.423152+0000","last_became_active":"2023-08-25T04:43:41.886846+0000","last_became_peered":"2023-08-25T04:43:41.886846+0000","last_unstale":"2023-08-25T04:45:49.423152+0000","last_undegraded":"2023-08-25T04:45:49.423152+0000","last_fullsized":"2023-08-25T04:45:49.423152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'280","reported_seq":297,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.380359+0000","last_change":"2023-08-25T04:43:42.903030+0000","last_active":"2023-08-25T04:45:48.380359+0000","last_peered":"2023-08-25T04:45:48.380359+0000","last_clean":"2023-08-25T04:45:48.380359+0000","last_became_active":"2023-08-25T04:43:42.902123+0000","last_became_peered":"2023-08-25T04:43:42.902123+0000","last_unstale":"2023-08-25T04:45:48.380359+0000","last_undegraded":"2023-08-25T04:45:48.380359+0000","last_fullsized":"2023-08-25T04:45:48.380359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'4","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:06.992606+0000","last_change":"2023-08-25T04:46:06.992658+0000","last_active":"2023-08-25T04:46:06.992606+0000","last_peered":"2023-08-25T04:46:06.992606+0000","last_clean":"2023-08-25T04:46:06.992606+0000","last_became_active":"2023-08-25T04:43:41.882776+0000","last_became_peered":"2023-08-25T04:43:41.882776+0000","last_unstale":"2023-08-25T04:46:06.992606+0000","last_undegraded":"2023-08-25T04:46:06.992606+0000","last_fullsized":"2023-08-25T04:46:06.992606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2023-08-25T04:46:06.992500+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2023-08-25T04:46:06.992500+0000","last_clean_scrub_stamp":"2023-08-25T04:46:06.992500+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:48.672959+0000","scrub_duration":0.0035735530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.407745+0000","last_change":"2023-08-25T04:43:36.786045+0000","last_active":"2023-08-25T04:45:44.407745+0000","last_peered":"2023-08-25T04:45:44.407745+0000","last_clean":"2023-08-25T04:45:44.407745+0000","last_became_active":"2023-08-25T04:43:36.785725+0000","last_became_peered":"2023-08-25T04:43:36.785725+0000","last_unstale":"2023-08-25T04:45:44.407745+0000","last_undegraded":"2023-08-25T04:45:44.407745+0000","last_fullsized":"2023-08-25T04:45:44.407745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:35.771473+0000","last_clean_scrub_stamp":"2023-08-25T04:43:35.771473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"23'253","reported_seq":270,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.397201+0000","last_change":"2023-08-25T04:43:42.890044+0000","last_active":"2023-08-25T04:45:44.397201+0000","last_peered":"2023-08-25T04:45:44.397201+0000","last_clean":"2023-08-25T04:45:44.397201+0000","last_became_active":"2023-08-25T04:43:42.889721+0000","last_became_peered":"2023-08-25T04:43:42.889721+0000","last_unstale":"2023-08-25T04:45:44.397201+0000","last_undegraded":"2023-08-25T04:45:44.397201+0000","last_fullsized":"2023-08-25T04:45:44.397201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:50.725288+0000","last_change":"2023-08-25T04:45:50.725366+0000","last_active":"2023-08-25T04:45:50.725288+0000","last_peered":"2023-08-25T04:45:50.725288+0000","last_clean":"2023-08-25T04:45:50.725288+0000","last_became_active":"2023-08-25T04:43:36.782680+0000","last_became_peered":"2023-08-25T04:43:36.782680+0000","last_unstale":"2023-08-25T04:45:50.725288+0000","last_undegraded":"2023-08-25T04:45:50.725288+0000","last_fullsized":"2023-08-25T04:45:50.725288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:50.725133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:50.725133+0000","last_clean_scrub_stamp":"2023-08-25T04:45:50.725133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:59.488947+0000","scrub_duration":0.0018703929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'10","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:56.942806+0000","last_change":"2023-08-25T04:45:56.942911+0000","last_active":"2023-08-25T04:45:56.942806+0000","last_peered":"2023-08-25T04:45:56.942806+0000","last_clean":"2023-08-25T04:45:56.942806+0000","last_became_active":"2023-08-25T04:43:41.885363+0000","last_became_peered":"2023-08-25T04:43:41.885363+0000","last_unstale":"2023-08-25T04:45:56.942806+0000","last_undegraded":"2023-08-25T04:45:56.942806+0000","last_fullsized":"2023-08-25T04:45:56.942806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2023-08-25T04:45:56.942677+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2023-08-25T04:45:56.942677+0000","last_clean_scrub_stamp":"2023-08-25T04:45:56.942677+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:57:56.907128+0000","scrub_duration":0.002126574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'246","reported_seq":263,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.408157+0000","last_change":"2023-08-25T04:43:42.899201+0000","last_active":"2023-08-25T04:45:49.408157+0000","last_peered":"2023-08-25T04:45:49.408157+0000","last_clean":"2023-08-25T04:45:49.408157+0000","last_became_active":"2023-08-25T04:43:42.898942+0000","last_became_peered":"2023-08-25T04:43:42.898942+0000","last_unstale":"2023-08-25T04:45:49.408157+0000","last_undegraded":"2023-08-25T04:45:49.408157+0000","last_fullsized":"2023-08-25T04:45:49.408157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.283941+0000","last_change":"2023-08-25T04:46:00.284036+0000","last_active":"2023-08-25T04:46:00.283941+0000","last_peered":"2023-08-25T04:46:00.283941+0000","last_clean":"2023-08-25T04:46:00.283941+0000","last_became_active":"2023-08-25T04:43:36.784937+0000","last_became_peered":"2023-08-25T04:43:36.784937+0000","last_unstale":"2023-08-25T04:46:00.283941+0000","last_undegraded":"2023-08-25T04:46:00.283941+0000","last_fullsized":"2023-08-25T04:46:00.283941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:00.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:00.283816+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:41.211029+0000","scrub_duration":0.001807915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"23'119","reported_seq":185,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:53.220629+0000","last_change":"2023-08-25T04:45:53.220691+0000","last_active":"2023-08-25T04:45:53.220629+0000","last_peered":"2023-08-25T04:45:53.220629+0000","last_clean":"2023-08-25T04:45:53.220629+0000","last_became_active":"2023-08-25T04:43:36.785451+0000","last_became_peered":"2023-08-25T04:43:36.785451+0000","last_unstale":"2023-08-25T04:45:53.220629+0000","last_undegraded":"2023-08-25T04:45:53.220629+0000","last_fullsized":"2023-08-25T04:45:53.220629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2023-08-25T04:45:53.220526+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2023-08-25T04:45:53.220526+0000","last_clean_scrub_stamp":"2023-08-25T04:45:53.220526+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:57:53.184978+0000","scrub_duration":0.00569083,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'14","reported_seq":54,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:50.919372+0000","last_change":"2023-08-25T04:45:50.919443+0000","last_active":"2023-08-25T04:45:50.919372+0000","last_peered":"2023-08-25T04:45:50.919372+0000","last_clean":"2023-08-25T04:45:50.919372+0000","last_became_active":"2023-08-25T04:43:41.885029+0000","last_became_peered":"2023-08-25T04:43:41.885029+0000","last_unstale":"2023-08-25T04:45:50.919372+0000","last_undegraded":"2023-08-25T04:45:50.919372+0000","last_fullsized":"2023-08-25T04:45:50.919372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2023-08-25T04:45:50.919257+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2023-08-25T04:45:50.919257+0000","last_clean_scrub_stamp":"2023-08-25T04:45:50.919257+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:18.289019+0000","scrub_duration":0.002121202,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7272,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":13,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'275","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:47.861253+0000","last_change":"2023-08-25T04:43:42.881048+0000","last_active":"2023-08-25T04:45:47.861253+0000","last_peered":"2023-08-25T04:45:47.861253+0000","last_clean":"2023-08-25T04:45:47.861253+0000","last_became_active":"2023-08-25T04:43:42.880591+0000","last_became_peered":"2023-08-25T04:43:42.880591+0000","last_unstale":"2023-08-25T04:45:47.861253+0000","last_undegraded":"2023-08-25T04:45:47.861253+0000","last_fullsized":"2023-08-25T04:45:47.861253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.160820+0000","last_change":"2023-08-25T04:45:57.160870+0000","last_active":"2023-08-25T04:45:57.160820+0000","last_peered":"2023-08-25T04:45:57.160820+0000","last_clean":"2023-08-25T04:45:57.160820+0000","last_became_active":"2023-08-25T04:43:37.192594+0000","last_became_peered":"2023-08-25T04:43:37.192594+0000","last_unstale":"2023-08-25T04:45:57.160820+0000","last_undegraded":"2023-08-25T04:45:57.160820+0000","last_fullsized":"2023-08-25T04:45:57.160820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:57.160708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:57.160708+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.160708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:32.985699+0000","scrub_duration":0.0019998730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.362033+0000","last_change":"2023-08-25T04:46:03.362124+0000","last_active":"2023-08-25T04:46:03.362033+0000","last_peered":"2023-08-25T04:46:03.362033+0000","last_clean":"2023-08-25T04:46:03.362033+0000","last_became_active":"2023-08-25T04:43:41.888158+0000","last_became_peered":"2023-08-25T04:43:41.888158+0000","last_unstale":"2023-08-25T04:46:03.362033+0000","last_undegraded":"2023-08-25T04:46:03.362033+0000","last_fullsized":"2023-08-25T04:46:03.362033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:03.361887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:03.361887+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.361887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:22.060209+0000","scrub_duration":0.0021121450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'249","reported_seq":266,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.380332+0000","last_change":"2023-08-25T04:43:42.902440+0000","last_active":"2023-08-25T04:45:48.380332+0000","last_peered":"2023-08-25T04:45:48.380332+0000","last_clean":"2023-08-25T04:45:48.380332+0000","last_became_active":"2023-08-25T04:43:42.901657+0000","last_became_peered":"2023-08-25T04:43:42.901657+0000","last_unstale":"2023-08-25T04:45:48.380332+0000","last_undegraded":"2023-08-25T04:45:48.380332+0000","last_fullsized":"2023-08-25T04:45:48.380332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:55.203439+0000","last_change":"2023-08-25T04:45:55.203486+0000","last_active":"2023-08-25T04:45:55.203439+0000","last_peered":"2023-08-25T04:45:55.203439+0000","last_clean":"2023-08-25T04:45:55.203439+0000","last_became_active":"2023-08-25T04:43:37.192427+0000","last_became_peered":"2023-08-25T04:43:37.192427+0000","last_unstale":"2023-08-25T04:45:55.203439+0000","last_undegraded":"2023-08-25T04:45:55.203439+0000","last_fullsized":"2023-08-25T04:45:55.203439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:55.203319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:55.203319+0000","last_clean_scrub_stamp":"2023-08-25T04:45:55.203319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:03.967132+0000","scrub_duration":0.0023883820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:05.948775+0000","last_change":"2023-08-25T04:46:05.948826+0000","last_active":"2023-08-25T04:46:05.948775+0000","last_peered":"2023-08-25T04:46:05.948775+0000","last_clean":"2023-08-25T04:46:05.948775+0000","last_became_active":"2023-08-25T04:43:41.883621+0000","last_became_peered":"2023-08-25T04:43:41.883621+0000","last_unstale":"2023-08-25T04:46:05.948775+0000","last_undegraded":"2023-08-25T04:46:05.948775+0000","last_fullsized":"2023-08-25T04:46:05.948775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:05.948651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:05.948651+0000","last_clean_scrub_stamp":"2023-08-25T04:46:05.948651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:59.653326+0000","scrub_duration":0.001754584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.661611+0000","last_change":"2023-08-25T04:46:01.661661+0000","last_active":"2023-08-25T04:46:01.661611+0000","last_peered":"2023-08-25T04:46:01.661611+0000","last_clean":"2023-08-25T04:46:01.661611+0000","last_became_active":"2023-08-25T04:43:42.893333+0000","last_became_peered":"2023-08-25T04:43:42.893333+0000","last_unstale":"2023-08-25T04:46:01.661611+0000","last_undegraded":"2023-08-25T04:46:01.661611+0000","last_fullsized":"2023-08-25T04:46:01.661611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:01.661506+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:01.661506+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.661506+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:29.031268+0000","scrub_duration":0.0017295419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.501952+0000","last_change":"2023-08-25T04:45:51.502008+0000","last_active":"2023-08-25T04:45:51.501952+0000","last_peered":"2023-08-25T04:45:51.501952+0000","last_clean":"2023-08-25T04:45:51.501952+0000","last_became_active":"2023-08-25T04:43:37.192432+0000","last_became_peered":"2023-08-25T04:43:37.192432+0000","last_unstale":"2023-08-25T04:45:51.501952+0000","last_undegraded":"2023-08-25T04:45:51.501952+0000","last_fullsized":"2023-08-25T04:45:51.501952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:51.501848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:51.501848+0000","last_clean_scrub_stamp":"2023-08-25T04:45:51.501848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:18.871610+0000","scrub_duration":0.0015800009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.408220+0000","last_change":"2023-08-25T04:43:41.889966+0000","last_active":"2023-08-25T04:45:49.408220+0000","last_peered":"2023-08-25T04:45:49.408220+0000","last_clean":"2023-08-25T04:45:49.408220+0000","last_became_active":"2023-08-25T04:43:41.889717+0000","last_became_peered":"2023-08-25T04:43:41.889717+0000","last_unstale":"2023-08-25T04:45:49.408220+0000","last_undegraded":"2023-08-25T04:45:49.408220+0000","last_fullsized":"2023-08-25T04:45:49.408220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"23'260","reported_seq":277,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.380328+0000","last_change":"2023-08-25T04:43:42.885970+0000","last_active":"2023-08-25T04:45:48.380328+0000","last_peered":"2023-08-25T04:45:48.380328+0000","last_clean":"2023-08-25T04:45:48.380328+0000","last_became_active":"2023-08-25T04:43:42.885671+0000","last_became_peered":"2023-08-25T04:43:42.885671+0000","last_unstale":"2023-08-25T04:45:48.380328+0000","last_undegraded":"2023-08-25T04:45:48.380328+0000","last_fullsized":"2023-08-25T04:45:48.380328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:54.771152+0000","last_change":"2023-08-25T04:45:54.771206+0000","last_active":"2023-08-25T04:45:54.771152+0000","last_peered":"2023-08-25T04:45:54.771152+0000","last_clean":"2023-08-25T04:45:54.771152+0000","last_became_active":"2023-08-25T04:43:37.192429+0000","last_became_peered":"2023-08-25T04:43:37.192429+0000","last_unstale":"2023-08-25T04:45:54.771152+0000","last_undegraded":"2023-08-25T04:45:54.771152+0000","last_fullsized":"2023-08-25T04:45:54.771152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:54.771023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:54.771023+0000","last_clean_scrub_stamp":"2023-08-25T04:45:54.771023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:36:51.613947+0000","scrub_duration":0.00223077,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"23'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.380253+0000","last_change":"2023-08-25T04:43:41.888493+0000","last_active":"2023-08-25T04:45:48.380253+0000","last_peered":"2023-08-25T04:45:48.380253+0000","last_clean":"2023-08-25T04:45:48.380253+0000","last_became_active":"2023-08-25T04:43:41.888207+0000","last_became_peered":"2023-08-25T04:43:41.888207+0000","last_unstale":"2023-08-25T04:45:48.380253+0000","last_undegraded":"2023-08-25T04:45:48.380253+0000","last_fullsized":"2023-08-25T04:45:48.380253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'310","reported_seq":327,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:47.861231+0000","last_change":"2023-08-25T04:43:42.900866+0000","last_active":"2023-08-25T04:45:47.861231+0000","last_peered":"2023-08-25T04:45:47.861231+0000","last_clean":"2023-08-25T04:45:47.861231+0000","last_became_active":"2023-08-25T04:43:42.900470+0000","last_became_peered":"2023-08-25T04:43:42.900470+0000","last_unstale":"2023-08-25T04:45:47.861231+0000","last_undegraded":"2023-08-25T04:45:47.861231+0000","last_fullsized":"2023-08-25T04:45:47.861231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:53.765264+0000","last_change":"2023-08-25T04:45:53.765312+0000","last_active":"2023-08-25T04:45:53.765264+0000","last_peered":"2023-08-25T04:45:53.765264+0000","last_clean":"2023-08-25T04:45:53.765264+0000","last_became_active":"2023-08-25T04:43:36.784943+0000","last_became_peered":"2023-08-25T04:43:36.784943+0000","last_unstale":"2023-08-25T04:45:53.765264+0000","last_undegraded":"2023-08-25T04:45:53.765264+0000","last_fullsized":"2023-08-25T04:45:53.765264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:53.765149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:53.765149+0000","last_clean_scrub_stamp":"2023-08-25T04:45:53.765149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:47:02.134163+0000","scrub_duration":0.0021115940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.309949+0000","last_change":"2023-08-25T04:46:00.310024+0000","last_active":"2023-08-25T04:46:00.309949+0000","last_peered":"2023-08-25T04:46:00.309949+0000","last_clean":"2023-08-25T04:46:00.309949+0000","last_became_active":"2023-08-25T04:43:41.884535+0000","last_became_peered":"2023-08-25T04:43:41.884535+0000","last_unstale":"2023-08-25T04:46:00.309949+0000","last_undegraded":"2023-08-25T04:46:00.309949+0000","last_fullsized":"2023-08-25T04:46:00.309949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:46:00.309816+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:46:00.309816+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.309816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:09.073630+0000","scrub_duration":0.0020692610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"23'272","reported_seq":289,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.380281+0000","last_change":"2023-08-25T04:43:42.903007+0000","last_active":"2023-08-25T04:45:48.380281+0000","last_peered":"2023-08-25T04:45:48.380281+0000","last_clean":"2023-08-25T04:45:48.380281+0000","last_became_active":"2023-08-25T04:43:42.902721+0000","last_became_peered":"2023-08-25T04:43:42.902721+0000","last_unstale":"2023-08-25T04:45:48.380281+0000","last_undegraded":"2023-08-25T04:45:48.380281+0000","last_fullsized":"2023-08-25T04:45:48.380281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:55.955653+0000","last_change":"2023-08-25T04:45:55.955731+0000","last_active":"2023-08-25T04:45:55.955653+0000","last_peered":"2023-08-25T04:45:55.955653+0000","last_clean":"2023-08-25T04:45:55.955653+0000","last_became_active":"2023-08-25T04:43:41.889659+0000","last_became_peered":"2023-08-25T04:43:41.889659+0000","last_unstale":"2023-08-25T04:45:55.955653+0000","last_undegraded":"2023-08-25T04:45:55.955653+0000","last_fullsized":"2023-08-25T04:45:55.955653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-08-25T04:45:55.955491+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-08-25T04:45:55.955491+0000","last_clean_scrub_stamp":"2023-08-25T04:45:55.955491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:14.653813+0000","scrub_duration":0.0022824579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'274","reported_seq":298,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.236528+0000","last_change":"2023-08-25T04:45:52.236575+0000","last_active":"2023-08-25T04:45:52.236528+0000","last_peered":"2023-08-25T04:45:52.236528+0000","last_clean":"2023-08-25T04:45:52.236528+0000","last_became_active":"2023-08-25T04:43:42.894618+0000","last_became_peered":"2023-08-25T04:43:42.894618+0000","last_unstale":"2023-08-25T04:45:52.236528+0000","last_undegraded":"2023-08-25T04:45:52.236528+0000","last_fullsized":"2023-08-25T04:45:52.236528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'274","last_scrub_stamp":"2023-08-25T04:45:52.236416+0000","last_deep_scrub":"23'274","last_deep_scrub_stamp":"2023-08-25T04:45:52.236416+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.236416+0000","objects_scrubbed":1,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:47:56.691703+0000","scrub_duration":0.0060813940000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'3","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.399135+0000","last_change":"2023-08-25T04:45:57.399191+0000","last_active":"2023-08-25T04:45:57.399135+0000","last_peered":"2023-08-25T04:45:57.399135+0000","last_clean":"2023-08-25T04:45:57.399135+0000","last_became_active":"2023-08-25T04:43:41.886063+0000","last_became_peered":"2023-08-25T04:43:41.886063+0000","last_unstale":"2023-08-25T04:45:57.399135+0000","last_undegraded":"2023-08-25T04:45:57.399135+0000","last_fullsized":"2023-08-25T04:45:57.399135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-08-25T04:45:57.399037+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-08-25T04:45:57.399037+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.399037+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:16.097359+0000","scrub_duration":0.0030540559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'263","reported_seq":287,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.167893+0000","last_change":"2023-08-25T04:45:52.167945+0000","last_active":"2023-08-25T04:45:52.167893+0000","last_peered":"2023-08-25T04:45:52.167893+0000","last_clean":"2023-08-25T04:45:52.167893+0000","last_became_active":"2023-08-25T04:43:42.900135+0000","last_became_peered":"2023-08-25T04:43:42.900135+0000","last_unstale":"2023-08-25T04:45:52.167893+0000","last_undegraded":"2023-08-25T04:45:52.167893+0000","last_fullsized":"2023-08-25T04:45:52.167893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'263","last_scrub_stamp":"2023-08-25T04:45:52.167794+0000","last_deep_scrub":"23'263","last_deep_scrub_stamp":"2023-08-25T04:45:52.167794+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.167794+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:40.246934+0000","scrub_duration":0.00190884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'4","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:59.323662+0000","last_change":"2023-08-25T04:45:59.323712+0000","last_active":"2023-08-25T04:45:59.323662+0000","last_peered":"2023-08-25T04:45:59.323662+0000","last_clean":"2023-08-25T04:45:59.323662+0000","last_became_active":"2023-08-25T04:43:41.891306+0000","last_became_peered":"2023-08-25T04:43:41.891306+0000","last_unstale":"2023-08-25T04:45:59.323662+0000","last_undegraded":"2023-08-25T04:45:59.323662+0000","last_fullsized":"2023-08-25T04:45:59.323662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2023-08-25T04:45:59.323559+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2023-08-25T04:45:59.323559+0000","last_clean_scrub_stamp":"2023-08-25T04:45:59.323559+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:57:59.288011+0000","scrub_duration":0.0028396300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'257","reported_seq":273,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:43.954247+0000","last_change":"2023-08-25T04:43:42.894647+0000","last_active":"2023-08-25T04:45:43.954247+0000","last_peered":"2023-08-25T04:45:43.954247+0000","last_clean":"2023-08-25T04:45:43.954247+0000","last_became_active":"2023-08-25T04:43:42.894386+0000","last_became_peered":"2023-08-25T04:43:42.894386+0000","last_unstale":"2023-08-25T04:45:43.954247+0000","last_undegraded":"2023-08-25T04:45:43.954247+0000","last_fullsized":"2023-08-25T04:45:43.954247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:44.397323+0000","last_change":"2023-08-25T04:43:41.893331+0000","last_active":"2023-08-25T04:45:44.397323+0000","last_peered":"2023-08-25T04:45:44.397323+0000","last_clean":"2023-08-25T04:45:44.397323+0000","last_became_active":"2023-08-25T04:43:41.892929+0000","last_became_peered":"2023-08-25T04:43:41.892929+0000","last_unstale":"2023-08-25T04:45:44.397323+0000","last_undegraded":"2023-08-25T04:45:44.397323+0000","last_fullsized":"2023-08-25T04:45:44.397323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:40.858803+0000","last_clean_scrub_stamp":"2023-08-25T04:43:40.858803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'252","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.423267+0000","last_change":"2023-08-25T04:43:42.894553+0000","last_active":"2023-08-25T04:45:49.423267+0000","last_peered":"2023-08-25T04:45:49.423267+0000","last_clean":"2023-08-25T04:45:49.423267+0000","last_became_active":"2023-08-25T04:43:42.894239+0000","last_became_peered":"2023-08-25T04:43:42.894239+0000","last_unstale":"2023-08-25T04:45:49.423267+0000","last_undegraded":"2023-08-25T04:45:49.423267+0000","last_fullsized":"2023-08-25T04:45:49.423267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'7","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:58.974261+0000","last_change":"2023-08-25T04:45:58.974319+0000","last_active":"2023-08-25T04:45:58.974261+0000","last_peered":"2023-08-25T04:45:58.974261+0000","last_clean":"2023-08-25T04:45:58.974261+0000","last_became_active":"2023-08-25T04:43:41.882756+0000","last_became_peered":"2023-08-25T04:43:41.882756+0000","last_unstale":"2023-08-25T04:45:58.974261+0000","last_undegraded":"2023-08-25T04:45:58.974261+0000","last_fullsized":"2023-08-25T04:45:58.974261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2023-08-25T04:45:58.974148+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2023-08-25T04:45:58.974148+0000","last_clean_scrub_stamp":"2023-08-25T04:45:58.974148+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:07.737962+0000","scrub_duration":0.0040936990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'285","reported_seq":310,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.168483+0000","last_change":"2023-08-25T04:46:01.168483+0000","last_active":"2023-08-25T04:46:01.168483+0000","last_peered":"2023-08-25T04:46:01.168483+0000","last_clean":"2023-08-25T04:46:01.168483+0000","last_became_active":"2023-08-25T04:43:42.894912+0000","last_became_peered":"2023-08-25T04:43:42.894912+0000","last_unstale":"2023-08-25T04:46:01.168483+0000","last_undegraded":"2023-08-25T04:46:01.168483+0000","last_fullsized":"2023-08-25T04:46:01.168483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'285","last_scrub_stamp":"2023-08-25T04:46:01.168322+0000","last_deep_scrub":"23'285","last_deep_scrub_stamp":"2023-08-25T04:46:01.168322+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.168322+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:22:40.848712+0000","scrub_duration":0.0017623630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"23'260","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:05.706542+0000","last_change":"2023-08-25T04:46:05.706619+0000","last_active":"2023-08-25T04:46:05.706542+0000","last_peered":"2023-08-25T04:46:05.706542+0000","last_clean":"2023-08-25T04:46:05.706542+0000","last_became_active":"2023-08-25T04:43:42.893255+0000","last_became_peered":"2023-08-25T04:43:42.893255+0000","last_unstale":"2023-08-25T04:46:05.706542+0000","last_undegraded":"2023-08-25T04:46:05.706542+0000","last_fullsized":"2023-08-25T04:46:05.706542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'260","last_scrub_stamp":"2023-08-25T04:46:05.706403+0000","last_deep_scrub":"23'260","last_deep_scrub_stamp":"2023-08-25T04:46:05.706403+0000","last_clean_scrub_stamp":"2023-08-25T04:46:05.706403+0000","objects_scrubbed":1,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:24.404725+0000","scrub_duration":0.0087624350000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"23'306","reported_seq":323,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.397726+0000","last_change":"2023-08-25T04:43:42.897868+0000","last_active":"2023-08-25T04:45:49.397726+0000","last_peered":"2023-08-25T04:45:49.397726+0000","last_clean":"2023-08-25T04:45:49.397726+0000","last_became_active":"2023-08-25T04:43:42.897394+0000","last_became_peered":"2023-08-25T04:43:42.897394+0000","last_unstale":"2023-08-25T04:45:49.397726+0000","last_undegraded":"2023-08-25T04:45:49.397726+0000","last_fullsized":"2023-08-25T04:45:49.397726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'286","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.408186+0000","last_change":"2023-08-25T04:43:42.894698+0000","last_active":"2023-08-25T04:45:49.408186+0000","last_peered":"2023-08-25T04:45:49.408186+0000","last_clean":"2023-08-25T04:45:49.408186+0000","last_became_active":"2023-08-25T04:43:42.894176+0000","last_became_peered":"2023-08-25T04:43:42.894176+0000","last_unstale":"2023-08-25T04:45:49.408186+0000","last_undegraded":"2023-08-25T04:45:49.408186+0000","last_fullsized":"2023-08-25T04:45:49.408186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"23'256","reported_seq":273,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.397779+0000","last_change":"2023-08-25T04:43:42.899435+0000","last_active":"2023-08-25T04:45:49.397779+0000","last_peered":"2023-08-25T04:45:49.397779+0000","last_clean":"2023-08-25T04:45:49.397779+0000","last_became_active":"2023-08-25T04:43:42.898842+0000","last_became_peered":"2023-08-25T04:43:42.898842+0000","last_unstale":"2023-08-25T04:45:49.397779+0000","last_undegraded":"2023-08-25T04:45:49.397779+0000","last_fullsized":"2023-08-25T04:45:49.397779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'267","reported_seq":284,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.380393+0000","last_change":"2023-08-25T04:43:42.890136+0000","last_active":"2023-08-25T04:45:48.380393+0000","last_peered":"2023-08-25T04:45:48.380393+0000","last_clean":"2023-08-25T04:45:48.380393+0000","last_became_active":"2023-08-25T04:43:42.889849+0000","last_became_peered":"2023-08-25T04:43:42.889849+0000","last_unstale":"2023-08-25T04:45:48.380393+0000","last_undegraded":"2023-08-25T04:45:48.380393+0000","last_fullsized":"2023-08-25T04:45:48.380393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":524,"num_write_kb":1101824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16961,"ondisk_log_size":16961,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1518959,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":463,"num_write_kb":1785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3096576,"data_stored":3037918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":476,"ondisk_log_size":476,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66388,"kb_used_data":26892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94305452,"statfs":{"total":96636764160,"available":96568782848,"internally_reserved":0,"allocated":27537408,"data_stored":27359168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.9349999999999996,"5min":1.8160000000000001,"15min":0.96299999999999997},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":18.02,"5min":18.02,"15min":18.02},"last":0.72499999999999998},{"interface":"front","average":{"1min":7.6100000000000003,"5min":1.954,"15min":1.012},"min":{"1min":0.48299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":22.920999999999999,"5min":22.920999999999999,"15min":22.920999999999999},"last":0.70999999999999996}]},{"osd":1,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.5759999999999996,"5min":2.0209999999999999,"15min":1.095},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":21.199999999999999,"5min":21.199999999999999,"15min":21.199999999999999},"last":0.497},{"interface":"front","average":{"1min":7.585,"5min":1.968,"15min":1.032},"min":{"1min":0.46600000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":22.437999999999999,"5min":22.437999999999999,"15min":22.437999999999999},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.3620000000000001,"5min":1.806,"15min":1.0469999999999999},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":17.844000000000001,"5min":17.844000000000001,"15min":17.844000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":7.2610000000000001,"5min":2.0910000000000002,"15min":1.2290000000000001},"min":{"1min":0.42699999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":19.690999999999999,"5min":19.690999999999999,"15min":19.690999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.7789999999999999,"5min":1.823,"15min":0.997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":17.731000000000002,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":7.0229999999999997,"5min":2.0950000000000002,"15min":1.2729999999999999},"min":{"1min":0.45700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":21.143999999999998,"5min":21.143999999999998,"15min":21.143999999999998},"last":0.60399999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":5.4710000000000001,"5min":1.4690000000000001,"15min":0.80200000000000005},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":22.465,"5min":22.465,"15min":22.465},"last":0.63500000000000001},{"interface":"front","average":{"1min":4.8609999999999998,"5min":1.373,"15min":0.79100000000000004},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":14.042999999999999,"5min":14.042999999999999,"15min":14.042999999999999},"last":0.622}]},{"osd":5,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":3.9830000000000001,"5min":1.238,"15min":0.78000000000000003},"min":{"1min":0.33600000000000002,"5min":0.307,"15min":0.307},"max":{"1min":14.117000000000001,"5min":14.117000000000001,"15min":14.117000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":5.8049999999999997,"5min":1.617,"15min":0.91900000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":22.334,"5min":22.334,"15min":22.334},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.8259999999999996,"5min":2.0169999999999999,"15min":1.0489999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":22.385000000000002,"5min":22.385000000000002,"15min":22.385000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":3.907,"5min":1.2529999999999999,"15min":0.81100000000000005},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":17.623000000000001,"5min":17.623000000000001,"15min":17.623000000000001},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47924,"kb_used_data":8428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323916,"statfs":{"total":96636764160,"available":96587689984,"internally_reserved":0,"allocated":8630272,"data_stored":8480479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":6.2830000000000004,"5min":1.708,"15min":0.94599999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":21.954999999999998,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":6.2729999999999997,"5min":1.7330000000000001,"15min":0.97699999999999998},"min":{"1min":0.35599999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":21.109000000000002,"5min":21.109000000000002,"15min":21.109000000000002},"last":0.76800000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.7000000000000002,"5min":1.7889999999999999,"15min":1.304},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":16.664999999999999,"5min":16.664999999999999,"15min":16.664999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":5.1100000000000003,"5min":1.6619999999999999,"15min":1.0880000000000001},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":22.042000000000002,"5min":22.042000000000002,"15min":22.042000000000002},"last":0.72299999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.75,"5min":1.827,"15min":1.3400000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":19.658000000000001,"5min":19.658000000000001,"15min":19.658000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":4.891,"5min":1.4790000000000001,"15min":0.91000000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":21.138999999999999,"5min":21.138999999999999,"15min":21.138999999999999},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":6.1159999999999997,"5min":1.7210000000000001,"15min":0.98899999999999999},"min":{"1min":0.39200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":21.971,"5min":21.971,"15min":21.971},"last":0.73799999999999999},{"interface":"front","average":{"1min":6.274,"5min":2.1110000000000002,"15min":1.417},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":23.931000000000001,"5min":23.931000000000001,"15min":23.931000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.468,"5min":1.302,"15min":0.77400000000000002},"min":{"1min":0.29399999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":14.532999999999999,"5min":14.532999999999999,"15min":14.532999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":4.1900000000000004,"5min":1.27,"15min":0.78300000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":21.081,"5min":21.081,"15min":21.081},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":2.5649999999999999,"5min":0.94599999999999995,"15min":0.67600000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":12.946,"5min":12.946,"15min":12.946},"last":0.42799999999999999},{"interface":"front","average":{"1min":2.6429999999999998,"5min":0.97999999999999998,"15min":0.70299999999999996},"min":{"1min":0.35199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":19.597000000000001,"5min":19.597000000000001,"15min":19.597000000000001},"last":0.46100000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":2.633,"5min":1.006,"15min":0.73499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.266999999999999,"5min":11.266999999999999,"15min":11.266999999999999},"last":0.505},{"interface":"front","average":{"1min":4.2560000000000002,"5min":1.3320000000000001,"15min":0.84499999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":16.693000000000001,"5min":16.693000000000001,"15min":16.693000000000001},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76984,"kb_used_data":49968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94294856,"statfs":{"total":96636764160,"available":96557932544,"internally_reserved":0,"allocated":51167232,"data_stored":51013887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.7160000000000002,"5min":1.427,"15min":0.71199999999999997},"min":{"1min":0.245,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":23.989999999999998,"5min":23.989999999999998,"15min":23.989999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":5.024,"5min":1.3009999999999999,"15min":0.68100000000000005},"min":{"1min":0.255,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":15.622,"5min":15.622,"15min":15.622},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.6580000000000004,"5min":1.4430000000000001,"15min":0.74099999999999999},"min":{"1min":0.29899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":23.954000000000001,"5min":23.954000000000001,"15min":23.954000000000001},"last":0.442},{"interface":"front","average":{"1min":5.4690000000000003,"5min":1.4530000000000001,"15min":0.78400000000000003},"min":{"1min":0.34499999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":20.946000000000002,"5min":20.946000000000002,"15min":20.946000000000002},"last":0.52000000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.2939999999999996,"5min":1.4059999999999999,"15min":0.75800000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":27.884,"5min":27.884,"15min":27.884},"last":0.47999999999999998},{"interface":"front","average":{"1min":5.6310000000000002,"5min":1.4450000000000001,"15min":0.747},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":23.018000000000001,"5min":23.018000000000001,"15min":23.018000000000001},"last":0.379}]},{"osd":4,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.2439999999999998,"5min":1.952,"15min":1.0700000000000001},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":24.044,"5min":24.044,"15min":24.044},"last":0.5},{"interface":"front","average":{"1min":7.9050000000000002,"5min":2.0840000000000001,"15min":1.1140000000000001},"min":{"1min":0.501,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":27.940000000000001,"5min":27.940000000000001,"15min":27.940000000000001},"last":0.57499999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":8.516,"5min":2.2000000000000002,"15min":1.147},"min":{"1min":0.44,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":26.969999999999999,"5min":26.969999999999999,"15min":26.969999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":7.0430000000000001,"5min":1.923,"15min":1.0700000000000001},"min":{"1min":0.42399999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":24.018000000000001,"5min":24.018000000000001,"15min":24.018000000000001},"last":0.62}]},{"osd":6,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.899,"5min":2.0950000000000002,"15min":1.127},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":22.899999999999999,"5min":22.899999999999999,"15min":22.899999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":7.0890000000000004,"5min":1.9550000000000001,"15min":1.099},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":23.898,"5min":23.898,"15min":23.898},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.718,"5min":2.0779999999999998,"15min":1.1379999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":21.010999999999999,"5min":21.010999999999999,"15min":21.010999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":6.2210000000000001,"5min":1.7669999999999999,"15min":1.0249999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":23.053999999999998,"5min":23.053999999999998,"15min":23.053999999999998},"last":0.67600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64316,"kb_used_data":24820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94307524,"statfs":{"total":96636764160,"available":96570904576,"internally_reserved":0,"allocated":25415680,"data_stored":25264588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":3.8849999999999998,"5min":1.0649999999999999,"15min":0.59499999999999997},"min":{"1min":0.32800000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":19.956,"5min":19.956,"15min":19.956},"last":0.40500000000000003},{"interface":"front","average":{"1min":4.4450000000000003,"5min":1.2150000000000001,"15min":0.67700000000000005},"min":{"1min":0.29599999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":14.029999999999999,"5min":14.029999999999999,"15min":14.029999999999999},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":6.3410000000000002,"5min":1.627,"15min":0.84099999999999997},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":22.942,"5min":22.942,"15min":22.942},"last":0.65900000000000003},{"interface":"front","average":{"1min":2.7879999999999998,"5min":0.87,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.016,"5min":11.016,"15min":11.016},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":4.9039999999999999,"5min":1.3069999999999999,"15min":0.70699999999999996},"min":{"1min":0.35899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":19.997,"5min":19.997,"15min":19.997},"last":0.58499999999999996},{"interface":"front","average":{"1min":5.9139999999999997,"5min":1.522,"15min":0.79000000000000004},"min":{"1min":0.40400000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":17.045999999999999,"5min":17.045999999999999,"15min":17.045999999999999},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":4.484,"5min":1.786,"15min":1.3360000000000001},"min":{"1min":0.49199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":21.001000000000001,"5min":21.001000000000001,"15min":21.001000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":8.2750000000000004,"5min":2.1640000000000001,"15min":1.1459999999999999},"min":{"1min":0.46400000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.68000000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":9.8439999999999994,"5min":2.4820000000000002,"15min":1.2549999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":23.93,"5min":23.93,"15min":23.93},"last":0.64100000000000001},{"interface":"front","average":{"1min":6.6479999999999997,"5min":1.8500000000000001,"15min":1.05},"min":{"1min":0.51600000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":17.010000000000002,"5min":17.010000000000002,"15min":17.010000000000002},"last":0.625}]},{"osd":6,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":7.6139999999999999,"5min":2.0379999999999998,"15min":1.109},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":27.701000000000001,"5min":27.701000000000001,"15min":27.701000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":4.758,"5min":1.5029999999999999,"15min":0.96099999999999997},"min":{"1min":0.62,"5min":0.443,"15min":0.443},"max":{"1min":20.942,"5min":20.942,"15min":20.942},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":5.657,"5min":1.6879999999999999,"15min":1.026},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":21.030999999999999,"5min":21.030999999999999,"15min":21.030999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":7.9189999999999996,"5min":2.125,"15min":1.159},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":20.902999999999999,"5min":20.902999999999999,"15min":20.902999999999999},"last":0.53900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56116,"kb_used_data":16620,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315724,"statfs":{"total":96636764160,"available":96579301376,"internally_reserved":0,"allocated":17018880,"data_stored":16869087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":4.1100000000000003,"5min":1.1180000000000001,"15min":0.61899999999999999},"min":{"1min":0.33900000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":18.98,"5min":18.98,"15min":18.98},"last":0.55400000000000005},{"interface":"front","average":{"1min":4.9240000000000004,"5min":1.302,"15min":0.69799999999999995},"min":{"1min":0.27300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":20.966999999999999,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.66300000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":3.899,"5min":1.127,"15min":0.66500000000000004},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":20.995999999999999,"5min":20.995999999999999,"15min":20.995999999999999},"last":0.63},{"interface":"front","average":{"1min":3.6629999999999998,"5min":1.0680000000000001,"15min":0.63600000000000001},"min":{"1min":0.34499999999999997,"5min":0.307,"15min":0.307},"max":{"1min":12.052,"5min":12.052,"15min":12.052},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.0149999999999997,"5min":1.341,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":19.925999999999998,"5min":19.925999999999998,"15min":19.925999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":4.4059999999999997,"5min":1.2589999999999999,"15min":0.73499999999999999},"min":{"1min":0.373,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":20.916,"5min":20.916,"15min":20.916},"last":0.57499999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.2930000000000001,"5min":1.982,"15min":1.097},"min":{"1min":0.46600000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":19.940999999999999,"5min":19.940999999999999,"15min":19.940999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":8.3059999999999992,"5min":2.1480000000000001,"15min":1.1220000000000001},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":22.038,"5min":22.038,"15min":22.038},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":6.3300000000000001,"5min":1.8140000000000001,"15min":1.0609999999999999},"min":{"1min":0.59499999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":19.98,"5min":19.98,"15min":19.98},"last":0.77200000000000002},{"interface":"front","average":{"1min":7.8689999999999998,"5min":2.0790000000000002,"15min":1.1140000000000001},"min":{"1min":0.53500000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":21.050999999999998,"5min":21.050999999999998,"15min":21.050999999999998},"last":0.78500000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.3419999999999996,"5min":1.9910000000000001,"15min":1.099},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":22.021999999999998,"5min":22.021999999999998,"15min":22.021999999999998},"last":0.753},{"interface":"front","average":{"1min":6.9569999999999999,"5min":1.921,"15min":1.0820000000000001},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.498},"max":{"1min":19.007999999999999,"5min":19.007999999999999,"15min":19.007999999999999},"last":0.82399999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":6.8129999999999997,"5min":1.885,"15min":1.0640000000000001},"min":{"1min":0.49199999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":21.023,"5min":21.023,"15min":21.023},"last":0.88400000000000001},{"interface":"front","average":{"1min":9.3469999999999995,"5min":2.411,"15min":1.2549999999999999},"min":{"1min":0.498,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":28.928000000000001,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.86599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64120,"kb_used_data":37104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94307720,"statfs":{"total":96636764160,"available":96571105280,"internally_reserved":0,"allocated":37994496,"data_stored":37840697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.6289999999999996,"5min":1.266,"15min":0.70599999999999996},"min":{"1min":0.28399999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":23.542000000000002,"5min":23.542000000000002,"15min":23.542000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":4.4550000000000001,"5min":1.2949999999999999,"15min":0.76800000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":20.547000000000001,"5min":20.547000000000001,"15min":20.547000000000001},"last":0.35999999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.3869999999999996,"5min":1.2709999999999999,"15min":0.752},"min":{"1min":0.31900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":18.984999999999999,"5min":18.984999999999999,"15min":18.984999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":4.9550000000000001,"5min":1.3380000000000001,"15min":0.73499999999999999},"min":{"1min":0.32300000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":20.052,"5min":20.052,"15min":20.052},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":5.7050000000000001,"5min":1.5329999999999999,"15min":0.83799999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":20.861000000000001,"5min":20.861000000000001,"15min":20.861000000000001},"last":0.38},{"interface":"front","average":{"1min":5.0060000000000002,"5min":1.405,"15min":0.80500000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":21.984000000000002,"5min":21.984000000000002,"15min":21.984000000000002},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.6619999999999999,"5min":2.1160000000000001,"15min":1.1919999999999999},"min":{"1min":0.40300000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":22.015999999999998,"5min":22.015999999999998,"15min":22.015999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":6.4500000000000002,"5min":1.8380000000000001,"15min":1.0700000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":20.934999999999999,"5min":20.934999999999999,"15min":20.934999999999999},"last":0.498}]},{"osd":5,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.859,"5min":1.9039999999999999,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":23.474,"5min":23.474,"15min":23.474},"last":0.66100000000000003},{"interface":"front","average":{"1min":7.242,"5min":2.069,"15min":1.2070000000000001},"min":{"1min":0.441,"5min":0.376,"15min":0.376},"max":{"1min":21.975999999999999,"5min":21.975999999999999,"15min":21.975999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.9580000000000002,"5min":2.1429999999999998,"15min":1.1739999999999999},"min":{"1min":0.45400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":20.898,"5min":20.898,"15min":20.898},"last":0.59099999999999997},{"interface":"front","average":{"1min":6.3879999999999999,"5min":1.8169999999999999,"15min":1.0549999999999999},"min":{"1min":0.48799999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":23.513000000000002,"5min":23.513000000000002,"15min":23.513000000000002},"last":0.70099999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.843,"5min":2.2029999999999998,"15min":1.2629999999999999},"min":{"1min":0.432,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":22.039999999999999,"5min":22.039999999999999,"15min":22.039999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":7.2370000000000001,"5min":2.0449999999999999,"15min":1.179},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.905000000000001,"5min":20.905000000000001,"15min":20.905000000000001},"last":0.67800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53328,"kb_used_data":26312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94318512,"statfs":{"total":96636764160,"available":96582156288,"internally_reserved":0,"allocated":26943488,"data_stored":26775912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.2069999999999999,"5min":1.657,"15min":0.89900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":17.920000000000002,"5min":17.920000000000002,"15min":17.920000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":6.46,"5min":1.7130000000000001,"15min":0.92200000000000004},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":20.904,"5min":20.904,"15min":20.904},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.3390000000000004,"5min":1.7170000000000001,"15min":0.94699999999999995},"min":{"1min":0.503,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":23.911000000000001,"5min":23.911000000000001,"15min":23.911000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":6.5750000000000002,"5min":1.756,"15min":0.95299999999999996},"min":{"1min":0.375,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":21.952999999999999,"5min":21.952999999999999,"15min":21.952999999999999},"last":0.69899999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.9210000000000003,"5min":1.833,"15min":0.98499999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":21.847999999999999,"5min":21.847999999999999,"15min":21.847999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":8.0950000000000006,"5min":2.0750000000000002,"15min":1.0720000000000001},"min":{"1min":0.504,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":33.182000000000002,"5min":33.182000000000002,"15min":33.182000000000002},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.1100000000000003,"5min":1.8660000000000001,"15min":0.99199999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":17.010999999999999,"5min":17.010999999999999,"15min":17.010999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":5.5220000000000002,"5min":1.575,"15min":0.91700000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":15.022,"5min":15.022,"15min":15.022},"last":0.58899999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":4.0679999999999996,"5min":1.1919999999999999,"15min":0.71299999999999997},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":5.1680000000000001,"5min":1.4570000000000001,"15min":0.83899999999999997},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":30.946999999999999,"5min":30.946999999999999,"15min":30.946999999999999},"last":0.54600000000000004}]},{"osd":6,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":5.859,"5min":1.5800000000000001,"15min":0.86699999999999999},"min":{"1min":0.42399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":15.936999999999999,"5min":15.936999999999999,"15min":15.936999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":5.0999999999999996,"5min":1.464,"15min":0.85799999999999998},"min":{"1min":0.42399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":20.937000000000001,"5min":20.937000000000001,"15min":20.937000000000001},"last":0.63}]},{"osd":7,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":4.4710000000000001,"5min":1.339,"15min":0.81699999999999995},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":12.914,"5min":12.914,"15min":12.914},"last":0.66300000000000003},{"interface":"front","average":{"1min":5.6820000000000004,"5min":1.6080000000000001,"15min":0.92900000000000005},"min":{"1min":0.48999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":15.045999999999999,"5min":15.045999999999999,"15min":15.045999999999999},"last":0.64200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52028,"kb_used_data":12532,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319812,"statfs":{"total":96636764160,"available":96583487488,"internally_reserved":0,"allocated":12832768,"data_stored":12675435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.2850000000000001,"5min":1.877,"15min":0.97499999999999998},"min":{"1min":0.34699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":27.048999999999999,"5min":27.048999999999999,"15min":27.048999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":6.5140000000000002,"5min":1.7290000000000001,"15min":0.93100000000000005},"min":{"1min":0.40100000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":20.956,"5min":20.956,"15min":20.956},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.9500000000000002,"5min":1.8089999999999999,"15min":0.95199999999999996},"min":{"1min":0.307,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":20.923999999999999,"5min":20.923999999999999,"15min":20.923999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":6.6459999999999999,"5min":1.782,"15min":0.97199999999999998},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":24.927,"5min":24.927,"15min":24.927},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.6070000000000002,"5min":1.978,"15min":1.04},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":18.602,"5min":18.602,"15min":18.602},"last":0.52600000000000002},{"interface":"front","average":{"1min":6.1580000000000004,"5min":1.722,"15min":0.98199999999999998},"min":{"1min":0.42699999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":15.946999999999999,"5min":15.946999999999999,"15min":15.946999999999999},"last":0.72799999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.8200000000000003,"5min":2.008,"15min":1.0389999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":17.782,"5min":17.782,"15min":17.782},"last":0.66300000000000003},{"interface":"front","average":{"1min":7.7779999999999996,"5min":2.0699999999999998,"15min":1.119},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":27.077000000000002,"5min":27.077000000000002,"15min":27.077000000000002},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.1859999999999999,"5min":1.214,"15min":0.71799999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":19.172999999999998,"5min":19.172999999999998,"15min":19.172999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":5.2329999999999997,"5min":1.4810000000000001,"15min":0.85599999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.693999999999999,"5min":17.693999999999999,"15min":17.693999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.056,"5min":1.6140000000000001,"15min":0.874},"min":{"1min":0.33700000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":27.103000000000002,"5min":27.103000000000002,"15min":27.103000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":4.9829999999999997,"5min":1.4399999999999999,"15min":0.84999999999999998},"min":{"1min":0.35299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":22.154,"5min":22.154,"15min":22.154},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.0890000000000004,"5min":1.2849999999999999,"15min":0.81799999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":19.253,"5min":19.253,"15min":19.253},"last":0.70399999999999996},{"interface":"front","average":{"1min":4.0060000000000002,"5min":1.238,"15min":0.77700000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":27.001000000000001,"5min":27.001000000000001,"15min":27.001000000000001},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":7854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1536000,"data_stored":1518217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1536000,"data_stored":1511105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50331648,"data_stored":50331648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37748736,"data_stored":37748736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:46:12.325 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.325 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.326 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.326 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.326 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.327 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.327 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.327 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.328 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.328 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.328 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.329 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.329 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.329 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.330 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.330 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.330 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.330 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.331 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.331 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.331 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.332 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.332 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.332 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.333 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.333 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.333 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.334 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.334 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.334 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.334 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.335 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.335 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.335 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.336 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.336 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.337 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.337 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.337 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.337 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.338 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-08-25T04:43:35.771473+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=35, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.338 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.338 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.339 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.339 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.339 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.340 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.340 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.340 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.341 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.341 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.341 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-08-25T04:43:40.858803+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=40, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.342 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.342 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.593 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.594 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.595 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:12.595 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-25T04:46:14.685 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:46:14.688 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:46:32.596 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:46:32.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.736+0000 7f8fc7b97700 1 Processor -- start 2023-08-25T04:46:32.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.736+0000 7f8fc7b97700 1 -- start start 2023-08-25T04:46:32.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.736+0000 7f8fc7b97700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc015b380 0x7f8fc00701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc7b97700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8fc00d0970 0x7f8fc00b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc7b97700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8fc00b2fa0 0x7f8fc00ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc7b97700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc00cd900 con 0x7f8fc00d0970 2023-08-25T04:46:32.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc7b97700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc0070730 con 0x7f8fc00b2fa0 2023-08-25T04:46:32.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc7b97700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00b33f0 con 0x7f8fc015b380 2023-08-25T04:46:32.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc5132700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8fc00d0970 0x7f8fc00b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc5132700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8fc00d0970 0x7f8fc00b2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50576/0 (socket says 172.21.15.16:50576) 2023-08-25T04:46:32.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc5132700 1 -- 172.21.15.16:0/696836384 learned_addr learned my addr 172.21.15.16:0/696836384 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:46:32.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc6134700 1 --2- 172.21.15.16:0/696836384 >> v2:172.21.15.117:3300/0 conn(0x7f8fc00b2fa0 0x7f8fc00ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc5933700 1 --2- 172.21.15.16:0/696836384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc015b380 0x7f8fc00701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc5132700 1 -- 172.21.15.16:0/696836384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc015b380 msgr2=0x7f8fc00701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:32.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc5132700 1 --2- 172.21.15.16:0/696836384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc015b380 0x7f8fc00701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc5132700 1 -- 172.21.15.16:0/696836384 >> v2:172.21.15.117:3300/0 conn(0x7f8fc00b2fa0 msgr2=0x7f8fc00ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:32.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc5132700 1 --2- 172.21.15.16:0/696836384 >> v2:172.21.15.117:3300/0 conn(0x7f8fc00b2fa0 0x7f8fc00ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc5132700 1 -- 172.21.15.16:0/696836384 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00cd340 con 0x7f8fc00d0970 2023-08-25T04:46:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc5132700 1 --2- 172.21.15.16:0/696836384 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fc00d0970 0x7f8fc00b2a60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8fc006f030 tx=0x7f8fb0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d656b93d55df70a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc4931700 1 -- 172.21.15.16:0/696836384 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb000b870 con 0x7f8fc00d0970 2023-08-25T04:46:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc4931700 1 -- 172.21.15.16:0/696836384 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb000b9d0 con 0x7f8fc00d0970 2023-08-25T04:46:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.737+0000 7f8fc4931700 1 -- 172.21.15.16:0/696836384 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb000bd60 con 0x7f8fc00d0970 2023-08-25T04:46:32.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.738+0000 7f8fc7b97700 1 -- 172.21.15.16:0/696836384 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fc00d0970 msgr2=0x7f8fc00b2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.738+0000 7f8fc7b97700 1 --2- 172.21.15.16:0/696836384 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fc00d0970 0x7f8fc00b2a60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8fc006f030 tx=0x7f8fb0009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.738+0000 7f8fc7b97700 1 -- 172.21.15.16:0/696836384 shutdown_connections 2023-08-25T04:46:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.738+0000 7f8fc7b97700 1 --2- 172.21.15.16:0/696836384 >> v2:172.21.15.117:3300/0 conn(0x7f8fc00b2fa0 0x7f8fc00ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.738+0000 7f8fc7b97700 1 --2- 172.21.15.16:0/696836384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc015b380 0x7f8fc00701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.738+0000 7f8fc7b97700 1 --2- 172.21.15.16:0/696836384 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fc00d0970 0x7f8fc00b2a60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.738+0000 7f8fc7b97700 1 -- 172.21.15.16:0/696836384 >> 172.21.15.16:0/696836384 conn(0x7f8fc00d0fe0 msgr2=0x7f8fc00d13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:32.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.738+0000 7f8fc7b97700 1 -- 172.21.15.16:0/696836384 shutdown_connections 2023-08-25T04:46:32.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.738+0000 7f8fc7b97700 1 -- 172.21.15.16:0/696836384 wait complete. 2023-08-25T04:46:32.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.739+0000 7f8fc7b97700 1 Processor -- start 2023-08-25T04:46:32.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.739+0000 7f8fc7b97700 1 -- start start 2023-08-25T04:46:32.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.740+0000 7f8fc7b97700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fc00b2fa0 0x7f8fc00a9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.740+0000 7f8fc7b97700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc00d0970 0x7f8fc014e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.740+0000 7f8fc7b97700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fc015b380 0x7f8fc00a9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.740+0000 7f8fc7b97700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00aa920 con 0x7f8fc015b380 2023-08-25T04:46:32.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.740+0000 7f8fc7b97700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00a8bc0 con 0x7f8fc00b2fa0 2023-08-25T04:46:32.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.740+0000 7f8fc7b97700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00aa640 con 0x7f8fc00d0970 2023-08-25T04:46:32.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.740+0000 7f8fc6134700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fc015b380 0x7f8fc00a9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.740+0000 7f8fc6134700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fc015b380 0x7f8fc00a9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50584/0 (socket says 172.21.15.16:50584) 2023-08-25T04:46:32.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.740+0000 7f8fc6134700 1 -- 172.21.15.16:0/3416529788 learned_addr learned my addr 172.21.15.16:0/3416529788 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:46:32.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.740+0000 7f8fc5933700 1 --2- 172.21.15.16:0/3416529788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fc00b2fa0 0x7f8fc00a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.740+0000 7f8fc5132700 1 --2- 172.21.15.16:0/3416529788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc00d0970 0x7f8fc014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.741+0000 7f8fc6134700 1 -- 172.21.15.16:0/3416529788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc00d0970 msgr2=0x7f8fc014e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.741+0000 7f8fc6134700 1 --2- 172.21.15.16:0/3416529788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc00d0970 0x7f8fc014e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.741+0000 7f8fc6134700 1 -- 172.21.15.16:0/3416529788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fc00b2fa0 msgr2=0x7f8fc00a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.741+0000 7f8fc6134700 1 --2- 172.21.15.16:0/3416529788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fc00b2fa0 0x7f8fc00a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.741+0000 7f8fc6134700 1 -- 172.21.15.16:0/3416529788 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb0009550 con 0x7f8fc015b380 2023-08-25T04:46:32.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.741+0000 7f8fc6134700 1 --2- 172.21.15.16:0/3416529788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fc015b380 0x7f8fc00a9c60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8007e60 tx=0x7f8fb800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:32.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.741+0000 7f8fb67fc700 1 -- 172.21.15.16:0/3416529788 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb800ed30 con 0x7f8fc015b380 2023-08-25T04:46:32.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.741+0000 7f8fb67fc700 1 -- 172.21.15.16:0/3416529788 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb8014420 con 0x7f8fc015b380 2023-08-25T04:46:32.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.741+0000 7f8fc7b97700 1 -- 172.21.15.16:0/3416529788 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc00a8570 con 0x7f8fc015b380 2023-08-25T04:46:32.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.741+0000 7f8fb67fc700 1 -- 172.21.15.16:0/3416529788 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb80147d0 con 0x7f8fc015b380 2023-08-25T04:46:32.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.741+0000 7f8fc7b97700 1 -- 172.21.15.16:0/3416529788 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc014e760 con 0x7f8fc015b380 2023-08-25T04:46:32.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.742+0000 7f8fc7b97700 1 -- 172.21.15.16:0/3416529788 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc014e8f0 con 0x7f8fc015b380 2023-08-25T04:46:32.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.742+0000 7f8fb67fc700 1 -- 172.21.15.16:0/3416529788 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8fb8014930 con 0x7f8fc015b380 2023-08-25T04:46:32.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.743+0000 7f8fb67fc700 1 --2- 172.21.15.16:0/3416529788 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f8fa406a0e0 0x7f8fa406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.743+0000 7f8fb67fc700 1 -- 172.21.15.16:0/3416529788 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8fb8088b70 con 0x7f8fc015b380 2023-08-25T04:46:32.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.743+0000 7f8fc5933700 1 --2- 172.21.15.16:0/3416529788 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f8fa406a0e0 0x7f8fa406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.744+0000 7f8fc5933700 1 --2- 172.21.15.16:0/3416529788 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f8fa406a0e0 0x7f8fa406c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc006b20 tx=0x7f8fbc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:32.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.748+0000 7f8fb67fc700 1 -- 172.21.15.16:0/3416529788 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8fc014e8f0 con 0x7f8fc015b380 2023-08-25T04:46:32.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.943+0000 7f8fc7b97700 1 -- 172.21.15.16:0/3416529788 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8fc00cb6b0 con 0x7f8fa406a0e0 2023-08-25T04:46:32.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.952+0000 7f8fb67fc700 1 -- 172.21.15.16:0/3416529788 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312387 (secure 0 0 0) 0x7f8fbc0076b0 con 0x7f8fa406a0e0 2023-08-25T04:46:32.957 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:46:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.956+0000 7f8fc7b97700 1 -- 172.21.15.16:0/3416529788 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f8fa406a0e0 msgr2=0x7f8fa406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.956+0000 7f8fc7b97700 1 --2- 172.21.15.16:0/3416529788 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f8fa406a0e0 0x7f8fa406c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc006b20 tx=0x7f8fbc008040 comp rx=0 tx=0).stop 2023-08-25T04:46:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.956+0000 7f8fc7b97700 1 -- 172.21.15.16:0/3416529788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fc015b380 msgr2=0x7f8fc00a9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.956+0000 7f8fc7b97700 1 --2- 172.21.15.16:0/3416529788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fc015b380 0x7f8fc00a9c60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8007e60 tx=0x7f8fb800e3c0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.956+0000 7f8fc7b97700 1 -- 172.21.15.16:0/3416529788 shutdown_connections 2023-08-25T04:46:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.956+0000 7f8fc7b97700 1 --2- 172.21.15.16:0/3416529788 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f8fa406a0e0 0x7f8fa406c5a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.956+0000 7f8fc7b97700 1 --2- 172.21.15.16:0/3416529788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fc015b380 0x7f8fc00a9c60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.956+0000 7f8fc7b97700 1 --2- 172.21.15.16:0/3416529788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fc00b2fa0 0x7f8fc00a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.956+0000 7f8fc7b97700 1 --2- 172.21.15.16:0/3416529788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc00d0970 0x7f8fc014e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.956+0000 7f8fc7b97700 1 -- 172.21.15.16:0/3416529788 >> 172.21.15.16:0/3416529788 conn(0x7f8fc00d0fe0 msgr2=0x7f8fc006fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.956+0000 7f8fc7b97700 1 -- 172.21.15.16:0/3416529788 shutdown_connections 2023-08-25T04:46:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:32.956+0000 7f8fc7b97700 1 -- 172.21.15.16:0/3416529788 wait complete. 2023-08-25T04:46:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-08-25T04:46:32.969 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-08-25T04:46:31.417507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102772623,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":129,"num_read_kb":115,"num_write":1146,"num_write_kb":1106025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17576,"ondisk_log_size":17576,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":481204,"kb_used_data":202676,"kb_used_omap":13,"kb_used_meta":278450,"kb_avail":754493516,"statfs":{"total":773094113280,"available":772601360384,"internally_reserved":0,"allocated":207540224,"data_stored":206279253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":285132888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003196"},"pg_stats":[{"pgid":"4.3f","version":"23'232","reported_seq":257,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.038106+0000","last_change":"2023-08-25T04:46:01.038166+0000","last_active":"2023-08-25T04:46:01.038106+0000","last_peered":"2023-08-25T04:46:01.038106+0000","last_clean":"2023-08-25T04:46:01.038106+0000","last_became_active":"2023-08-25T04:43:42.894831+0000","last_became_peered":"2023-08-25T04:43:42.894831+0000","last_unstale":"2023-08-25T04:46:01.038106+0000","last_undegraded":"2023-08-25T04:46:01.038106+0000","last_fullsized":"2023-08-25T04:46:01.038106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'232","last_scrub_stamp":"2023-08-25T04:46:01.037985+0000","last_deep_scrub":"23'232","last_deep_scrub_stamp":"2023-08-25T04:46:01.037985+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.037985+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:36:57.880910+0000","scrub_duration":0.0016765160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'220","reported_seq":245,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:23.267930+0000","last_change":"2023-08-25T04:46:23.267988+0000","last_active":"2023-08-25T04:46:23.267930+0000","last_peered":"2023-08-25T04:46:23.267930+0000","last_clean":"2023-08-25T04:46:23.267930+0000","last_became_active":"2023-08-25T04:43:42.895245+0000","last_became_peered":"2023-08-25T04:43:42.895245+0000","last_unstale":"2023-08-25T04:46:23.267930+0000","last_undegraded":"2023-08-25T04:46:23.267930+0000","last_fullsized":"2023-08-25T04:46:23.267930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'220","last_scrub_stamp":"2023-08-25T04:46:23.267814+0000","last_deep_scrub":"23'220","last_deep_scrub_stamp":"2023-08-25T04:46:23.267814+0000","last_clean_scrub_stamp":"2023-08-25T04:46:23.267814+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:16:36.701979+0000","scrub_duration":0.0021392400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"23'276","reported_seq":293,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.408261+0000","last_change":"2023-08-25T04:43:42.888920+0000","last_active":"2023-08-25T04:45:49.408261+0000","last_peered":"2023-08-25T04:45:49.408261+0000","last_clean":"2023-08-25T04:45:49.408261+0000","last_became_active":"2023-08-25T04:43:42.888568+0000","last_became_peered":"2023-08-25T04:43:42.888568+0000","last_unstale":"2023-08-25T04:45:49.408261+0000","last_undegraded":"2023-08-25T04:45:49.408261+0000","last_fullsized":"2023-08-25T04:45:49.408261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"23'253","reported_seq":278,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:04.727265+0000","last_change":"2023-08-25T04:46:04.727316+0000","last_active":"2023-08-25T04:46:04.727265+0000","last_peered":"2023-08-25T04:46:04.727265+0000","last_clean":"2023-08-25T04:46:04.727265+0000","last_became_active":"2023-08-25T04:43:42.893534+0000","last_became_peered":"2023-08-25T04:43:42.893534+0000","last_unstale":"2023-08-25T04:46:04.727265+0000","last_undegraded":"2023-08-25T04:46:04.727265+0000","last_fullsized":"2023-08-25T04:46:04.727265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'253","last_scrub_stamp":"2023-08-25T04:46:04.727143+0000","last_deep_scrub":"23'253","last_deep_scrub_stamp":"2023-08-25T04:46:04.727143+0000","last_clean_scrub_stamp":"2023-08-25T04:46:04.727143+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:48:03.426061+0000","scrub_duration":0.0023240380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"23'256","reported_seq":281,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.953954+0000","last_change":"2023-08-25T04:46:03.953954+0000","last_active":"2023-08-25T04:46:03.953954+0000","last_peered":"2023-08-25T04:46:03.953954+0000","last_clean":"2023-08-25T04:46:03.953954+0000","last_became_active":"2023-08-25T04:43:42.901963+0000","last_became_peered":"2023-08-25T04:43:42.901963+0000","last_unstale":"2023-08-25T04:46:03.953954+0000","last_undegraded":"2023-08-25T04:46:03.953954+0000","last_fullsized":"2023-08-25T04:46:03.953954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'256","last_scrub_stamp":"2023-08-25T04:46:03.953767+0000","last_deep_scrub":"23'256","last_deep_scrub_stamp":"2023-08-25T04:46:03.953767+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.953767+0000","objects_scrubbed":1,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:06.097285+0000","scrub_duration":0.0078404019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'278","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944646+0000","last_change":"2023-08-25T04:43:42.888877+0000","last_active":"2023-08-25T04:45:49.944646+0000","last_peered":"2023-08-25T04:45:49.944646+0000","last_clean":"2023-08-25T04:45:49.944646+0000","last_became_active":"2023-08-25T04:43:42.888567+0000","last_became_peered":"2023-08-25T04:43:42.888567+0000","last_unstale":"2023-08-25T04:45:49.944646+0000","last_undegraded":"2023-08-25T04:45:49.944646+0000","last_fullsized":"2023-08-25T04:45:49.944646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"23'295","reported_seq":320,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:25.174949+0000","last_change":"2023-08-25T04:46:25.175012+0000","last_active":"2023-08-25T04:46:25.174949+0000","last_peered":"2023-08-25T04:46:25.174949+0000","last_clean":"2023-08-25T04:46:25.174949+0000","last_became_active":"2023-08-25T04:43:42.902156+0000","last_became_peered":"2023-08-25T04:43:42.902156+0000","last_unstale":"2023-08-25T04:46:25.174949+0000","last_undegraded":"2023-08-25T04:46:25.174949+0000","last_fullsized":"2023-08-25T04:46:25.174949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'295","last_scrub_stamp":"2023-08-25T04:46:25.174849+0000","last_deep_scrub":"23'295","last_deep_scrub_stamp":"2023-08-25T04:46:25.174849+0000","last_clean_scrub_stamp":"2023-08-25T04:46:25.174849+0000","objects_scrubbed":2,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:35:29.333088+0000","scrub_duration":0.017116702000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"23'270","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:17.296005+0000","last_change":"2023-08-25T04:46:17.296066+0000","last_active":"2023-08-25T04:46:17.296005+0000","last_peered":"2023-08-25T04:46:17.296005+0000","last_clean":"2023-08-25T04:46:17.296005+0000","last_became_active":"2023-08-25T04:43:42.895410+0000","last_became_peered":"2023-08-25T04:43:42.895410+0000","last_unstale":"2023-08-25T04:46:17.296005+0000","last_undegraded":"2023-08-25T04:46:17.296005+0000","last_fullsized":"2023-08-25T04:46:17.296005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'270","last_scrub_stamp":"2023-08-25T04:46:17.295895+0000","last_deep_scrub":"23'270","last_deep_scrub_stamp":"2023-08-25T04:46:17.295895+0000","last_clean_scrub_stamp":"2023-08-25T04:46:17.295895+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:24.881693+0000","scrub_duration":0.001880591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"23'249","reported_seq":274,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:15.980943+0000","last_change":"2023-08-25T04:46:15.981007+0000","last_active":"2023-08-25T04:46:15.980943+0000","last_peered":"2023-08-25T04:46:15.980943+0000","last_clean":"2023-08-25T04:46:15.980943+0000","last_became_active":"2023-08-25T04:43:42.896949+0000","last_became_peered":"2023-08-25T04:43:42.896949+0000","last_unstale":"2023-08-25T04:46:15.980943+0000","last_undegraded":"2023-08-25T04:46:15.980943+0000","last_fullsized":"2023-08-25T04:46:15.980943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'249","last_scrub_stamp":"2023-08-25T04:46:15.980802+0000","last_deep_scrub":"23'249","last_deep_scrub_stamp":"2023-08-25T04:46:15.980802+0000","last_clean_scrub_stamp":"2023-08-25T04:46:15.980802+0000","objects_scrubbed":1,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:23.566600+0000","scrub_duration":0.0083634850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'283","reported_seq":308,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:18.321487+0000","last_change":"2023-08-25T04:46:18.321541+0000","last_active":"2023-08-25T04:46:18.321487+0000","last_peered":"2023-08-25T04:46:18.321487+0000","last_clean":"2023-08-25T04:46:18.321487+0000","last_became_active":"2023-08-25T04:43:42.894786+0000","last_became_peered":"2023-08-25T04:43:42.894786+0000","last_unstale":"2023-08-25T04:46:18.321487+0000","last_undegraded":"2023-08-25T04:46:18.321487+0000","last_fullsized":"2023-08-25T04:46:18.321487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'283","last_scrub_stamp":"2023-08-25T04:46:18.321394+0000","last_deep_scrub":"23'283","last_deep_scrub_stamp":"2023-08-25T04:46:18.321394+0000","last_clean_scrub_stamp":"2023-08-25T04:46:18.321394+0000","objects_scrubbed":1,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:57.751393+0000","scrub_duration":0.012244069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"23'244","reported_seq":261,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944607+0000","last_change":"2023-08-25T04:43:42.892793+0000","last_active":"2023-08-25T04:45:49.944607+0000","last_peered":"2023-08-25T04:45:49.944607+0000","last_clean":"2023-08-25T04:45:49.944607+0000","last_became_active":"2023-08-25T04:43:42.892558+0000","last_became_peered":"2023-08-25T04:43:42.892558+0000","last_unstale":"2023-08-25T04:45:49.944607+0000","last_undegraded":"2023-08-25T04:45:49.944607+0000","last_fullsized":"2023-08-25T04:45:49.944607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"23'260","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.103144+0000","last_change":"2023-08-25T04:45:57.103144+0000","last_active":"2023-08-25T04:45:57.103144+0000","last_peered":"2023-08-25T04:45:57.103144+0000","last_clean":"2023-08-25T04:45:57.103144+0000","last_became_active":"2023-08-25T04:43:42.891782+0000","last_became_peered":"2023-08-25T04:43:42.891782+0000","last_unstale":"2023-08-25T04:45:57.103144+0000","last_undegraded":"2023-08-25T04:45:57.103144+0000","last_fullsized":"2023-08-25T04:45:57.103144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'260","last_scrub_stamp":"2023-08-25T04:45:57.102967+0000","last_deep_scrub":"23'260","last_deep_scrub_stamp":"2023-08-25T04:45:57.102967+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.102967+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:11:20.262318+0000","scrub_duration":0.0024717099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'253","reported_seq":278,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.229483+0000","last_change":"2023-08-25T04:45:51.229483+0000","last_active":"2023-08-25T04:45:51.229483+0000","last_peered":"2023-08-25T04:45:51.229483+0000","last_clean":"2023-08-25T04:45:51.229483+0000","last_became_active":"2023-08-25T04:43:42.896334+0000","last_became_peered":"2023-08-25T04:43:42.896334+0000","last_unstale":"2023-08-25T04:45:51.229483+0000","last_undegraded":"2023-08-25T04:45:51.229483+0000","last_fullsized":"2023-08-25T04:45:51.229483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'253","last_scrub_stamp":"2023-08-25T04:45:51.229299+0000","last_deep_scrub":"23'253","last_deep_scrub_stamp":"2023-08-25T04:45:51.229299+0000","last_clean_scrub_stamp":"2023-08-25T04:45:51.229299+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:07:04.578619+0000","scrub_duration":0.001452009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'273","reported_seq":298,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:05.288862+0000","last_change":"2023-08-25T04:46:05.288910+0000","last_active":"2023-08-25T04:46:05.288862+0000","last_peered":"2023-08-25T04:46:05.288862+0000","last_clean":"2023-08-25T04:46:05.288862+0000","last_became_active":"2023-08-25T04:43:42.894472+0000","last_became_peered":"2023-08-25T04:43:42.894472+0000","last_unstale":"2023-08-25T04:46:05.288862+0000","last_undegraded":"2023-08-25T04:46:05.288862+0000","last_fullsized":"2023-08-25T04:46:05.288862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'273","last_scrub_stamp":"2023-08-25T04:46:05.288764+0000","last_deep_scrub":"23'273","last_deep_scrub_stamp":"2023-08-25T04:46:05.288764+0000","last_clean_scrub_stamp":"2023-08-25T04:46:05.288764+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:07.432282+0000","scrub_duration":0.0024051290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:28.267320+0000","last_change":"2023-08-25T04:46:28.267405+0000","last_active":"2023-08-25T04:46:28.267320+0000","last_peered":"2023-08-25T04:46:28.267320+0000","last_clean":"2023-08-25T04:46:28.267320+0000","last_became_active":"2023-08-25T04:43:42.902184+0000","last_became_peered":"2023-08-25T04:43:42.902184+0000","last_unstale":"2023-08-25T04:46:28.267320+0000","last_undegraded":"2023-08-25T04:46:28.267320+0000","last_fullsized":"2023-08-25T04:46:28.267320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:28.267186+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:28.267186+0000","last_clean_scrub_stamp":"2023-08-25T04:46:28.267186+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:21.363371+0000","scrub_duration":0.0021385200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"23'258","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:08.143464+0000","last_change":"2023-08-25T04:46:08.143515+0000","last_active":"2023-08-25T04:46:08.143464+0000","last_peered":"2023-08-25T04:46:08.143464+0000","last_clean":"2023-08-25T04:46:08.143464+0000","last_became_active":"2023-08-25T04:43:42.888730+0000","last_became_peered":"2023-08-25T04:43:42.888730+0000","last_unstale":"2023-08-25T04:46:08.143464+0000","last_undegraded":"2023-08-25T04:46:08.143464+0000","last_fullsized":"2023-08-25T04:46:08.143464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'258","last_scrub_stamp":"2023-08-25T04:46:08.143341+0000","last_deep_scrub":"23'258","last_deep_scrub_stamp":"2023-08-25T04:46:08.143341+0000","last_clean_scrub_stamp":"2023-08-25T04:46:08.143341+0000","objects_scrubbed":1,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:07.464282+0000","scrub_duration":0.0087248789999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:16.965802+0000","last_change":"2023-08-25T04:46:16.965855+0000","last_active":"2023-08-25T04:46:16.965802+0000","last_peered":"2023-08-25T04:46:16.965802+0000","last_clean":"2023-08-25T04:46:16.965802+0000","last_became_active":"2023-08-25T04:43:42.898103+0000","last_became_peered":"2023-08-25T04:43:42.898103+0000","last_unstale":"2023-08-25T04:46:16.965802+0000","last_undegraded":"2023-08-25T04:46:16.965802+0000","last_fullsized":"2023-08-25T04:46:16.965802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:16.965676+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:16.965676+0000","last_clean_scrub_stamp":"2023-08-25T04:46:16.965676+0000","objects_scrubbed":1,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:56.395676+0000","scrub_duration":0.0080171589999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'250","reported_seq":267,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944526+0000","last_change":"2023-08-25T04:43:42.892153+0000","last_active":"2023-08-25T04:45:49.944526+0000","last_peered":"2023-08-25T04:45:49.944526+0000","last_clean":"2023-08-25T04:45:49.944526+0000","last_became_active":"2023-08-25T04:43:42.891874+0000","last_became_peered":"2023-08-25T04:43:42.891874+0000","last_unstale":"2023-08-25T04:45:49.944526+0000","last_undegraded":"2023-08-25T04:45:49.944526+0000","last_fullsized":"2023-08-25T04:45:49.944526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"23'237","reported_seq":262,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.059523+0000","last_change":"2023-08-25T04:46:00.059576+0000","last_active":"2023-08-25T04:46:00.059523+0000","last_peered":"2023-08-25T04:46:00.059523+0000","last_clean":"2023-08-25T04:46:00.059523+0000","last_became_active":"2023-08-25T04:43:42.895114+0000","last_became_peered":"2023-08-25T04:43:42.895114+0000","last_unstale":"2023-08-25T04:46:00.059523+0000","last_undegraded":"2023-08-25T04:46:00.059523+0000","last_fullsized":"2023-08-25T04:46:00.059523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'237","last_scrub_stamp":"2023-08-25T04:46:00.059425+0000","last_deep_scrub":"23'237","last_deep_scrub_stamp":"2023-08-25T04:46:00.059425+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.059425+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:47:08.428439+0000","scrub_duration":0.0021392239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:02.208337+0000","last_change":"2023-08-25T04:46:02.208395+0000","last_active":"2023-08-25T04:46:02.208337+0000","last_peered":"2023-08-25T04:46:02.208337+0000","last_clean":"2023-08-25T04:46:02.208337+0000","last_became_active":"2023-08-25T04:43:42.895893+0000","last_became_peered":"2023-08-25T04:43:42.895893+0000","last_unstale":"2023-08-25T04:46:02.208337+0000","last_undegraded":"2023-08-25T04:46:02.208337+0000","last_fullsized":"2023-08-25T04:46:02.208337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:02.208224+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:02.208224+0000","last_clean_scrub_stamp":"2023-08-25T04:46:02.208224+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:28:50.652408+0000","scrub_duration":0.001791534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"23'266","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.515456+0000","last_change":"2023-08-25T04:43:42.905467+0000","last_active":"2023-08-25T04:45:51.515456+0000","last_peered":"2023-08-25T04:45:51.515456+0000","last_clean":"2023-08-25T04:45:51.515456+0000","last_became_active":"2023-08-25T04:43:42.905157+0000","last_became_peered":"2023-08-25T04:43:42.905157+0000","last_unstale":"2023-08-25T04:45:51.515456+0000","last_undegraded":"2023-08-25T04:45:51.515456+0000","last_fullsized":"2023-08-25T04:45:51.515456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"23'278","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.991834+0000","last_change":"2023-08-25T04:46:00.991883+0000","last_active":"2023-08-25T04:46:00.991834+0000","last_peered":"2023-08-25T04:46:00.991834+0000","last_clean":"2023-08-25T04:46:00.991834+0000","last_became_active":"2023-08-25T04:43:42.879881+0000","last_became_peered":"2023-08-25T04:43:42.879881+0000","last_unstale":"2023-08-25T04:46:00.991834+0000","last_undegraded":"2023-08-25T04:46:00.991834+0000","last_fullsized":"2023-08-25T04:46:00.991834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'278","last_scrub_stamp":"2023-08-25T04:46:00.991708+0000","last_deep_scrub":"23'278","last_deep_scrub_stamp":"2023-08-25T04:46:00.991708+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.991708+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:59:59.525971+0000","scrub_duration":0.001818802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'246","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.998363+0000","last_change":"2023-08-25T04:46:03.998431+0000","last_active":"2023-08-25T04:46:03.998363+0000","last_peered":"2023-08-25T04:46:03.998363+0000","last_clean":"2023-08-25T04:46:03.998363+0000","last_became_active":"2023-08-25T04:44:30.818308+0000","last_became_peered":"2023-08-25T04:44:30.818308+0000","last_unstale":"2023-08-25T04:46:03.998363+0000","last_undegraded":"2023-08-25T04:46:03.998363+0000","last_fullsized":"2023-08-25T04:46:03.998363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'246","last_scrub_stamp":"2023-08-25T04:46:03.998242+0000","last_deep_scrub":"23'246","last_deep_scrub_stamp":"2023-08-25T04:46:03.998242+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.998242+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:16:04.323429+0000","scrub_duration":0.001734148,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"23'239","reported_seq":264,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:26.177269+0000","last_change":"2023-08-25T04:46:26.177340+0000","last_active":"2023-08-25T04:46:26.177269+0000","last_peered":"2023-08-25T04:46:26.177269+0000","last_clean":"2023-08-25T04:46:26.177269+0000","last_became_active":"2023-08-25T04:43:42.896869+0000","last_became_peered":"2023-08-25T04:43:42.896869+0000","last_unstale":"2023-08-25T04:46:26.177269+0000","last_undegraded":"2023-08-25T04:46:26.177269+0000","last_fullsized":"2023-08-25T04:46:26.177269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'239","last_scrub_stamp":"2023-08-25T04:46:26.177136+0000","last_deep_scrub":"23'239","last_deep_scrub_stamp":"2023-08-25T04:46:26.177136+0000","last_clean_scrub_stamp":"2023-08-25T04:46:26.177136+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:12:10.015765+0000","scrub_duration":0.0022678490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"23'255","reported_seq":280,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:22.373816+0000","last_change":"2023-08-25T04:46:22.373866+0000","last_active":"2023-08-25T04:46:22.373816+0000","last_peered":"2023-08-25T04:46:22.373816+0000","last_clean":"2023-08-25T04:46:22.373816+0000","last_became_active":"2023-08-25T04:43:42.893673+0000","last_became_peered":"2023-08-25T04:43:42.893673+0000","last_unstale":"2023-08-25T04:46:22.373816+0000","last_undegraded":"2023-08-25T04:46:22.373816+0000","last_fullsized":"2023-08-25T04:46:22.373816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'255","last_scrub_stamp":"2023-08-25T04:46:22.373701+0000","last_deep_scrub":"23'255","last_deep_scrub_stamp":"2023-08-25T04:46:22.373701+0000","last_clean_scrub_stamp":"2023-08-25T04:46:22.373701+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:32:04.054159+0000","scrub_duration":0.0023847949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'274","reported_seq":299,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:10.405513+0000","last_change":"2023-08-25T04:46:10.405567+0000","last_active":"2023-08-25T04:46:10.405513+0000","last_peered":"2023-08-25T04:46:10.405513+0000","last_clean":"2023-08-25T04:46:10.405513+0000","last_became_active":"2023-08-25T04:43:42.887831+0000","last_became_peered":"2023-08-25T04:43:42.887831+0000","last_unstale":"2023-08-25T04:46:10.405513+0000","last_undegraded":"2023-08-25T04:46:10.405513+0000","last_fullsized":"2023-08-25T04:46:10.405513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'274","last_scrub_stamp":"2023-08-25T04:46:10.405391+0000","last_deep_scrub":"23'274","last_deep_scrub_stamp":"2023-08-25T04:46:10.405391+0000","last_clean_scrub_stamp":"2023-08-25T04:46:10.405391+0000","objects_scrubbed":2,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:08.939653+0000","scrub_duration":0.013184357000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'237","reported_seq":262,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:02.351329+0000","last_change":"2023-08-25T04:46:02.351387+0000","last_active":"2023-08-25T04:46:02.351329+0000","last_peered":"2023-08-25T04:46:02.351329+0000","last_clean":"2023-08-25T04:46:02.351329+0000","last_became_active":"2023-08-25T04:43:42.894302+0000","last_became_peered":"2023-08-25T04:43:42.894302+0000","last_unstale":"2023-08-25T04:46:02.351329+0000","last_undegraded":"2023-08-25T04:46:02.351329+0000","last_fullsized":"2023-08-25T04:46:02.351329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'237","last_scrub_stamp":"2023-08-25T04:46:02.351216+0000","last_deep_scrub":"23'237","last_deep_scrub_stamp":"2023-08-25T04:46:02.351216+0000","last_clean_scrub_stamp":"2023-08-25T04:46:02.351216+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:00.885478+0000","scrub_duration":0.0016876969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:23.209215+0000","last_change":"2023-08-25T04:46:23.209320+0000","last_active":"2023-08-25T04:46:23.209215+0000","last_peered":"2023-08-25T04:46:23.209215+0000","last_clean":"2023-08-25T04:46:23.209215+0000","last_became_active":"2023-08-25T04:43:41.888339+0000","last_became_peered":"2023-08-25T04:43:41.888339+0000","last_unstale":"2023-08-25T04:46:23.209215+0000","last_undegraded":"2023-08-25T04:46:23.209215+0000","last_fullsized":"2023-08-25T04:46:23.209215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-08-25T04:46:23.209085+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-08-25T04:46:23.209085+0000","last_clean_scrub_stamp":"2023-08-25T04:46:23.209085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:18.113873+0000","scrub_duration":0.0022365309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'271","reported_seq":288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.423259+0000","last_change":"2023-08-25T04:43:42.897739+0000","last_active":"2023-08-25T04:45:49.423259+0000","last_peered":"2023-08-25T04:45:49.423259+0000","last_clean":"2023-08-25T04:45:49.423259+0000","last_became_active":"2023-08-25T04:43:42.897425+0000","last_became_peered":"2023-08-25T04:43:42.897425+0000","last_unstale":"2023-08-25T04:45:49.423259+0000","last_undegraded":"2023-08-25T04:45:49.423259+0000","last_fullsized":"2023-08-25T04:45:49.423259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:08.410533+0000","last_change":"2023-08-25T04:46:08.410533+0000","last_active":"2023-08-25T04:46:08.410533+0000","last_peered":"2023-08-25T04:46:08.410533+0000","last_clean":"2023-08-25T04:46:08.410533+0000","last_became_active":"2023-08-25T04:43:41.885184+0000","last_became_peered":"2023-08-25T04:43:41.885184+0000","last_unstale":"2023-08-25T04:46:08.410533+0000","last_undegraded":"2023-08-25T04:46:08.410533+0000","last_fullsized":"2023-08-25T04:46:08.410533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:08.410308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:08.410308+0000","last_clean_scrub_stamp":"2023-08-25T04:46:08.410308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:17.174121+0000","scrub_duration":0.001705238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'291","reported_seq":316,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:21.972608+0000","last_change":"2023-08-25T04:46:21.972669+0000","last_active":"2023-08-25T04:46:21.972608+0000","last_peered":"2023-08-25T04:46:21.972608+0000","last_clean":"2023-08-25T04:46:21.972608+0000","last_became_active":"2023-08-25T04:43:42.890575+0000","last_became_peered":"2023-08-25T04:43:42.890575+0000","last_unstale":"2023-08-25T04:46:21.972608+0000","last_undegraded":"2023-08-25T04:46:21.972608+0000","last_fullsized":"2023-08-25T04:46:21.972608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'291","last_scrub_stamp":"2023-08-25T04:46:21.972508+0000","last_deep_scrub":"23'291","last_deep_scrub_stamp":"2023-08-25T04:46:21.972508+0000","last_clean_scrub_stamp":"2023-08-25T04:46:21.972508+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:25.669510+0000","scrub_duration":0.002317838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.805506+0000","last_change":"2023-08-25T04:45:52.805506+0000","last_active":"2023-08-25T04:45:52.805506+0000","last_peered":"2023-08-25T04:45:52.805506+0000","last_clean":"2023-08-25T04:45:52.805506+0000","last_became_active":"2023-08-25T04:43:41.885299+0000","last_became_peered":"2023-08-25T04:43:41.885299+0000","last_unstale":"2023-08-25T04:45:52.805506+0000","last_undegraded":"2023-08-25T04:45:52.805506+0000","last_fullsized":"2023-08-25T04:45:52.805506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:45:52.805353+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:45:52.805353+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.805353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:28.630344+0000","scrub_duration":0.0017761649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'269","reported_seq":294,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.678926+0000","last_change":"2023-08-25T04:46:03.678987+0000","last_active":"2023-08-25T04:46:03.678926+0000","last_peered":"2023-08-25T04:46:03.678926+0000","last_clean":"2023-08-25T04:46:03.678926+0000","last_became_active":"2023-08-25T04:43:42.898874+0000","last_became_peered":"2023-08-25T04:43:42.898874+0000","last_unstale":"2023-08-25T04:46:03.678926+0000","last_undegraded":"2023-08-25T04:46:03.678926+0000","last_fullsized":"2023-08-25T04:46:03.678926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'269","last_scrub_stamp":"2023-08-25T04:46:03.678818+0000","last_deep_scrub":"23'269","last_deep_scrub_stamp":"2023-08-25T04:46:03.678818+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.678818+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:44.606031+0000","scrub_duration":0.0016713940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.002914+0000","last_change":"2023-08-25T04:46:00.002914+0000","last_active":"2023-08-25T04:46:00.002914+0000","last_peered":"2023-08-25T04:46:00.002914+0000","last_clean":"2023-08-25T04:46:00.002914+0000","last_became_active":"2023-08-25T04:43:41.882381+0000","last_became_peered":"2023-08-25T04:43:41.882381+0000","last_unstale":"2023-08-25T04:46:00.002914+0000","last_undegraded":"2023-08-25T04:46:00.002914+0000","last_fullsized":"2023-08-25T04:46:00.002914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:46:00.002750+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:46:00.002750+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.002750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:35.827741+0000","scrub_duration":0.0019692830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'262","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:20.224044+0000","last_change":"2023-08-25T04:46:20.224100+0000","last_active":"2023-08-25T04:46:20.224044+0000","last_peered":"2023-08-25T04:46:20.224044+0000","last_clean":"2023-08-25T04:46:20.224044+0000","last_became_active":"2023-08-25T04:44:30.481273+0000","last_became_peered":"2023-08-25T04:44:30.481273+0000","last_unstale":"2023-08-25T04:46:20.224044+0000","last_undegraded":"2023-08-25T04:46:20.224044+0000","last_fullsized":"2023-08-25T04:46:20.224044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'262","last_scrub_stamp":"2023-08-25T04:46:20.223925+0000","last_deep_scrub":"23'262","last_deep_scrub_stamp":"2023-08-25T04:46:20.223925+0000","last_clean_scrub_stamp":"2023-08-25T04:46:20.223925+0000","objects_scrubbed":1,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:35:24.382164+0000","scrub_duration":0.0097733969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.353165+0000","last_change":"2023-08-25T04:46:01.353165+0000","last_active":"2023-08-25T04:46:01.353165+0000","last_peered":"2023-08-25T04:46:01.353165+0000","last_clean":"2023-08-25T04:46:01.353165+0000","last_became_active":"2023-08-25T04:43:41.882055+0000","last_became_peered":"2023-08-25T04:43:41.882055+0000","last_unstale":"2023-08-25T04:46:01.353165+0000","last_undegraded":"2023-08-25T04:46:01.353165+0000","last_fullsized":"2023-08-25T04:46:01.353165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:01.352985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:01.352985+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.352985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:37.177976+0000","scrub_duration":0.001474939,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"23'269","reported_seq":294,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:18.181975+0000","last_change":"2023-08-25T04:46:18.182082+0000","last_active":"2023-08-25T04:46:18.181975+0000","last_peered":"2023-08-25T04:46:18.181975+0000","last_clean":"2023-08-25T04:46:18.181975+0000","last_became_active":"2023-08-25T04:43:42.890100+0000","last_became_peered":"2023-08-25T04:43:42.890100+0000","last_unstale":"2023-08-25T04:46:18.181975+0000","last_undegraded":"2023-08-25T04:46:18.181975+0000","last_fullsized":"2023-08-25T04:46:18.181975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'269","last_scrub_stamp":"2023-08-25T04:46:18.181858+0000","last_deep_scrub":"23'269","last_deep_scrub_stamp":"2023-08-25T04:46:18.181858+0000","last_clean_scrub_stamp":"2023-08-25T04:46:18.181858+0000","objects_scrubbed":1,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:21.878859+0000","scrub_duration":0.010619290999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'14","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:16.038350+0000","last_change":"2023-08-25T04:46:16.038435+0000","last_active":"2023-08-25T04:46:16.038350+0000","last_peered":"2023-08-25T04:46:16.038350+0000","last_clean":"2023-08-25T04:46:16.038350+0000","last_became_active":"2023-08-25T04:43:41.887622+0000","last_became_peered":"2023-08-25T04:43:41.887622+0000","last_unstale":"2023-08-25T04:46:16.038350+0000","last_undegraded":"2023-08-25T04:46:16.038350+0000","last_fullsized":"2023-08-25T04:46:16.038350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2023-08-25T04:46:16.038244+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2023-08-25T04:46:16.038244+0000","last_clean_scrub_stamp":"2023-08-25T04:46:16.038244+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:55.468243+0000","scrub_duration":0.0038245340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"23'273","reported_seq":298,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:21.375329+0000","last_change":"2023-08-25T04:46:21.375408+0000","last_active":"2023-08-25T04:46:21.375329+0000","last_peered":"2023-08-25T04:46:21.375329+0000","last_clean":"2023-08-25T04:46:21.375329+0000","last_became_active":"2023-08-25T04:43:42.890648+0000","last_became_peered":"2023-08-25T04:43:42.890648+0000","last_unstale":"2023-08-25T04:46:21.375329+0000","last_undegraded":"2023-08-25T04:46:21.375329+0000","last_fullsized":"2023-08-25T04:46:21.375329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'273","last_scrub_stamp":"2023-08-25T04:46:21.375181+0000","last_deep_scrub":"23'273","last_deep_scrub_stamp":"2023-08-25T04:46:21.375181+0000","last_clean_scrub_stamp":"2023-08-25T04:46:21.375181+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:15.079856+0000","scrub_duration":0.002419259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'388","reported_seq":415,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:17.068231+0000","last_change":"2023-08-25T04:46:17.068287+0000","last_active":"2023-08-25T04:46:17.068231+0000","last_peered":"2023-08-25T04:46:17.068231+0000","last_clean":"2023-08-25T04:46:17.068231+0000","last_became_active":"2023-08-25T04:43:41.886491+0000","last_became_peered":"2023-08-25T04:43:41.886491+0000","last_unstale":"2023-08-25T04:46:17.068231+0000","last_undegraded":"2023-08-25T04:46:17.068231+0000","last_fullsized":"2023-08-25T04:46:17.068231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'388","last_scrub_stamp":"2023-08-25T04:46:17.068129+0000","last_deep_scrub":"23'388","last_deep_scrub_stamp":"2023-08-25T04:46:17.068129+0000","last_clean_scrub_stamp":"2023-08-25T04:46:17.068129+0000","objects_scrubbed":4,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:10.164314+0000","scrub_duration":0.0091339360000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1510889,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":385,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"23'297","reported_seq":314,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944486+0000","last_change":"2023-08-25T04:43:42.893709+0000","last_active":"2023-08-25T04:45:49.944486+0000","last_peered":"2023-08-25T04:45:49.944486+0000","last_clean":"2023-08-25T04:45:49.944486+0000","last_became_active":"2023-08-25T04:43:42.893525+0000","last_became_peered":"2023-08-25T04:43:42.893525+0000","last_unstale":"2023-08-25T04:45:49.944486+0000","last_undegraded":"2023-08-25T04:45:49.944486+0000","last_fullsized":"2023-08-25T04:45:49.944486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'5","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:10.209723+0000","last_change":"2023-08-25T04:46:10.209775+0000","last_active":"2023-08-25T04:46:10.209723+0000","last_peered":"2023-08-25T04:46:10.209723+0000","last_clean":"2023-08-25T04:46:10.209723+0000","last_became_active":"2023-08-25T04:43:41.890673+0000","last_became_peered":"2023-08-25T04:43:41.890673+0000","last_unstale":"2023-08-25T04:46:10.209723+0000","last_undegraded":"2023-08-25T04:46:10.209723+0000","last_fullsized":"2023-08-25T04:46:10.209723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2023-08-25T04:46:10.209611+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2023-08-25T04:46:10.209611+0000","last_clean_scrub_stamp":"2023-08-25T04:46:10.209611+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:03.914286+0000","scrub_duration":0.0034207019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"23'270","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:23.191356+0000","last_change":"2023-08-25T04:46:23.191414+0000","last_active":"2023-08-25T04:46:23.191356+0000","last_peered":"2023-08-25T04:46:23.191356+0000","last_clean":"2023-08-25T04:46:23.191356+0000","last_became_active":"2023-08-25T04:43:42.897204+0000","last_became_peered":"2023-08-25T04:43:42.897204+0000","last_unstale":"2023-08-25T04:46:23.191356+0000","last_undegraded":"2023-08-25T04:46:23.191356+0000","last_fullsized":"2023-08-25T04:46:23.191356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'270","last_scrub_stamp":"2023-08-25T04:46:23.191215+0000","last_deep_scrub":"23'270","last_deep_scrub_stamp":"2023-08-25T04:46:23.191215+0000","last_clean_scrub_stamp":"2023-08-25T04:46:23.191215+0000","objects_scrubbed":1,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:16.287401+0000","scrub_duration":0.0084130279999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.983964+0000","last_change":"2023-08-25T04:45:52.983964+0000","last_active":"2023-08-25T04:45:52.983964+0000","last_peered":"2023-08-25T04:45:52.983964+0000","last_clean":"2023-08-25T04:45:52.983964+0000","last_became_active":"2023-08-25T04:43:41.881067+0000","last_became_peered":"2023-08-25T04:43:41.881067+0000","last_unstale":"2023-08-25T04:45:52.983964+0000","last_undegraded":"2023-08-25T04:45:52.983964+0000","last_fullsized":"2023-08-25T04:45:52.983964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:52.983794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:52.983794+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.983794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:28:30.719694+0000","scrub_duration":0.0024229049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'253","reported_seq":278,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:13.249412+0000","last_change":"2023-08-25T04:46:13.249462+0000","last_active":"2023-08-25T04:46:13.249412+0000","last_peered":"2023-08-25T04:46:13.249412+0000","last_clean":"2023-08-25T04:46:13.249412+0000","last_became_active":"2023-08-25T04:43:42.894807+0000","last_became_peered":"2023-08-25T04:43:42.894807+0000","last_unstale":"2023-08-25T04:46:13.249412+0000","last_undegraded":"2023-08-25T04:46:13.249412+0000","last_fullsized":"2023-08-25T04:46:13.249412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'253","last_scrub_stamp":"2023-08-25T04:46:13.249311+0000","last_deep_scrub":"23'253","last_deep_scrub_stamp":"2023-08-25T04:46:13.249311+0000","last_clean_scrub_stamp":"2023-08-25T04:46:13.249311+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:06.953986+0000","scrub_duration":0.001625549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:11.159065+0000","last_change":"2023-08-25T04:46:11.159117+0000","last_active":"2023-08-25T04:46:11.159065+0000","last_peered":"2023-08-25T04:46:11.159065+0000","last_clean":"2023-08-25T04:46:11.159065+0000","last_became_active":"2023-08-25T04:43:41.890706+0000","last_became_peered":"2023-08-25T04:43:41.890706+0000","last_unstale":"2023-08-25T04:46:11.159065+0000","last_undegraded":"2023-08-25T04:46:11.159065+0000","last_fullsized":"2023-08-25T04:46:11.159065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:46:11.158932+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:46:11.158932+0000","last_clean_scrub_stamp":"2023-08-25T04:46:11.158932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:52.839390+0000","scrub_duration":0.0015778840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"23'288","reported_seq":313,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:11.944082+0000","last_change":"2023-08-25T04:46:11.944161+0000","last_active":"2023-08-25T04:46:11.944082+0000","last_peered":"2023-08-25T04:46:11.944082+0000","last_clean":"2023-08-25T04:46:11.944082+0000","last_became_active":"2023-08-25T04:43:42.897476+0000","last_became_peered":"2023-08-25T04:43:42.897476+0000","last_unstale":"2023-08-25T04:46:11.944082+0000","last_undegraded":"2023-08-25T04:46:11.944082+0000","last_fullsized":"2023-08-25T04:46:11.944082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'288","last_scrub_stamp":"2023-08-25T04:46:11.943899+0000","last_deep_scrub":"23'288","last_deep_scrub_stamp":"2023-08-25T04:46:11.943899+0000","last_clean_scrub_stamp":"2023-08-25T04:46:11.943899+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:05.648574+0000","scrub_duration":0.0021087810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'12","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:58.712516+0000","last_change":"2023-08-25T04:45:58.712516+0000","last_active":"2023-08-25T04:45:58.712516+0000","last_peered":"2023-08-25T04:45:58.712516+0000","last_clean":"2023-08-25T04:45:58.712516+0000","last_became_active":"2023-08-25T04:43:41.892517+0000","last_became_peered":"2023-08-25T04:43:41.892517+0000","last_unstale":"2023-08-25T04:45:58.712516+0000","last_undegraded":"2023-08-25T04:45:58.712516+0000","last_fullsized":"2023-08-25T04:45:58.712516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2023-08-25T04:45:58.712345+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2023-08-25T04:45:58.712345+0000","last_clean_scrub_stamp":"2023-08-25T04:45:58.712345+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:37:12.386852+0000","scrub_duration":0.0051496449999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"23'268","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.423312+0000","last_change":"2023-08-25T04:43:42.905276+0000","last_active":"2023-08-25T04:45:49.423312+0000","last_peered":"2023-08-25T04:45:49.423312+0000","last_clean":"2023-08-25T04:45:49.423312+0000","last_became_active":"2023-08-25T04:43:42.904736+0000","last_became_peered":"2023-08-25T04:43:42.904736+0000","last_unstale":"2023-08-25T04:45:49.423312+0000","last_undegraded":"2023-08-25T04:45:49.423312+0000","last_fullsized":"2023-08-25T04:45:49.423312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:24.138150+0000","last_change":"2023-08-25T04:46:24.138227+0000","last_active":"2023-08-25T04:46:24.138150+0000","last_peered":"2023-08-25T04:46:24.138150+0000","last_clean":"2023-08-25T04:46:24.138150+0000","last_became_active":"2023-08-25T04:43:41.890942+0000","last_became_peered":"2023-08-25T04:43:41.890942+0000","last_unstale":"2023-08-25T04:46:24.138150+0000","last_undegraded":"2023-08-25T04:46:24.138150+0000","last_fullsized":"2023-08-25T04:46:24.138150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-08-25T04:46:24.138037+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-08-25T04:46:24.138037+0000","last_clean_scrub_stamp":"2023-08-25T04:46:24.138037+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:27.835038+0000","scrub_duration":0.003479546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"23'238","reported_seq":263,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:14.281547+0000","last_change":"2023-08-25T04:46:14.281593+0000","last_active":"2023-08-25T04:46:14.281547+0000","last_peered":"2023-08-25T04:46:14.281547+0000","last_clean":"2023-08-25T04:46:14.281547+0000","last_became_active":"2023-08-25T04:43:42.894285+0000","last_became_peered":"2023-08-25T04:43:42.894285+0000","last_unstale":"2023-08-25T04:46:14.281547+0000","last_undegraded":"2023-08-25T04:46:14.281547+0000","last_fullsized":"2023-08-25T04:46:14.281547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'238","last_scrub_stamp":"2023-08-25T04:46:14.281430+0000","last_deep_scrub":"23'238","last_deep_scrub_stamp":"2023-08-25T04:46:14.281430+0000","last_clean_scrub_stamp":"2023-08-25T04:46:14.281430+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:55.961888+0000","scrub_duration":0.0016190309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'3","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:15.085333+0000","last_change":"2023-08-25T04:46:15.085384+0000","last_active":"2023-08-25T04:46:15.085333+0000","last_peered":"2023-08-25T04:46:15.085333+0000","last_clean":"2023-08-25T04:46:15.085333+0000","last_became_active":"2023-08-25T04:43:41.890883+0000","last_became_peered":"2023-08-25T04:43:41.890883+0000","last_unstale":"2023-08-25T04:46:15.085333+0000","last_undegraded":"2023-08-25T04:46:15.085333+0000","last_fullsized":"2023-08-25T04:46:15.085333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-08-25T04:46:15.085227+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-08-25T04:46:15.085227+0000","last_clean_scrub_stamp":"2023-08-25T04:46:15.085227+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:22.671025+0000","scrub_duration":0.0028661110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"23'265","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944660+0000","last_change":"2023-08-25T04:43:42.891686+0000","last_active":"2023-08-25T04:45:49.944660+0000","last_peered":"2023-08-25T04:45:49.944660+0000","last_clean":"2023-08-25T04:45:49.944660+0000","last_became_active":"2023-08-25T04:43:42.891443+0000","last_became_peered":"2023-08-25T04:43:42.891443+0000","last_unstale":"2023-08-25T04:45:49.944660+0000","last_undegraded":"2023-08-25T04:45:49.944660+0000","last_fullsized":"2023-08-25T04:45:49.944660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:02.258330+0000","last_change":"2023-08-25T04:46:02.258387+0000","last_active":"2023-08-25T04:46:02.258330+0000","last_peered":"2023-08-25T04:46:02.258330+0000","last_clean":"2023-08-25T04:46:02.258330+0000","last_became_active":"2023-08-25T04:43:41.888447+0000","last_became_peered":"2023-08-25T04:43:41.888447+0000","last_unstale":"2023-08-25T04:46:02.258330+0000","last_undegraded":"2023-08-25T04:46:02.258330+0000","last_fullsized":"2023-08-25T04:46:02.258330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-08-25T04:46:02.258220+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-08-25T04:46:02.258220+0000","last_clean_scrub_stamp":"2023-08-25T04:46:02.258220+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:50.337360+0000","scrub_duration":0.0030581060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"23'270","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.667962+0000","last_change":"2023-08-25T04:46:00.668030+0000","last_active":"2023-08-25T04:46:00.667962+0000","last_peered":"2023-08-25T04:46:00.667962+0000","last_clean":"2023-08-25T04:46:00.667962+0000","last_became_active":"2023-08-25T04:43:42.892191+0000","last_became_peered":"2023-08-25T04:43:42.892191+0000","last_unstale":"2023-08-25T04:46:00.667962+0000","last_undegraded":"2023-08-25T04:46:00.667962+0000","last_fullsized":"2023-08-25T04:46:00.667962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'270","last_scrub_stamp":"2023-08-25T04:46:00.667852+0000","last_deep_scrub":"23'270","last_deep_scrub_stamp":"2023-08-25T04:46:00.667852+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.667852+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:25:37.904637+0000","scrub_duration":0.002178714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:54.495493+0000","last_change":"2023-08-25T04:45:54.495493+0000","last_active":"2023-08-25T04:45:54.495493+0000","last_peered":"2023-08-25T04:45:54.495493+0000","last_clean":"2023-08-25T04:45:54.495493+0000","last_became_active":"2023-08-25T04:43:41.884098+0000","last_became_peered":"2023-08-25T04:43:41.884098+0000","last_unstale":"2023-08-25T04:45:54.495493+0000","last_undegraded":"2023-08-25T04:45:54.495493+0000","last_fullsized":"2023-08-25T04:45:54.495493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:45:54.495284+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:45:54.495284+0000","last_clean_scrub_stamp":"2023-08-25T04:45:54.495284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:35.422497+0000","scrub_duration":0.0022346089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"23'270","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:18.981074+0000","last_change":"2023-08-25T04:46:18.981133+0000","last_active":"2023-08-25T04:46:18.981074+0000","last_peered":"2023-08-25T04:46:18.981074+0000","last_clean":"2023-08-25T04:46:18.981074+0000","last_became_active":"2023-08-25T04:43:42.880104+0000","last_became_peered":"2023-08-25T04:43:42.880104+0000","last_unstale":"2023-08-25T04:46:18.981074+0000","last_undegraded":"2023-08-25T04:46:18.981074+0000","last_fullsized":"2023-08-25T04:46:18.981074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'270","last_scrub_stamp":"2023-08-25T04:46:18.980949+0000","last_deep_scrub":"23'270","last_deep_scrub_stamp":"2023-08-25T04:46:18.980949+0000","last_clean_scrub_stamp":"2023-08-25T04:46:18.980949+0000","objects_scrubbed":1,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:18.301890+0000","scrub_duration":0.0082879540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'5","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.831129+0000","last_change":"2023-08-25T04:45:57.831129+0000","last_active":"2023-08-25T04:45:57.831129+0000","last_peered":"2023-08-25T04:45:57.831129+0000","last_clean":"2023-08-25T04:45:57.831129+0000","last_became_active":"2023-08-25T04:43:41.885433+0000","last_became_peered":"2023-08-25T04:43:41.885433+0000","last_unstale":"2023-08-25T04:45:57.831129+0000","last_undegraded":"2023-08-25T04:45:57.831129+0000","last_fullsized":"2023-08-25T04:45:57.831129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2023-08-25T04:45:57.830944+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2023-08-25T04:45:57.830944+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.830944+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:45.910084+0000","scrub_duration":0.0028335420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'243","reported_seq":260,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944457+0000","last_change":"2023-08-25T04:43:42.896701+0000","last_active":"2023-08-25T04:45:49.944457+0000","last_peered":"2023-08-25T04:45:49.944457+0000","last_clean":"2023-08-25T04:45:49.944457+0000","last_became_active":"2023-08-25T04:43:42.896440+0000","last_became_peered":"2023-08-25T04:43:42.896440+0000","last_unstale":"2023-08-25T04:45:49.944457+0000","last_undegraded":"2023-08-25T04:45:49.944457+0000","last_fullsized":"2023-08-25T04:45:49.944457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.718106+0000","last_change":"2023-08-25T04:45:57.718160+0000","last_active":"2023-08-25T04:45:57.718106+0000","last_peered":"2023-08-25T04:45:57.718106+0000","last_clean":"2023-08-25T04:45:57.718106+0000","last_became_active":"2023-08-25T04:43:41.890827+0000","last_became_peered":"2023-08-25T04:43:41.890827+0000","last_unstale":"2023-08-25T04:45:57.718106+0000","last_undegraded":"2023-08-25T04:45:57.718106+0000","last_fullsized":"2023-08-25T04:45:57.718106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:45:57.717976+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:45:57.717976+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.717976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:15:58.043163+0000","scrub_duration":0.0018100639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"23'288","reported_seq":305,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944535+0000","last_change":"2023-08-25T04:43:42.897377+0000","last_active":"2023-08-25T04:45:49.944535+0000","last_peered":"2023-08-25T04:45:49.944535+0000","last_clean":"2023-08-25T04:45:49.944535+0000","last_became_active":"2023-08-25T04:43:42.897108+0000","last_became_peered":"2023-08-25T04:43:42.897108+0000","last_unstale":"2023-08-25T04:45:49.944535+0000","last_undegraded":"2023-08-25T04:45:49.944535+0000","last_fullsized":"2023-08-25T04:45:49.944535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:14.033833+0000","last_change":"2023-08-25T04:46:14.033900+0000","last_active":"2023-08-25T04:46:14.033833+0000","last_peered":"2023-08-25T04:46:14.033833+0000","last_clean":"2023-08-25T04:46:14.033833+0000","last_became_active":"2023-08-25T04:43:41.888323+0000","last_became_peered":"2023-08-25T04:43:41.888323+0000","last_unstale":"2023-08-25T04:46:14.033833+0000","last_undegraded":"2023-08-25T04:46:14.033833+0000","last_fullsized":"2023-08-25T04:46:14.033833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:14.033678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:14.033678+0000","last_clean_scrub_stamp":"2023-08-25T04:46:14.033678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:35:18.191917+0000","scrub_duration":0.0021053500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"23'285","reported_seq":310,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:04.217438+0000","last_change":"2023-08-25T04:46:04.217487+0000","last_active":"2023-08-25T04:46:04.217438+0000","last_peered":"2023-08-25T04:46:04.217438+0000","last_clean":"2023-08-25T04:46:04.217438+0000","last_became_active":"2023-08-25T04:43:42.896943+0000","last_became_peered":"2023-08-25T04:43:42.896943+0000","last_unstale":"2023-08-25T04:46:04.217438+0000","last_undegraded":"2023-08-25T04:46:04.217438+0000","last_fullsized":"2023-08-25T04:46:04.217438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'285","last_scrub_stamp":"2023-08-25T04:46:04.217330+0000","last_deep_scrub":"23'285","last_deep_scrub_stamp":"2023-08-25T04:46:04.217330+0000","last_clean_scrub_stamp":"2023-08-25T04:46:04.217330+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:11.803128+0000","scrub_duration":0.0016762509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:15.146036+0000","last_change":"2023-08-25T04:46:15.146082+0000","last_active":"2023-08-25T04:46:15.146036+0000","last_peered":"2023-08-25T04:46:15.146036+0000","last_clean":"2023-08-25T04:46:15.146036+0000","last_became_active":"2023-08-25T04:43:41.886846+0000","last_became_peered":"2023-08-25T04:43:41.886846+0000","last_unstale":"2023-08-25T04:46:15.146036+0000","last_undegraded":"2023-08-25T04:46:15.146036+0000","last_fullsized":"2023-08-25T04:46:15.146036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:15.145931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:15.145931+0000","last_clean_scrub_stamp":"2023-08-25T04:46:15.145931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:14.466872+0000","scrub_duration":0.001480068,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'280","reported_seq":305,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:26.413514+0000","last_change":"2023-08-25T04:46:26.413581+0000","last_active":"2023-08-25T04:46:26.413514+0000","last_peered":"2023-08-25T04:46:26.413514+0000","last_clean":"2023-08-25T04:46:26.413514+0000","last_became_active":"2023-08-25T04:43:42.902123+0000","last_became_peered":"2023-08-25T04:43:42.902123+0000","last_unstale":"2023-08-25T04:46:26.413514+0000","last_undegraded":"2023-08-25T04:46:26.413514+0000","last_fullsized":"2023-08-25T04:46:26.413514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'280","last_scrub_stamp":"2023-08-25T04:46:26.413389+0000","last_deep_scrub":"23'280","last_deep_scrub_stamp":"2023-08-25T04:46:26.413389+0000","last_clean_scrub_stamp":"2023-08-25T04:46:26.413389+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:06:05.843388+0000","scrub_duration":0.0016787550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'4","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:06.992606+0000","last_change":"2023-08-25T04:46:06.992658+0000","last_active":"2023-08-25T04:46:06.992606+0000","last_peered":"2023-08-25T04:46:06.992606+0000","last_clean":"2023-08-25T04:46:06.992606+0000","last_became_active":"2023-08-25T04:43:41.882776+0000","last_became_peered":"2023-08-25T04:43:41.882776+0000","last_unstale":"2023-08-25T04:46:06.992606+0000","last_undegraded":"2023-08-25T04:46:06.992606+0000","last_fullsized":"2023-08-25T04:46:06.992606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2023-08-25T04:46:06.992500+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2023-08-25T04:46:06.992500+0000","last_clean_scrub_stamp":"2023-08-25T04:46:06.992500+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:48.672959+0000","scrub_duration":0.0035735530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:13.079069+0000","last_change":"2023-08-25T04:46:13.079120+0000","last_active":"2023-08-25T04:46:13.079069+0000","last_peered":"2023-08-25T04:46:13.079069+0000","last_clean":"2023-08-25T04:46:13.079069+0000","last_became_active":"2023-08-25T04:43:36.785725+0000","last_became_peered":"2023-08-25T04:43:36.785725+0000","last_unstale":"2023-08-25T04:46:13.079069+0000","last_undegraded":"2023-08-25T04:46:13.079069+0000","last_fullsized":"2023-08-25T04:46:13.079069+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:13.078953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:13.078953+0000","last_clean_scrub_stamp":"2023-08-25T04:46:13.078953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:16.775955+0000","scrub_duration":0.0021933959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"23'254","reported_seq":279,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:16.169561+0000","last_change":"2023-08-25T04:46:16.169612+0000","last_active":"2023-08-25T04:46:16.169561+0000","last_peered":"2023-08-25T04:46:16.169561+0000","last_clean":"2023-08-25T04:46:16.169561+0000","last_became_active":"2023-08-25T04:43:42.889721+0000","last_became_peered":"2023-08-25T04:43:42.889721+0000","last_unstale":"2023-08-25T04:46:16.169561+0000","last_undegraded":"2023-08-25T04:46:16.169561+0000","last_fullsized":"2023-08-25T04:46:16.169561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'254","last_scrub_stamp":"2023-08-25T04:46:16.169445+0000","last_deep_scrub":"23'254","last_deep_scrub_stamp":"2023-08-25T04:46:16.169445+0000","last_clean_scrub_stamp":"2023-08-25T04:46:16.169445+0000","objects_scrubbed":1,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:16:29.603610+0000","scrub_duration":0.0096788659999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:50.725288+0000","last_change":"2023-08-25T04:45:50.725366+0000","last_active":"2023-08-25T04:45:50.725288+0000","last_peered":"2023-08-25T04:45:50.725288+0000","last_clean":"2023-08-25T04:45:50.725288+0000","last_became_active":"2023-08-25T04:43:36.782680+0000","last_became_peered":"2023-08-25T04:43:36.782680+0000","last_unstale":"2023-08-25T04:45:50.725288+0000","last_undegraded":"2023-08-25T04:45:50.725288+0000","last_fullsized":"2023-08-25T04:45:50.725288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:50.725133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:50.725133+0000","last_clean_scrub_stamp":"2023-08-25T04:45:50.725133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:59.488947+0000","scrub_duration":0.0018703929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'10","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:56.942806+0000","last_change":"2023-08-25T04:45:56.942911+0000","last_active":"2023-08-25T04:45:56.942806+0000","last_peered":"2023-08-25T04:45:56.942806+0000","last_clean":"2023-08-25T04:45:56.942806+0000","last_became_active":"2023-08-25T04:43:41.885363+0000","last_became_peered":"2023-08-25T04:43:41.885363+0000","last_unstale":"2023-08-25T04:45:56.942806+0000","last_undegraded":"2023-08-25T04:45:56.942806+0000","last_fullsized":"2023-08-25T04:45:56.942806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2023-08-25T04:45:56.942677+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2023-08-25T04:45:56.942677+0000","last_clean_scrub_stamp":"2023-08-25T04:45:56.942677+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:57:56.907128+0000","scrub_duration":0.002126574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'246","reported_seq":271,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:28.159508+0000","last_change":"2023-08-25T04:46:28.159573+0000","last_active":"2023-08-25T04:46:28.159508+0000","last_peered":"2023-08-25T04:46:28.159508+0000","last_clean":"2023-08-25T04:46:28.159508+0000","last_became_active":"2023-08-25T04:43:42.898942+0000","last_became_peered":"2023-08-25T04:43:42.898942+0000","last_unstale":"2023-08-25T04:46:28.159508+0000","last_undegraded":"2023-08-25T04:46:28.159508+0000","last_fullsized":"2023-08-25T04:46:28.159508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'246","last_scrub_stamp":"2023-08-25T04:46:28.159368+0000","last_deep_scrub":"23'246","last_deep_scrub_stamp":"2023-08-25T04:46:28.159368+0000","last_clean_scrub_stamp":"2023-08-25T04:46:28.159368+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:18:53.143904+0000","scrub_duration":0.001848113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.283941+0000","last_change":"2023-08-25T04:46:00.284036+0000","last_active":"2023-08-25T04:46:00.283941+0000","last_peered":"2023-08-25T04:46:00.283941+0000","last_clean":"2023-08-25T04:46:00.283941+0000","last_became_active":"2023-08-25T04:43:36.784937+0000","last_became_peered":"2023-08-25T04:43:36.784937+0000","last_unstale":"2023-08-25T04:46:00.283941+0000","last_undegraded":"2023-08-25T04:46:00.283941+0000","last_fullsized":"2023-08-25T04:46:00.283941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:00.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:00.283816+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:41.211029+0000","scrub_duration":0.001807915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"23'119","reported_seq":185,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:53.220629+0000","last_change":"2023-08-25T04:45:53.220691+0000","last_active":"2023-08-25T04:45:53.220629+0000","last_peered":"2023-08-25T04:45:53.220629+0000","last_clean":"2023-08-25T04:45:53.220629+0000","last_became_active":"2023-08-25T04:43:36.785451+0000","last_became_peered":"2023-08-25T04:43:36.785451+0000","last_unstale":"2023-08-25T04:45:53.220629+0000","last_undegraded":"2023-08-25T04:45:53.220629+0000","last_fullsized":"2023-08-25T04:45:53.220629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2023-08-25T04:45:53.220526+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2023-08-25T04:45:53.220526+0000","last_clean_scrub_stamp":"2023-08-25T04:45:53.220526+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:57:53.184978+0000","scrub_duration":0.00569083,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'14","reported_seq":54,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:50.919372+0000","last_change":"2023-08-25T04:45:50.919443+0000","last_active":"2023-08-25T04:45:50.919372+0000","last_peered":"2023-08-25T04:45:50.919372+0000","last_clean":"2023-08-25T04:45:50.919372+0000","last_became_active":"2023-08-25T04:43:41.885029+0000","last_became_peered":"2023-08-25T04:43:41.885029+0000","last_unstale":"2023-08-25T04:45:50.919372+0000","last_undegraded":"2023-08-25T04:45:50.919372+0000","last_fullsized":"2023-08-25T04:45:50.919372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2023-08-25T04:45:50.919257+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2023-08-25T04:45:50.919257+0000","last_clean_scrub_stamp":"2023-08-25T04:45:50.919257+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:18.289019+0000","scrub_duration":0.002121202,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7272,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":13,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'275","reported_seq":300,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:12.984470+0000","last_change":"2023-08-25T04:46:12.984547+0000","last_active":"2023-08-25T04:46:12.984470+0000","last_peered":"2023-08-25T04:46:12.984470+0000","last_clean":"2023-08-25T04:46:12.984470+0000","last_became_active":"2023-08-25T04:43:42.880591+0000","last_became_peered":"2023-08-25T04:43:42.880591+0000","last_unstale":"2023-08-25T04:46:12.984470+0000","last_undegraded":"2023-08-25T04:46:12.984470+0000","last_fullsized":"2023-08-25T04:46:12.984470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'275","last_scrub_stamp":"2023-08-25T04:46:12.984338+0000","last_deep_scrub":"23'275","last_deep_scrub_stamp":"2023-08-25T04:46:12.984338+0000","last_clean_scrub_stamp":"2023-08-25T04:46:12.984338+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:54.664796+0000","scrub_duration":0.001898091,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.160820+0000","last_change":"2023-08-25T04:45:57.160870+0000","last_active":"2023-08-25T04:45:57.160820+0000","last_peered":"2023-08-25T04:45:57.160820+0000","last_clean":"2023-08-25T04:45:57.160820+0000","last_became_active":"2023-08-25T04:43:37.192594+0000","last_became_peered":"2023-08-25T04:43:37.192594+0000","last_unstale":"2023-08-25T04:45:57.160820+0000","last_undegraded":"2023-08-25T04:45:57.160820+0000","last_fullsized":"2023-08-25T04:45:57.160820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:57.160708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:57.160708+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.160708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:32.985699+0000","scrub_duration":0.0019998730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.362033+0000","last_change":"2023-08-25T04:46:03.362124+0000","last_active":"2023-08-25T04:46:03.362033+0000","last_peered":"2023-08-25T04:46:03.362033+0000","last_clean":"2023-08-25T04:46:03.362033+0000","last_became_active":"2023-08-25T04:43:41.888158+0000","last_became_peered":"2023-08-25T04:43:41.888158+0000","last_unstale":"2023-08-25T04:46:03.362033+0000","last_undegraded":"2023-08-25T04:46:03.362033+0000","last_fullsized":"2023-08-25T04:46:03.362033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:03.361887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:03.361887+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.361887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:22.060209+0000","scrub_duration":0.0021121450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'249","reported_seq":266,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.380332+0000","last_change":"2023-08-25T04:43:42.902440+0000","last_active":"2023-08-25T04:45:48.380332+0000","last_peered":"2023-08-25T04:45:48.380332+0000","last_clean":"2023-08-25T04:45:48.380332+0000","last_became_active":"2023-08-25T04:43:42.901657+0000","last_became_peered":"2023-08-25T04:43:42.901657+0000","last_unstale":"2023-08-25T04:45:48.380332+0000","last_undegraded":"2023-08-25T04:45:48.380332+0000","last_fullsized":"2023-08-25T04:45:48.380332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:55.203439+0000","last_change":"2023-08-25T04:45:55.203486+0000","last_active":"2023-08-25T04:45:55.203439+0000","last_peered":"2023-08-25T04:45:55.203439+0000","last_clean":"2023-08-25T04:45:55.203439+0000","last_became_active":"2023-08-25T04:43:37.192427+0000","last_became_peered":"2023-08-25T04:43:37.192427+0000","last_unstale":"2023-08-25T04:45:55.203439+0000","last_undegraded":"2023-08-25T04:45:55.203439+0000","last_fullsized":"2023-08-25T04:45:55.203439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:55.203319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:55.203319+0000","last_clean_scrub_stamp":"2023-08-25T04:45:55.203319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:03.967132+0000","scrub_duration":0.0023883820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:05.948775+0000","last_change":"2023-08-25T04:46:05.948826+0000","last_active":"2023-08-25T04:46:05.948775+0000","last_peered":"2023-08-25T04:46:05.948775+0000","last_clean":"2023-08-25T04:46:05.948775+0000","last_became_active":"2023-08-25T04:43:41.883621+0000","last_became_peered":"2023-08-25T04:43:41.883621+0000","last_unstale":"2023-08-25T04:46:05.948775+0000","last_undegraded":"2023-08-25T04:46:05.948775+0000","last_fullsized":"2023-08-25T04:46:05.948775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:05.948651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:05.948651+0000","last_clean_scrub_stamp":"2023-08-25T04:46:05.948651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:59.653326+0000","scrub_duration":0.001754584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.661611+0000","last_change":"2023-08-25T04:46:01.661661+0000","last_active":"2023-08-25T04:46:01.661611+0000","last_peered":"2023-08-25T04:46:01.661611+0000","last_clean":"2023-08-25T04:46:01.661611+0000","last_became_active":"2023-08-25T04:43:42.893333+0000","last_became_peered":"2023-08-25T04:43:42.893333+0000","last_unstale":"2023-08-25T04:46:01.661611+0000","last_undegraded":"2023-08-25T04:46:01.661611+0000","last_fullsized":"2023-08-25T04:46:01.661611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:01.661506+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:01.661506+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.661506+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:29.031268+0000","scrub_duration":0.0017295419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.501952+0000","last_change":"2023-08-25T04:45:51.502008+0000","last_active":"2023-08-25T04:45:51.501952+0000","last_peered":"2023-08-25T04:45:51.501952+0000","last_clean":"2023-08-25T04:45:51.501952+0000","last_became_active":"2023-08-25T04:43:37.192432+0000","last_became_peered":"2023-08-25T04:43:37.192432+0000","last_unstale":"2023-08-25T04:45:51.501952+0000","last_undegraded":"2023-08-25T04:45:51.501952+0000","last_fullsized":"2023-08-25T04:45:51.501952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:51.501848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:51.501848+0000","last_clean_scrub_stamp":"2023-08-25T04:45:51.501848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:18.871610+0000","scrub_duration":0.0015800009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:14.988470+0000","last_change":"2023-08-25T04:46:14.988549+0000","last_active":"2023-08-25T04:46:14.988470+0000","last_peered":"2023-08-25T04:46:14.988470+0000","last_clean":"2023-08-25T04:46:14.988470+0000","last_became_active":"2023-08-25T04:43:41.889717+0000","last_became_peered":"2023-08-25T04:43:41.889717+0000","last_unstale":"2023-08-25T04:46:14.988470+0000","last_undegraded":"2023-08-25T04:46:14.988470+0000","last_fullsized":"2023-08-25T04:46:14.988470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:14.988323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:14.988323+0000","last_clean_scrub_stamp":"2023-08-25T04:46:14.988323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:11:58.826953+0000","scrub_duration":0.0019775750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"23'260","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:28.444582+0000","last_change":"2023-08-25T04:46:28.444663+0000","last_active":"2023-08-25T04:46:28.444582+0000","last_peered":"2023-08-25T04:46:28.444582+0000","last_clean":"2023-08-25T04:46:28.444582+0000","last_became_active":"2023-08-25T04:43:42.885671+0000","last_became_peered":"2023-08-25T04:43:42.885671+0000","last_unstale":"2023-08-25T04:46:28.444582+0000","last_undegraded":"2023-08-25T04:46:28.444582+0000","last_fullsized":"2023-08-25T04:46:28.444582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'260","last_scrub_stamp":"2023-08-25T04:46:28.444450+0000","last_deep_scrub":"23'260","last_deep_scrub_stamp":"2023-08-25T04:46:28.444450+0000","last_clean_scrub_stamp":"2023-08-25T04:46:28.444450+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:27.765391+0000","scrub_duration":0.001797613,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:54.771152+0000","last_change":"2023-08-25T04:45:54.771206+0000","last_active":"2023-08-25T04:45:54.771152+0000","last_peered":"2023-08-25T04:45:54.771152+0000","last_clean":"2023-08-25T04:45:54.771152+0000","last_became_active":"2023-08-25T04:43:37.192429+0000","last_became_peered":"2023-08-25T04:43:37.192429+0000","last_unstale":"2023-08-25T04:45:54.771152+0000","last_undegraded":"2023-08-25T04:45:54.771152+0000","last_fullsized":"2023-08-25T04:45:54.771152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:54.771023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:54.771023+0000","last_clean_scrub_stamp":"2023-08-25T04:45:54.771023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:36:51.613947+0000","scrub_duration":0.00223077,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"23'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:09.442864+0000","last_change":"2023-08-25T04:46:09.442913+0000","last_active":"2023-08-25T04:46:09.442864+0000","last_peered":"2023-08-25T04:46:09.442864+0000","last_clean":"2023-08-25T04:46:09.442864+0000","last_became_active":"2023-08-25T04:43:41.888207+0000","last_became_peered":"2023-08-25T04:43:41.888207+0000","last_unstale":"2023-08-25T04:46:09.442864+0000","last_undegraded":"2023-08-25T04:46:09.442864+0000","last_fullsized":"2023-08-25T04:46:09.442864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-08-25T04:46:09.442734+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-08-25T04:46:09.442734+0000","last_clean_scrub_stamp":"2023-08-25T04:46:09.442734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:45.267725+0000","scrub_duration":0.001704176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'310","reported_seq":335,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:19.995299+0000","last_change":"2023-08-25T04:46:19.995353+0000","last_active":"2023-08-25T04:46:19.995299+0000","last_peered":"2023-08-25T04:46:19.995299+0000","last_clean":"2023-08-25T04:46:19.995299+0000","last_became_active":"2023-08-25T04:43:42.900470+0000","last_became_peered":"2023-08-25T04:43:42.900470+0000","last_unstale":"2023-08-25T04:46:19.995299+0000","last_undegraded":"2023-08-25T04:46:19.995299+0000","last_fullsized":"2023-08-25T04:46:19.995299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'310","last_scrub_stamp":"2023-08-25T04:46:19.995142+0000","last_deep_scrub":"23'310","last_deep_scrub_stamp":"2023-08-25T04:46:19.995142+0000","last_clean_scrub_stamp":"2023-08-25T04:46:19.995142+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:16:33.429307+0000","scrub_duration":0.002470397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:53.765264+0000","last_change":"2023-08-25T04:45:53.765312+0000","last_active":"2023-08-25T04:45:53.765264+0000","last_peered":"2023-08-25T04:45:53.765264+0000","last_clean":"2023-08-25T04:45:53.765264+0000","last_became_active":"2023-08-25T04:43:36.784943+0000","last_became_peered":"2023-08-25T04:43:36.784943+0000","last_unstale":"2023-08-25T04:45:53.765264+0000","last_undegraded":"2023-08-25T04:45:53.765264+0000","last_fullsized":"2023-08-25T04:45:53.765264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:53.765149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:53.765149+0000","last_clean_scrub_stamp":"2023-08-25T04:45:53.765149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:47:02.134163+0000","scrub_duration":0.0021115940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.309949+0000","last_change":"2023-08-25T04:46:00.310024+0000","last_active":"2023-08-25T04:46:00.309949+0000","last_peered":"2023-08-25T04:46:00.309949+0000","last_clean":"2023-08-25T04:46:00.309949+0000","last_became_active":"2023-08-25T04:43:41.884535+0000","last_became_peered":"2023-08-25T04:43:41.884535+0000","last_unstale":"2023-08-25T04:46:00.309949+0000","last_undegraded":"2023-08-25T04:46:00.309949+0000","last_fullsized":"2023-08-25T04:46:00.309949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:46:00.309816+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:46:00.309816+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.309816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:09.073630+0000","scrub_duration":0.0020692610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"23'273","reported_seq":298,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:25.373588+0000","last_change":"2023-08-25T04:46:25.373676+0000","last_active":"2023-08-25T04:46:25.373588+0000","last_peered":"2023-08-25T04:46:25.373588+0000","last_clean":"2023-08-25T04:46:25.373588+0000","last_became_active":"2023-08-25T04:43:42.902721+0000","last_became_peered":"2023-08-25T04:43:42.902721+0000","last_unstale":"2023-08-25T04:46:25.373588+0000","last_undegraded":"2023-08-25T04:46:25.373588+0000","last_fullsized":"2023-08-25T04:46:25.373588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'273","last_scrub_stamp":"2023-08-25T04:46:25.373435+0000","last_deep_scrub":"23'273","last_deep_scrub_stamp":"2023-08-25T04:46:25.373435+0000","last_clean_scrub_stamp":"2023-08-25T04:46:25.373435+0000","objects_scrubbed":1,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:32.959233+0000","scrub_duration":0.010531183,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:55.955731+0000","last_change":"2023-08-25T04:45:55.955731+0000","last_active":"2023-08-25T04:45:55.955731+0000","last_peered":"2023-08-25T04:45:55.955731+0000","last_clean":"2023-08-25T04:45:55.955731+0000","last_became_active":"2023-08-25T04:43:41.889659+0000","last_became_peered":"2023-08-25T04:43:41.889659+0000","last_unstale":"2023-08-25T04:45:55.955731+0000","last_undegraded":"2023-08-25T04:45:55.955731+0000","last_fullsized":"2023-08-25T04:45:55.955731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-08-25T04:45:55.955491+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-08-25T04:45:55.955491+0000","last_clean_scrub_stamp":"2023-08-25T04:45:55.955491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:14.653813+0000","scrub_duration":0.0022824579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'274","reported_seq":299,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.236575+0000","last_change":"2023-08-25T04:45:52.236575+0000","last_active":"2023-08-25T04:45:52.236575+0000","last_peered":"2023-08-25T04:45:52.236575+0000","last_clean":"2023-08-25T04:45:52.236575+0000","last_became_active":"2023-08-25T04:43:42.894618+0000","last_became_peered":"2023-08-25T04:43:42.894618+0000","last_unstale":"2023-08-25T04:45:52.236575+0000","last_undegraded":"2023-08-25T04:45:52.236575+0000","last_fullsized":"2023-08-25T04:45:52.236575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'274","last_scrub_stamp":"2023-08-25T04:45:52.236416+0000","last_deep_scrub":"23'274","last_deep_scrub_stamp":"2023-08-25T04:45:52.236416+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.236416+0000","objects_scrubbed":1,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:47:56.691703+0000","scrub_duration":0.0060813940000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'3","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.399191+0000","last_change":"2023-08-25T04:45:57.399191+0000","last_active":"2023-08-25T04:45:57.399191+0000","last_peered":"2023-08-25T04:45:57.399191+0000","last_clean":"2023-08-25T04:45:57.399191+0000","last_became_active":"2023-08-25T04:43:41.886063+0000","last_became_peered":"2023-08-25T04:43:41.886063+0000","last_unstale":"2023-08-25T04:45:57.399191+0000","last_undegraded":"2023-08-25T04:45:57.399191+0000","last_fullsized":"2023-08-25T04:45:57.399191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-08-25T04:45:57.399037+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-08-25T04:45:57.399037+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.399037+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:16.097359+0000","scrub_duration":0.0030540559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'263","reported_seq":288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.167945+0000","last_change":"2023-08-25T04:45:52.167945+0000","last_active":"2023-08-25T04:45:52.167945+0000","last_peered":"2023-08-25T04:45:52.167945+0000","last_clean":"2023-08-25T04:45:52.167945+0000","last_became_active":"2023-08-25T04:43:42.900135+0000","last_became_peered":"2023-08-25T04:43:42.900135+0000","last_unstale":"2023-08-25T04:45:52.167945+0000","last_undegraded":"2023-08-25T04:45:52.167945+0000","last_fullsized":"2023-08-25T04:45:52.167945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'263","last_scrub_stamp":"2023-08-25T04:45:52.167794+0000","last_deep_scrub":"23'263","last_deep_scrub_stamp":"2023-08-25T04:45:52.167794+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.167794+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:40.246934+0000","scrub_duration":0.00190884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'4","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:59.323712+0000","last_change":"2023-08-25T04:45:59.323712+0000","last_active":"2023-08-25T04:45:59.323712+0000","last_peered":"2023-08-25T04:45:59.323712+0000","last_clean":"2023-08-25T04:45:59.323712+0000","last_became_active":"2023-08-25T04:43:41.891306+0000","last_became_peered":"2023-08-25T04:43:41.891306+0000","last_unstale":"2023-08-25T04:45:59.323712+0000","last_undegraded":"2023-08-25T04:45:59.323712+0000","last_fullsized":"2023-08-25T04:45:59.323712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2023-08-25T04:45:59.323559+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2023-08-25T04:45:59.323559+0000","last_clean_scrub_stamp":"2023-08-25T04:45:59.323559+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:57:59.288011+0000","scrub_duration":0.0028396300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'257","reported_seq":274,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944545+0000","last_change":"2023-08-25T04:43:42.894647+0000","last_active":"2023-08-25T04:45:49.944545+0000","last_peered":"2023-08-25T04:45:49.944545+0000","last_clean":"2023-08-25T04:45:49.944545+0000","last_became_active":"2023-08-25T04:43:42.894386+0000","last_became_peered":"2023-08-25T04:43:42.894386+0000","last_unstale":"2023-08-25T04:45:49.944545+0000","last_undegraded":"2023-08-25T04:45:49.944545+0000","last_fullsized":"2023-08-25T04:45:49.944545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:11.089321+0000","last_change":"2023-08-25T04:46:11.089419+0000","last_active":"2023-08-25T04:46:11.089321+0000","last_peered":"2023-08-25T04:46:11.089321+0000","last_clean":"2023-08-25T04:46:11.089321+0000","last_became_active":"2023-08-25T04:43:41.892929+0000","last_became_peered":"2023-08-25T04:43:41.892929+0000","last_unstale":"2023-08-25T04:46:11.089321+0000","last_undegraded":"2023-08-25T04:46:11.089321+0000","last_fullsized":"2023-08-25T04:46:11.089321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-08-25T04:46:11.089185+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-08-25T04:46:11.089185+0000","last_clean_scrub_stamp":"2023-08-25T04:46:11.089185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:18.674983+0000","scrub_duration":0.0021106720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'252","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.423267+0000","last_change":"2023-08-25T04:43:42.894553+0000","last_active":"2023-08-25T04:45:49.423267+0000","last_peered":"2023-08-25T04:45:49.423267+0000","last_clean":"2023-08-25T04:45:49.423267+0000","last_became_active":"2023-08-25T04:43:42.894239+0000","last_became_peered":"2023-08-25T04:43:42.894239+0000","last_unstale":"2023-08-25T04:45:49.423267+0000","last_undegraded":"2023-08-25T04:45:49.423267+0000","last_fullsized":"2023-08-25T04:45:49.423267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'7","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:58.974261+0000","last_change":"2023-08-25T04:45:58.974319+0000","last_active":"2023-08-25T04:45:58.974261+0000","last_peered":"2023-08-25T04:45:58.974261+0000","last_clean":"2023-08-25T04:45:58.974261+0000","last_became_active":"2023-08-25T04:43:41.882756+0000","last_became_peered":"2023-08-25T04:43:41.882756+0000","last_unstale":"2023-08-25T04:45:58.974261+0000","last_undegraded":"2023-08-25T04:45:58.974261+0000","last_fullsized":"2023-08-25T04:45:58.974261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2023-08-25T04:45:58.974148+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2023-08-25T04:45:58.974148+0000","last_clean_scrub_stamp":"2023-08-25T04:45:58.974148+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:07.737962+0000","scrub_duration":0.0040936990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'285","reported_seq":310,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.168483+0000","last_change":"2023-08-25T04:46:01.168483+0000","last_active":"2023-08-25T04:46:01.168483+0000","last_peered":"2023-08-25T04:46:01.168483+0000","last_clean":"2023-08-25T04:46:01.168483+0000","last_became_active":"2023-08-25T04:43:42.894912+0000","last_became_peered":"2023-08-25T04:43:42.894912+0000","last_unstale":"2023-08-25T04:46:01.168483+0000","last_undegraded":"2023-08-25T04:46:01.168483+0000","last_fullsized":"2023-08-25T04:46:01.168483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'285","last_scrub_stamp":"2023-08-25T04:46:01.168322+0000","last_deep_scrub":"23'285","last_deep_scrub_stamp":"2023-08-25T04:46:01.168322+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.168322+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:22:40.848712+0000","scrub_duration":0.0017623630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"23'260","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:05.706542+0000","last_change":"2023-08-25T04:46:05.706619+0000","last_active":"2023-08-25T04:46:05.706542+0000","last_peered":"2023-08-25T04:46:05.706542+0000","last_clean":"2023-08-25T04:46:05.706542+0000","last_became_active":"2023-08-25T04:43:42.893255+0000","last_became_peered":"2023-08-25T04:43:42.893255+0000","last_unstale":"2023-08-25T04:46:05.706542+0000","last_undegraded":"2023-08-25T04:46:05.706542+0000","last_fullsized":"2023-08-25T04:46:05.706542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'260","last_scrub_stamp":"2023-08-25T04:46:05.706403+0000","last_deep_scrub":"23'260","last_deep_scrub_stamp":"2023-08-25T04:46:05.706403+0000","last_clean_scrub_stamp":"2023-08-25T04:46:05.706403+0000","objects_scrubbed":1,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:24.404725+0000","scrub_duration":0.0087624350000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"23'306","reported_seq":323,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.397726+0000","last_change":"2023-08-25T04:43:42.897868+0000","last_active":"2023-08-25T04:45:49.397726+0000","last_peered":"2023-08-25T04:45:49.397726+0000","last_clean":"2023-08-25T04:45:49.397726+0000","last_became_active":"2023-08-25T04:43:42.897394+0000","last_became_peered":"2023-08-25T04:43:42.897394+0000","last_unstale":"2023-08-25T04:45:49.397726+0000","last_undegraded":"2023-08-25T04:45:49.397726+0000","last_fullsized":"2023-08-25T04:45:49.397726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'286","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.408186+0000","last_change":"2023-08-25T04:43:42.894698+0000","last_active":"2023-08-25T04:45:49.408186+0000","last_peered":"2023-08-25T04:45:49.408186+0000","last_clean":"2023-08-25T04:45:49.408186+0000","last_became_active":"2023-08-25T04:43:42.894176+0000","last_became_peered":"2023-08-25T04:43:42.894176+0000","last_unstale":"2023-08-25T04:45:49.408186+0000","last_undegraded":"2023-08-25T04:45:49.408186+0000","last_fullsized":"2023-08-25T04:45:49.408186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"23'256","reported_seq":273,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.397779+0000","last_change":"2023-08-25T04:43:42.899435+0000","last_active":"2023-08-25T04:45:49.397779+0000","last_peered":"2023-08-25T04:45:49.397779+0000","last_clean":"2023-08-25T04:45:49.397779+0000","last_became_active":"2023-08-25T04:43:42.898842+0000","last_became_peered":"2023-08-25T04:43:42.898842+0000","last_unstale":"2023-08-25T04:45:49.397779+0000","last_undegraded":"2023-08-25T04:45:49.397779+0000","last_fullsized":"2023-08-25T04:45:49.397779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:13.322386+0000","last_change":"2023-08-25T04:46:13.322439+0000","last_active":"2023-08-25T04:46:13.322386+0000","last_peered":"2023-08-25T04:46:13.322386+0000","last_clean":"2023-08-25T04:46:13.322386+0000","last_became_active":"2023-08-25T04:43:42.889849+0000","last_became_peered":"2023-08-25T04:43:42.889849+0000","last_unstale":"2023-08-25T04:46:13.322386+0000","last_undegraded":"2023-08-25T04:46:13.322386+0000","last_fullsized":"2023-08-25T04:46:13.322386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:13.322282+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:13.322282+0000","last_clean_scrub_stamp":"2023-08-25T04:46:13.322282+0000","objects_scrubbed":1,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:15.465800+0000","scrub_duration":0.0081659450000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":524,"num_write_kb":1101824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16973,"ondisk_log_size":16973,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1518959,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":463,"num_write_kb":1785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3096576,"data_stored":3037918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66388,"kb_used_data":26892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94305452,"statfs":{"total":96636764160,"available":96568782848,"internally_reserved":0,"allocated":27537408,"data_stored":27359168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.9349999999999996,"5min":1.8160000000000001,"15min":0.96299999999999997},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":18.02,"5min":18.02,"15min":18.02},"last":0.52700000000000002},{"interface":"front","average":{"1min":7.6100000000000003,"5min":1.954,"15min":1.012},"min":{"1min":0.48299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":22.920999999999999,"5min":22.920999999999999,"15min":22.920999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.5759999999999996,"5min":2.0209999999999999,"15min":1.095},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":21.199999999999999,"5min":21.199999999999999,"15min":21.199999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":7.585,"5min":1.968,"15min":1.032},"min":{"1min":0.46600000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":22.437999999999999,"5min":22.437999999999999,"15min":22.437999999999999},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.3620000000000001,"5min":1.806,"15min":1.0469999999999999},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":17.844000000000001,"5min":17.844000000000001,"15min":17.844000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":7.2610000000000001,"5min":2.0910000000000002,"15min":1.2290000000000001},"min":{"1min":0.42699999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":19.690999999999999,"5min":19.690999999999999,"15min":19.690999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.7789999999999999,"5min":1.823,"15min":0.997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":17.731000000000002,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":7.0229999999999997,"5min":2.0950000000000002,"15min":1.2729999999999999},"min":{"1min":0.45700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":21.143999999999998,"5min":21.143999999999998,"15min":21.143999999999998},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":5.4710000000000001,"5min":1.4690000000000001,"15min":0.80200000000000005},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":22.465,"5min":22.465,"15min":22.465},"last":0.38300000000000001},{"interface":"front","average":{"1min":4.8609999999999998,"5min":1.373,"15min":0.79100000000000004},"min":{"1min":0.373,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":14.042999999999999,"5min":14.042999999999999,"15min":14.042999999999999},"last":0.40000000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":3.9830000000000001,"5min":1.238,"15min":0.78000000000000003},"min":{"1min":0.33600000000000002,"5min":0.307,"15min":0.307},"max":{"1min":14.117000000000001,"5min":14.117000000000001,"15min":14.117000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":5.8049999999999997,"5min":1.617,"15min":0.91900000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":22.334,"5min":22.334,"15min":22.334},"last":0.47199999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.8259999999999996,"5min":2.0169999999999999,"15min":1.0489999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":22.385000000000002,"5min":22.385000000000002,"15min":22.385000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":3.907,"5min":1.2529999999999999,"15min":0.81100000000000005},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":17.623000000000001,"5min":17.623000000000001,"15min":17.623000000000001},"last":0.45700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47924,"kb_used_data":8428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323916,"statfs":{"total":96636764160,"available":96587689984,"internally_reserved":0,"allocated":8630272,"data_stored":8480479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":6.2830000000000004,"5min":1.708,"15min":0.94599999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":21.954999999999998,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":6.2729999999999997,"5min":1.7330000000000001,"15min":0.97699999999999998},"min":{"1min":0.35599999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":21.109000000000002,"5min":21.109000000000002,"15min":21.109000000000002},"last":0.73399999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.7000000000000002,"5min":1.7889999999999999,"15min":1.304},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":16.664999999999999,"5min":16.664999999999999,"15min":16.664999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":5.1100000000000003,"5min":1.6619999999999999,"15min":1.0880000000000001},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":22.042000000000002,"5min":22.042000000000002,"15min":22.042000000000002},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.75,"5min":1.827,"15min":1.3400000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":19.658000000000001,"5min":19.658000000000001,"15min":19.658000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":4.891,"5min":1.4790000000000001,"15min":0.91000000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":21.138999999999999,"5min":21.138999999999999,"15min":21.138999999999999},"last":0.59099999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":6.1159999999999997,"5min":1.7210000000000001,"15min":0.98899999999999999},"min":{"1min":0.39200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":21.971,"5min":21.971,"15min":21.971},"last":0.77800000000000002},{"interface":"front","average":{"1min":6.274,"5min":2.1110000000000002,"15min":1.417},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":23.931000000000001,"5min":23.931000000000001,"15min":23.931000000000001},"last":0.71899999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":4.468,"5min":1.302,"15min":0.77400000000000002},"min":{"1min":0.29399999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":14.532999999999999,"5min":14.532999999999999,"15min":14.532999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":4.1900000000000004,"5min":1.27,"15min":0.78300000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":21.081,"5min":21.081,"15min":21.081},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":2.5649999999999999,"5min":0.94599999999999995,"15min":0.67600000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":12.946,"5min":12.946,"15min":12.946},"last":0.63200000000000001},{"interface":"front","average":{"1min":2.6429999999999998,"5min":0.97999999999999998,"15min":0.70299999999999996},"min":{"1min":0.35199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":19.597000000000001,"5min":19.597000000000001,"15min":19.597000000000001},"last":0.76400000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":2.633,"5min":1.006,"15min":0.73499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.266999999999999,"5min":11.266999999999999,"15min":11.266999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":4.2560000000000002,"5min":1.3320000000000001,"15min":0.84499999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":16.693000000000001,"5min":16.693000000000001,"15min":16.693000000000001},"last":0.754}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76984,"kb_used_data":49968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94294856,"statfs":{"total":96636764160,"available":96557932544,"internally_reserved":0,"allocated":51167232,"data_stored":51013887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.7160000000000002,"5min":1.427,"15min":0.71199999999999997},"min":{"1min":0.245,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":23.989999999999998,"5min":23.989999999999998,"15min":23.989999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":5.024,"5min":1.3009999999999999,"15min":0.68100000000000005},"min":{"1min":0.255,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":15.622,"5min":15.622,"15min":15.622},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.6580000000000004,"5min":1.4430000000000001,"15min":0.74099999999999999},"min":{"1min":0.29899999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":23.954000000000001,"5min":23.954000000000001,"15min":23.954000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":5.4690000000000003,"5min":1.4530000000000001,"15min":0.78400000000000003},"min":{"1min":0.34499999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":20.946000000000002,"5min":20.946000000000002,"15min":20.946000000000002},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.2939999999999996,"5min":1.4059999999999999,"15min":0.75800000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":27.884,"5min":27.884,"15min":27.884},"last":0.56999999999999995},{"interface":"front","average":{"1min":5.6310000000000002,"5min":1.4450000000000001,"15min":0.747},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":23.018000000000001,"5min":23.018000000000001,"15min":23.018000000000001},"last":0.40799999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.2439999999999998,"5min":1.952,"15min":1.0700000000000001},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":24.044,"5min":24.044,"15min":24.044},"last":0.54200000000000004},{"interface":"front","average":{"1min":7.9050000000000002,"5min":2.0840000000000001,"15min":1.1140000000000001},"min":{"1min":0.501,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":27.940000000000001,"5min":27.940000000000001,"15min":27.940000000000001},"last":0.622}]},{"osd":5,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":8.516,"5min":2.2000000000000002,"15min":1.147},"min":{"1min":0.44,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":26.969999999999999,"5min":26.969999999999999,"15min":26.969999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":7.0430000000000001,"5min":1.923,"15min":1.0700000000000001},"min":{"1min":0.42399999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":24.018000000000001,"5min":24.018000000000001,"15min":24.018000000000001},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.899,"5min":2.0950000000000002,"15min":1.127},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":22.899999999999999,"5min":22.899999999999999,"15min":22.899999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":7.0890000000000004,"5min":1.9550000000000001,"15min":1.099},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":23.898,"5min":23.898,"15min":23.898},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.718,"5min":2.0779999999999998,"15min":1.1379999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":21.010999999999999,"5min":21.010999999999999,"15min":21.010999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":6.2210000000000001,"5min":1.7669999999999999,"15min":1.0249999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":23.053999999999998,"5min":23.053999999999998,"15min":23.053999999999998},"last":0.59499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64316,"kb_used_data":24820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94307524,"statfs":{"total":96636764160,"available":96570904576,"internally_reserved":0,"allocated":25415680,"data_stored":25264588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":3.8849999999999998,"5min":1.0649999999999999,"15min":0.59499999999999997},"min":{"1min":0.32800000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":19.956,"5min":19.956,"15min":19.956},"last":0.34699999999999998},{"interface":"front","average":{"1min":4.4450000000000003,"5min":1.2150000000000001,"15min":0.67700000000000005},"min":{"1min":0.29599999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":14.029999999999999,"5min":14.029999999999999,"15min":14.029999999999999},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":6.3410000000000002,"5min":1.627,"15min":0.84099999999999997},"min":{"1min":0.377,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":22.942,"5min":22.942,"15min":22.942},"last":0.41699999999999998},{"interface":"front","average":{"1min":2.7879999999999998,"5min":0.87,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.016,"5min":11.016,"15min":11.016},"last":0.29499999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":4.9039999999999999,"5min":1.3069999999999999,"15min":0.70699999999999996},"min":{"1min":0.35899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":19.997,"5min":19.997,"15min":19.997},"last":0.32500000000000001},{"interface":"front","average":{"1min":5.9139999999999997,"5min":1.522,"15min":0.79000000000000004},"min":{"1min":0.40400000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":17.045999999999999,"5min":17.045999999999999,"15min":17.045999999999999},"last":0.375}]},{"osd":4,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":4.484,"5min":1.786,"15min":1.3360000000000001},"min":{"1min":0.49199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":21.001000000000001,"5min":21.001000000000001,"15min":21.001000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":8.2750000000000004,"5min":2.1640000000000001,"15min":1.1459999999999999},"min":{"1min":0.46400000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":20.986000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":9.8439999999999994,"5min":2.4820000000000002,"15min":1.2549999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":23.93,"5min":23.93,"15min":23.93},"last":0.71499999999999997},{"interface":"front","average":{"1min":6.6479999999999997,"5min":1.8500000000000001,"15min":1.05},"min":{"1min":0.51600000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":17.010000000000002,"5min":17.010000000000002,"15min":17.010000000000002},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":7.6139999999999999,"5min":2.0379999999999998,"15min":1.109},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":27.701000000000001,"5min":27.701000000000001,"15min":27.701000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":4.758,"5min":1.5029999999999999,"15min":0.96099999999999997},"min":{"1min":0.62,"5min":0.443,"15min":0.443},"max":{"1min":20.942,"5min":20.942,"15min":20.942},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":5.657,"5min":1.6879999999999999,"15min":1.026},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":21.030999999999999,"5min":21.030999999999999,"15min":21.030999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":7.9189999999999996,"5min":2.125,"15min":1.159},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":20.902999999999999,"5min":20.902999999999999,"15min":20.902999999999999},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56116,"kb_used_data":16620,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315724,"statfs":{"total":96636764160,"available":96579301376,"internally_reserved":0,"allocated":17018880,"data_stored":16869087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":4.1100000000000003,"5min":1.1180000000000001,"15min":0.61899999999999999},"min":{"1min":0.33900000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":18.98,"5min":18.98,"15min":18.98},"last":0.32500000000000001},{"interface":"front","average":{"1min":4.9240000000000004,"5min":1.302,"15min":0.69799999999999995},"min":{"1min":0.27300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":20.966999999999999,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":3.899,"5min":1.127,"15min":0.66500000000000004},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":20.995999999999999,"5min":20.995999999999999,"15min":20.995999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":3.6629999999999998,"5min":1.0680000000000001,"15min":0.63600000000000001},"min":{"1min":0.34499999999999997,"5min":0.307,"15min":0.307},"max":{"1min":12.052,"5min":12.052,"15min":12.052},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":5.0149999999999997,"5min":1.341,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":19.925999999999998,"5min":19.925999999999998,"15min":19.925999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":4.4059999999999997,"5min":1.2589999999999999,"15min":0.73499999999999999},"min":{"1min":0.373,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":20.916,"5min":20.916,"15min":20.916},"last":0.38}]},{"osd":4,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.2930000000000001,"5min":1.982,"15min":1.097},"min":{"1min":0.46600000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":19.940999999999999,"5min":19.940999999999999,"15min":19.940999999999999},"last":0.63},{"interface":"front","average":{"1min":8.3059999999999992,"5min":2.1480000000000001,"15min":1.1220000000000001},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":22.038,"5min":22.038,"15min":22.038},"last":0.44400000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":6.3300000000000001,"5min":1.8140000000000001,"15min":1.0609999999999999},"min":{"1min":0.59499999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":19.98,"5min":19.98,"15min":19.98},"last":0.56499999999999995},{"interface":"front","average":{"1min":7.8689999999999998,"5min":2.0790000000000002,"15min":1.1140000000000001},"min":{"1min":0.53500000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":21.050999999999998,"5min":21.050999999999998,"15min":21.050999999999998},"last":0.60899999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":7.3419999999999996,"5min":1.9910000000000001,"15min":1.099},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":22.021999999999998,"5min":22.021999999999998,"15min":22.021999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":6.9569999999999999,"5min":1.921,"15min":1.0820000000000001},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.498},"max":{"1min":19.007999999999999,"5min":19.007999999999999,"15min":19.007999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:45:37 2023","interfaces":[{"interface":"back","average":{"1min":6.8129999999999997,"5min":1.885,"15min":1.0640000000000001},"min":{"1min":0.49199999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":21.023,"5min":21.023,"15min":21.023},"last":0.65100000000000002},{"interface":"front","average":{"1min":9.3469999999999995,"5min":2.411,"15min":1.2549999999999999},"min":{"1min":0.498,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":28.928000000000001,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.49099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64120,"kb_used_data":37104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94307720,"statfs":{"total":96636764160,"available":96571105280,"internally_reserved":0,"allocated":37994496,"data_stored":37840697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.6289999999999996,"5min":1.266,"15min":0.70599999999999996},"min":{"1min":0.28399999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":23.542000000000002,"5min":23.542000000000002,"15min":23.542000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":4.4550000000000001,"5min":1.2949999999999999,"15min":0.76800000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":20.547000000000001,"5min":20.547000000000001,"15min":20.547000000000001},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.3869999999999996,"5min":1.2709999999999999,"15min":0.752},"min":{"1min":0.31900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":18.984999999999999,"5min":18.984999999999999,"15min":18.984999999999999},"last":0.374},{"interface":"front","average":{"1min":4.9550000000000001,"5min":1.3380000000000001,"15min":0.73499999999999999},"min":{"1min":0.32300000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":20.052,"5min":20.052,"15min":20.052},"last":0.55200000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":5.7050000000000001,"5min":1.5329999999999999,"15min":0.83799999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":20.861000000000001,"5min":20.861000000000001,"15min":20.861000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":5.0060000000000002,"5min":1.405,"15min":0.80500000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":21.984000000000002,"5min":21.984000000000002,"15min":21.984000000000002},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.6619999999999999,"5min":2.1160000000000001,"15min":1.1919999999999999},"min":{"1min":0.40300000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":22.015999999999998,"5min":22.015999999999998,"15min":22.015999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":6.4500000000000002,"5min":1.8380000000000001,"15min":1.0700000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":20.934999999999999,"5min":20.934999999999999,"15min":20.934999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.859,"5min":1.9039999999999999,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":23.474,"5min":23.474,"15min":23.474},"last":0.59299999999999997},{"interface":"front","average":{"1min":7.242,"5min":2.069,"15min":1.2070000000000001},"min":{"1min":0.441,"5min":0.376,"15min":0.376},"max":{"1min":21.975999999999999,"5min":21.975999999999999,"15min":21.975999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.9580000000000002,"5min":2.1429999999999998,"15min":1.1739999999999999},"min":{"1min":0.45400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":20.898,"5min":20.898,"15min":20.898},"last":0.68799999999999994},{"interface":"front","average":{"1min":6.3879999999999999,"5min":1.8169999999999999,"15min":1.0549999999999999},"min":{"1min":0.48799999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":23.513000000000002,"5min":23.513000000000002,"15min":23.513000000000002},"last":0.629}]},{"osd":7,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.843,"5min":2.2029999999999998,"15min":1.2629999999999999},"min":{"1min":0.432,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":22.039999999999999,"5min":22.039999999999999,"15min":22.039999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":7.2370000000000001,"5min":2.0449999999999999,"15min":1.179},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":20.905000000000001,"5min":20.905000000000001,"15min":20.905000000000001},"last":0.64800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53328,"kb_used_data":26312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94318512,"statfs":{"total":96636764160,"available":96582156288,"internally_reserved":0,"allocated":26943488,"data_stored":26775912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.2069999999999999,"5min":1.657,"15min":0.89900000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":17.920000000000002,"5min":17.920000000000002,"15min":17.920000000000002},"last":0.505},{"interface":"front","average":{"1min":6.46,"5min":1.7130000000000001,"15min":0.92200000000000004},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":20.904,"5min":20.904,"15min":20.904},"last":0.53900000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.3390000000000004,"5min":1.7170000000000001,"15min":0.94699999999999995},"min":{"1min":0.503,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":23.911000000000001,"5min":23.911000000000001,"15min":23.911000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":6.5750000000000002,"5min":1.756,"15min":0.95299999999999996},"min":{"1min":0.375,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":21.952999999999999,"5min":21.952999999999999,"15min":21.952999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":6.9210000000000003,"5min":1.833,"15min":0.98499999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":21.847999999999999,"5min":21.847999999999999,"15min":21.847999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":8.0950000000000006,"5min":2.0750000000000002,"15min":1.0720000000000001},"min":{"1min":0.504,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":33.182000000000002,"5min":33.182000000000002,"15min":33.182000000000002},"last":0.57999999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":7.1100000000000003,"5min":1.8660000000000001,"15min":0.99199999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":17.010999999999999,"5min":17.010999999999999,"15min":17.010999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":5.5220000000000002,"5min":1.575,"15min":0.91700000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":15.022,"5min":15.022,"15min":15.022},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":4.0679999999999996,"5min":1.1919999999999999,"15min":0.71299999999999997},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":20.963999999999999,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.44},{"interface":"front","average":{"1min":5.1680000000000001,"5min":1.4570000000000001,"15min":0.83899999999999997},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":30.946999999999999,"5min":30.946999999999999,"15min":30.946999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":5.859,"5min":1.5800000000000001,"15min":0.86699999999999999},"min":{"1min":0.42399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":15.936999999999999,"5min":15.936999999999999,"15min":15.936999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":5.0999999999999996,"5min":1.464,"15min":0.85799999999999998},"min":{"1min":0.42399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":20.937000000000001,"5min":20.937000000000001,"15min":20.937000000000001},"last":0.38600000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:45:35 2023","interfaces":[{"interface":"back","average":{"1min":4.4710000000000001,"5min":1.339,"15min":0.81699999999999995},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":12.914,"5min":12.914,"15min":12.914},"last":0.35499999999999998},{"interface":"front","average":{"1min":5.6820000000000004,"5min":1.6080000000000001,"15min":0.92900000000000005},"min":{"1min":0.48999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":15.045999999999999,"5min":15.045999999999999,"15min":15.045999999999999},"last":0.41299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52028,"kb_used_data":12532,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319812,"statfs":{"total":96636764160,"available":96583487488,"internally_reserved":0,"allocated":12832768,"data_stored":12675435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.2850000000000001,"5min":1.877,"15min":0.97499999999999998},"min":{"1min":0.34699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":27.048999999999999,"5min":27.048999999999999,"15min":27.048999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":6.5140000000000002,"5min":1.7290000000000001,"15min":0.93100000000000005},"min":{"1min":0.40100000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":20.956,"5min":20.956,"15min":20.956},"last":0.78900000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.9500000000000002,"5min":1.8089999999999999,"15min":0.95199999999999996},"min":{"1min":0.307,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":20.923999999999999,"5min":20.923999999999999,"15min":20.923999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":6.6459999999999999,"5min":1.782,"15min":0.97199999999999998},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":24.927,"5min":24.927,"15min":24.927},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.6070000000000002,"5min":1.978,"15min":1.04},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":18.602,"5min":18.602,"15min":18.602},"last":0.77000000000000002},{"interface":"front","average":{"1min":6.1580000000000004,"5min":1.722,"15min":0.98199999999999998},"min":{"1min":0.42699999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":15.946999999999999,"5min":15.946999999999999,"15min":15.946999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":7.8200000000000003,"5min":2.008,"15min":1.0389999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":17.782,"5min":17.782,"15min":17.782},"last":0.71999999999999997},{"interface":"front","average":{"1min":7.7779999999999996,"5min":2.0699999999999998,"15min":1.119},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":27.077000000000002,"5min":27.077000000000002,"15min":27.077000000000002},"last":0.625}]},{"osd":4,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.1859999999999999,"5min":1.214,"15min":0.71799999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":19.172999999999998,"5min":19.172999999999998,"15min":19.172999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":5.2329999999999997,"5min":1.4810000000000001,"15min":0.85599999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.693999999999999,"5min":17.693999999999999,"15min":17.693999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":6.056,"5min":1.6140000000000001,"15min":0.874},"min":{"1min":0.33700000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":27.103000000000002,"5min":27.103000000000002,"15min":27.103000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":4.9829999999999997,"5min":1.4399999999999999,"15min":0.84999999999999998},"min":{"1min":0.35299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":22.154,"5min":22.154,"15min":22.154},"last":0.53300000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:45:39 2023","interfaces":[{"interface":"back","average":{"1min":4.0890000000000004,"5min":1.2849999999999999,"15min":0.81799999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":19.253,"5min":19.253,"15min":19.253},"last":0.55400000000000005},{"interface":"front","average":{"1min":4.0060000000000002,"5min":1.238,"15min":0.77700000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":27.001000000000001,"5min":27.001000000000001,"15min":27.001000000000001},"last":0.57299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":7854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1536000,"data_stored":1518217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1536000,"data_stored":1511105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50331648,"data_stored":50331648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37748736,"data_stored":37748736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:46:32.979 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.980 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.980 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.980 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.981 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.981 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.982 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.983 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.983 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.984 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.984 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.986 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.988 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.989 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.989 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.990 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.991 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:32.991 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-25T04:46:44.742 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:46:44.750 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:46:52.995 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:46:53.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.133+0000 7f8498a11700 1 Processor -- start 2023-08-25T04:46:53.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.133+0000 7f8498a11700 1 -- start start 2023-08-25T04:46:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.134+0000 7f8498a11700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849415e670 0x7f84940ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.134+0000 7f8498a11700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f849406a340 0x7f849406a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.134+0000 7f8498a11700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84940713e0 con 0x7f84940cc820 2023-08-25T04:46:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.134+0000 7f8498a11700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849406ad00 con 0x7f849406a340 2023-08-25T04:46:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.134+0000 7f8498a11700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84940b3d20 con 0x7f849415e670 2023-08-25T04:46:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.134+0000 7f8492d9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f84940cc820 0x7f84940ccc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41006/0 (socket says 172.21.15.16:41006) 2023-08-25T04:46:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.134+0000 7f8492d9d700 1 -- 172.21.15.16:0/1998074918 learned_addr learned my addr 172.21.15.16:0/1998074918 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:46:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f8491d9b700 1 --2- 172.21.15.16:0/1998074918 >> v2:172.21.15.117:3300/0 conn(0x7f849406a340 0x7f849406a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849259c700 1 --2- 172.21.15.16:0/1998074918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849415e670 0x7f84940ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 -- 172.21.15.16:0/1998074918 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229037535 0 0) 0x7f84940713e0 con 0x7f84940cc820 2023-08-25T04:46:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 -- 172.21.15.16:0/1998074918 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84800035b0 con 0x7f84940cc820 2023-08-25T04:46:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 -- 172.21.15.16:0/1998074918 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2858928774 0 0) 0x7f84800035b0 con 0x7f84940cc820 2023-08-25T04:46:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 -- 172.21.15.16:0/1998074918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849415e670 msgr2=0x7f84940ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 --2- 172.21.15.16:0/1998074918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849415e670 0x7f84940ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 -- 172.21.15.16:0/1998074918 >> v2:172.21.15.117:3300/0 conn(0x7f849406a340 msgr2=0x7f849406a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 --2- 172.21.15.16:0/1998074918 >> v2:172.21.15.117:3300/0 conn(0x7f849406a340 0x7f849406a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 -- 172.21.15.16:0/1998074918 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849415ea50 con 0x7f84940cc820 2023-08-25T04:46:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 -- 172.21.15.16:0/1998074918 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f848c0019f0 con 0x7f84940cc820 2023-08-25T04:46:53.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 -- 172.21.15.16:0/1998074918 >> v1:172.21.15.16:6789/0 conn(0x7f84940cc820 legacy=0x7f84940ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 --2- 172.21.15.16:0/1998074918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8480003a70 0x7f8480003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 --2- 172.21.15.16:0/1998074918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849415e670 0x7f8480004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 --2- 172.21.15.16:0/1998074918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8480004d90 0x7f8480005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 -- 172.21.15.16:0/1998074918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849406ad00 con 0x7f8480004d90 2023-08-25T04:46:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 -- 172.21.15.16:0/1998074918 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84940b3d20 con 0x7f8480003a70 2023-08-25T04:46:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849159a700 1 -- 172.21.15.16:0/1998074918 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848000ba10 con 0x7f849415e670 2023-08-25T04:46:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f8492d9d700 1 --2- 172.21.15.16:0/1998074918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8480004d90 0x7f8480005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f849259c700 1 --2- 172.21.15.16:0/1998074918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8480003a70 0x7f8480003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.135+0000 7f8491d9b700 1 --2- 172.21.15.16:0/1998074918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849415e670 0x7f8480004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.136+0000 7f8492d9d700 1 -- 172.21.15.16:0/1998074918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849415e670 msgr2=0x7f8480004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:53.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.136+0000 7f8492d9d700 1 --2- 172.21.15.16:0/1998074918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849415e670 0x7f8480004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.136+0000 7f8492d9d700 1 -- 172.21.15.16:0/1998074918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8480003a70 msgr2=0x7f8480003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:53.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.136+0000 7f8492d9d700 1 --2- 172.21.15.16:0/1998074918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8480003a70 0x7f8480003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.136+0000 7f8492d9d700 1 -- 172.21.15.16:0/1998074918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84800035b0 con 0x7f8480004d90 2023-08-25T04:46:53.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.136+0000 7f8492d9d700 1 --2- 172.21.15.16:0/1998074918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8480004d90 0x7f8480005210 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f848c00a830 tx=0x7f8480005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f93f58fb792eab server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:53.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.136+0000 7f849159a700 1 -- 172.21.15.16:0/1998074918 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c012600 con 0x7f8480004d90 2023-08-25T04:46:53.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.136+0000 7f849159a700 1 -- 172.21.15.16:0/1998074918 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c012760 con 0x7f8480004d90 2023-08-25T04:46:53.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.136+0000 7f849159a700 1 -- 172.21.15.16:0/1998074918 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c012b10 con 0x7f8480004d90 2023-08-25T04:46:53.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.136+0000 7f8498a11700 1 -- 172.21.15.16:0/1998074918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8480004d90 msgr2=0x7f8480005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.136+0000 7f8498a11700 1 --2- 172.21.15.16:0/1998074918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8480004d90 0x7f8480005210 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f848c00a830 tx=0x7f8480005880 comp rx=0 tx=0).stop 2023-08-25T04:46:53.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.136+0000 7f8492d9d700 1 -- 172.21.15.16:0/1998074918 reap_dead start 2023-08-25T04:46:53.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.137+0000 7f8498a11700 1 -- 172.21.15.16:0/1998074918 shutdown_connections 2023-08-25T04:46:53.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.137+0000 7f8498a11700 1 -- 172.21.15.16:0/1998074918 >> 172.21.15.16:0/1998074918 conn(0x7f84940b1a10 msgr2=0x7f84940b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:53.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.137+0000 7f8498a11700 1 -- 172.21.15.16:0/1998074918 shutdown_connections 2023-08-25T04:46:53.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.137+0000 7f8498a11700 1 -- 172.21.15.16:0/1998074918 wait complete. 2023-08-25T04:46:53.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.138+0000 7f8498a11700 1 Processor -- start 2023-08-25T04:46:53.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.138+0000 7f8498a11700 1 -- start start 2023-08-25T04:46:53.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8498a11700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8480004d90 0x7f84940b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8498a11700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849415a850 0x7f84940cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8498a11700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f849415a310 0x7f84940cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8498a11700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84940c7c30 con 0x7f849415a310 2023-08-25T04:46:53.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8498a11700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84940b1530 con 0x7f8480004d90 2023-08-25T04:46:53.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8498a11700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84941f5a50 con 0x7f849415a850 2023-08-25T04:46:53.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8492d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f849415a310 0x7f84940cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8492d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f849415a310 0x7f84940cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50604/0 (socket says 172.21.15.16:50604) 2023-08-25T04:46:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8492d9d700 1 -- 172.21.15.16:0/1603451373 learned_addr learned my addr 172.21.15.16:0/1603451373 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:46:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8491d9b700 1 --2- 172.21.15.16:0/1603451373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849415a850 0x7f84940cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f849259c700 1 --2- 172.21.15.16:0/1603451373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8480004d90 0x7f84940b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8492d9d700 1 -- 172.21.15.16:0/1603451373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849415a850 msgr2=0x7f84940cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8492d9d700 1 --2- 172.21.15.16:0/1603451373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849415a850 0x7f84940cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8492d9d700 1 -- 172.21.15.16:0/1603451373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8480004d90 msgr2=0x7f84940b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8492d9d700 1 --2- 172.21.15.16:0/1603451373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8480004d90 0x7f84940b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8492d9d700 1 -- 172.21.15.16:0/1603451373 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84941f5ca0 con 0x7f849415a310 2023-08-25T04:46:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.139+0000 7f8492d9d700 1 --2- 172.21.15.16:0/1603451373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f849415a310 0x7f84940cefa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f848c001cb0 tx=0x7f84940c3580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.140+0000 7f848affd700 1 -- 172.21.15.16:0/1603451373 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c01e600 con 0x7f849415a310 2023-08-25T04:46:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.140+0000 7f848affd700 1 -- 172.21.15.16:0/1603451373 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c01e780 con 0x7f849415a310 2023-08-25T04:46:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.140+0000 7f8498a11700 1 -- 172.21.15.16:0/1603451373 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84941f5f80 con 0x7f849415a310 2023-08-25T04:46:53.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.140+0000 7f848affd700 1 -- 172.21.15.16:0/1603451373 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c01eb30 con 0x7f849415a310 2023-08-25T04:46:53.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.140+0000 7f8498a11700 1 -- 172.21.15.16:0/1603451373 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84941f6540 con 0x7f849415a310 2023-08-25T04:46:53.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.141+0000 7f8498a11700 1 -- 172.21.15.16:0/1603451373 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849404ee70 con 0x7f849415a310 2023-08-25T04:46:53.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.141+0000 7f848affd700 1 -- 172.21.15.16:0/1603451373 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f848c019030 con 0x7f849415a310 2023-08-25T04:46:53.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.142+0000 7f848affd700 1 --2- 172.21.15.16:0/1603451373 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f847406a0e0 0x7f847406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.142+0000 7f848affd700 1 -- 172.21.15.16:0/1603451373 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f848c08a370 con 0x7f849415a310 2023-08-25T04:46:53.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.142+0000 7f849259c700 1 --2- 172.21.15.16:0/1603451373 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f847406a0e0 0x7f847406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.142+0000 7f849259c700 1 --2- 172.21.15.16:0/1603451373 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f847406a0e0 0x7f847406c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8484009be0 tx=0x7f8484009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:53.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.146+0000 7f848affd700 1 -- 172.21.15.16:0/1603451373 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f848c055c90 con 0x7f849415a310 2023-08-25T04:46:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.342+0000 7f8498a11700 1 -- 172.21.15.16:0/1603451373 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8494071630 con 0x7f847406a0e0 2023-08-25T04:46:53.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.352+0000 7f848affd700 1 -- 172.21.15.16:0/1603451373 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+313792 (secure 0 0 0) 0x7f8484019070 con 0x7f847406a0e0 2023-08-25T04:46:53.359 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:46:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.355+0000 7f8498a11700 1 -- 172.21.15.16:0/1603451373 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f847406a0e0 msgr2=0x7f847406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.355+0000 7f8498a11700 1 --2- 172.21.15.16:0/1603451373 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f847406a0e0 0x7f847406c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8484009be0 tx=0x7f8484009210 comp rx=0 tx=0).stop 2023-08-25T04:46:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.355+0000 7f8498a11700 1 -- 172.21.15.16:0/1603451373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f849415a310 msgr2=0x7f84940cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.355+0000 7f8498a11700 1 --2- 172.21.15.16:0/1603451373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f849415a310 0x7f84940cefa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f848c001cb0 tx=0x7f84940c3580 comp rx=0 tx=0).stop 2023-08-25T04:46:53.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.355+0000 7f8498a11700 1 -- 172.21.15.16:0/1603451373 shutdown_connections 2023-08-25T04:46:53.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.355+0000 7f8498a11700 1 --2- 172.21.15.16:0/1603451373 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f847406a0e0 0x7f847406c5a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.355+0000 7f8498a11700 1 --2- 172.21.15.16:0/1603451373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f849415a310 0x7f84940cefa0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.355+0000 7f8498a11700 1 --2- 172.21.15.16:0/1603451373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8480004d90 0x7f84940b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.355+0000 7f8498a11700 1 --2- 172.21.15.16:0/1603451373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849415a850 0x7f84940cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.355+0000 7f8498a11700 1 -- 172.21.15.16:0/1603451373 >> 172.21.15.16:0/1603451373 conn(0x7f84940b1a10 msgr2=0x7f84940ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.355+0000 7f8498a11700 1 -- 172.21.15.16:0/1603451373 shutdown_connections 2023-08-25T04:46:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:46:53.355+0000 7f8498a11700 1 -- 172.21.15.16:0/1603451373 wait complete. 2023-08-25T04:46:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-08-25T04:46:53.368 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-08-25T04:46:51.423102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102772623,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":129,"num_read_kb":115,"num_write":1146,"num_write_kb":1106025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17578,"ondisk_log_size":17578,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":481204,"kb_used_data":202676,"kb_used_omap":13,"kb_used_meta":278450,"kb_avail":754493516,"statfs":{"total":773094113280,"available":772601360384,"internally_reserved":0,"allocated":207540224,"data_stored":206279253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":285132888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003294"},"pg_stats":[{"pgid":"4.3f","version":"23'232","reported_seq":257,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.038106+0000","last_change":"2023-08-25T04:46:01.038166+0000","last_active":"2023-08-25T04:46:01.038106+0000","last_peered":"2023-08-25T04:46:01.038106+0000","last_clean":"2023-08-25T04:46:01.038106+0000","last_became_active":"2023-08-25T04:43:42.894831+0000","last_became_peered":"2023-08-25T04:43:42.894831+0000","last_unstale":"2023-08-25T04:46:01.038106+0000","last_undegraded":"2023-08-25T04:46:01.038106+0000","last_fullsized":"2023-08-25T04:46:01.038106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'232","last_scrub_stamp":"2023-08-25T04:46:01.037985+0000","last_deep_scrub":"23'232","last_deep_scrub_stamp":"2023-08-25T04:46:01.037985+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.037985+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:36:57.880910+0000","scrub_duration":0.0016765160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'220","reported_seq":245,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:23.267930+0000","last_change":"2023-08-25T04:46:23.267988+0000","last_active":"2023-08-25T04:46:23.267930+0000","last_peered":"2023-08-25T04:46:23.267930+0000","last_clean":"2023-08-25T04:46:23.267930+0000","last_became_active":"2023-08-25T04:43:42.895245+0000","last_became_peered":"2023-08-25T04:43:42.895245+0000","last_unstale":"2023-08-25T04:46:23.267930+0000","last_undegraded":"2023-08-25T04:46:23.267930+0000","last_fullsized":"2023-08-25T04:46:23.267930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'220","last_scrub_stamp":"2023-08-25T04:46:23.267814+0000","last_deep_scrub":"23'220","last_deep_scrub_stamp":"2023-08-25T04:46:23.267814+0000","last_clean_scrub_stamp":"2023-08-25T04:46:23.267814+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:16:36.701979+0000","scrub_duration":0.0021392400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"23'276","reported_seq":293,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.408261+0000","last_change":"2023-08-25T04:43:42.888920+0000","last_active":"2023-08-25T04:45:49.408261+0000","last_peered":"2023-08-25T04:45:49.408261+0000","last_clean":"2023-08-25T04:45:49.408261+0000","last_became_active":"2023-08-25T04:43:42.888568+0000","last_became_peered":"2023-08-25T04:43:42.888568+0000","last_unstale":"2023-08-25T04:45:49.408261+0000","last_undegraded":"2023-08-25T04:45:49.408261+0000","last_fullsized":"2023-08-25T04:45:49.408261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"23'253","reported_seq":278,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:04.727265+0000","last_change":"2023-08-25T04:46:04.727316+0000","last_active":"2023-08-25T04:46:04.727265+0000","last_peered":"2023-08-25T04:46:04.727265+0000","last_clean":"2023-08-25T04:46:04.727265+0000","last_became_active":"2023-08-25T04:43:42.893534+0000","last_became_peered":"2023-08-25T04:43:42.893534+0000","last_unstale":"2023-08-25T04:46:04.727265+0000","last_undegraded":"2023-08-25T04:46:04.727265+0000","last_fullsized":"2023-08-25T04:46:04.727265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'253","last_scrub_stamp":"2023-08-25T04:46:04.727143+0000","last_deep_scrub":"23'253","last_deep_scrub_stamp":"2023-08-25T04:46:04.727143+0000","last_clean_scrub_stamp":"2023-08-25T04:46:04.727143+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:48:03.426061+0000","scrub_duration":0.0023240380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"23'256","reported_seq":281,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.953954+0000","last_change":"2023-08-25T04:46:03.953954+0000","last_active":"2023-08-25T04:46:03.953954+0000","last_peered":"2023-08-25T04:46:03.953954+0000","last_clean":"2023-08-25T04:46:03.953954+0000","last_became_active":"2023-08-25T04:43:42.901963+0000","last_became_peered":"2023-08-25T04:43:42.901963+0000","last_unstale":"2023-08-25T04:46:03.953954+0000","last_undegraded":"2023-08-25T04:46:03.953954+0000","last_fullsized":"2023-08-25T04:46:03.953954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'256","last_scrub_stamp":"2023-08-25T04:46:03.953767+0000","last_deep_scrub":"23'256","last_deep_scrub_stamp":"2023-08-25T04:46:03.953767+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.953767+0000","objects_scrubbed":1,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:06.097285+0000","scrub_duration":0.0078404019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'278","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944646+0000","last_change":"2023-08-25T04:43:42.888877+0000","last_active":"2023-08-25T04:45:49.944646+0000","last_peered":"2023-08-25T04:45:49.944646+0000","last_clean":"2023-08-25T04:45:49.944646+0000","last_became_active":"2023-08-25T04:43:42.888567+0000","last_became_peered":"2023-08-25T04:43:42.888567+0000","last_unstale":"2023-08-25T04:45:49.944646+0000","last_undegraded":"2023-08-25T04:45:49.944646+0000","last_fullsized":"2023-08-25T04:45:49.944646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"23'295","reported_seq":320,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:25.174949+0000","last_change":"2023-08-25T04:46:25.175012+0000","last_active":"2023-08-25T04:46:25.174949+0000","last_peered":"2023-08-25T04:46:25.174949+0000","last_clean":"2023-08-25T04:46:25.174949+0000","last_became_active":"2023-08-25T04:43:42.902156+0000","last_became_peered":"2023-08-25T04:43:42.902156+0000","last_unstale":"2023-08-25T04:46:25.174949+0000","last_undegraded":"2023-08-25T04:46:25.174949+0000","last_fullsized":"2023-08-25T04:46:25.174949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'295","last_scrub_stamp":"2023-08-25T04:46:25.174849+0000","last_deep_scrub":"23'295","last_deep_scrub_stamp":"2023-08-25T04:46:25.174849+0000","last_clean_scrub_stamp":"2023-08-25T04:46:25.174849+0000","objects_scrubbed":2,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:35:29.333088+0000","scrub_duration":0.017116702000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"23'270","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:17.296005+0000","last_change":"2023-08-25T04:46:17.296066+0000","last_active":"2023-08-25T04:46:17.296005+0000","last_peered":"2023-08-25T04:46:17.296005+0000","last_clean":"2023-08-25T04:46:17.296005+0000","last_became_active":"2023-08-25T04:43:42.895410+0000","last_became_peered":"2023-08-25T04:43:42.895410+0000","last_unstale":"2023-08-25T04:46:17.296005+0000","last_undegraded":"2023-08-25T04:46:17.296005+0000","last_fullsized":"2023-08-25T04:46:17.296005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'270","last_scrub_stamp":"2023-08-25T04:46:17.295895+0000","last_deep_scrub":"23'270","last_deep_scrub_stamp":"2023-08-25T04:46:17.295895+0000","last_clean_scrub_stamp":"2023-08-25T04:46:17.295895+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:24.881693+0000","scrub_duration":0.001880591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"23'249","reported_seq":274,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:15.980943+0000","last_change":"2023-08-25T04:46:15.981007+0000","last_active":"2023-08-25T04:46:15.980943+0000","last_peered":"2023-08-25T04:46:15.980943+0000","last_clean":"2023-08-25T04:46:15.980943+0000","last_became_active":"2023-08-25T04:43:42.896949+0000","last_became_peered":"2023-08-25T04:43:42.896949+0000","last_unstale":"2023-08-25T04:46:15.980943+0000","last_undegraded":"2023-08-25T04:46:15.980943+0000","last_fullsized":"2023-08-25T04:46:15.980943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'249","last_scrub_stamp":"2023-08-25T04:46:15.980802+0000","last_deep_scrub":"23'249","last_deep_scrub_stamp":"2023-08-25T04:46:15.980802+0000","last_clean_scrub_stamp":"2023-08-25T04:46:15.980802+0000","objects_scrubbed":1,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:23.566600+0000","scrub_duration":0.0083634850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'283","reported_seq":308,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:18.321487+0000","last_change":"2023-08-25T04:46:18.321541+0000","last_active":"2023-08-25T04:46:18.321487+0000","last_peered":"2023-08-25T04:46:18.321487+0000","last_clean":"2023-08-25T04:46:18.321487+0000","last_became_active":"2023-08-25T04:43:42.894786+0000","last_became_peered":"2023-08-25T04:43:42.894786+0000","last_unstale":"2023-08-25T04:46:18.321487+0000","last_undegraded":"2023-08-25T04:46:18.321487+0000","last_fullsized":"2023-08-25T04:46:18.321487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'283","last_scrub_stamp":"2023-08-25T04:46:18.321394+0000","last_deep_scrub":"23'283","last_deep_scrub_stamp":"2023-08-25T04:46:18.321394+0000","last_clean_scrub_stamp":"2023-08-25T04:46:18.321394+0000","objects_scrubbed":1,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:57.751393+0000","scrub_duration":0.012244069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"23'244","reported_seq":261,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944607+0000","last_change":"2023-08-25T04:43:42.892793+0000","last_active":"2023-08-25T04:45:49.944607+0000","last_peered":"2023-08-25T04:45:49.944607+0000","last_clean":"2023-08-25T04:45:49.944607+0000","last_became_active":"2023-08-25T04:43:42.892558+0000","last_became_peered":"2023-08-25T04:43:42.892558+0000","last_unstale":"2023-08-25T04:45:49.944607+0000","last_undegraded":"2023-08-25T04:45:49.944607+0000","last_fullsized":"2023-08-25T04:45:49.944607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"23'260","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.103144+0000","last_change":"2023-08-25T04:45:57.103144+0000","last_active":"2023-08-25T04:45:57.103144+0000","last_peered":"2023-08-25T04:45:57.103144+0000","last_clean":"2023-08-25T04:45:57.103144+0000","last_became_active":"2023-08-25T04:43:42.891782+0000","last_became_peered":"2023-08-25T04:43:42.891782+0000","last_unstale":"2023-08-25T04:45:57.103144+0000","last_undegraded":"2023-08-25T04:45:57.103144+0000","last_fullsized":"2023-08-25T04:45:57.103144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'260","last_scrub_stamp":"2023-08-25T04:45:57.102967+0000","last_deep_scrub":"23'260","last_deep_scrub_stamp":"2023-08-25T04:45:57.102967+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.102967+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:11:20.262318+0000","scrub_duration":0.0024717099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'253","reported_seq":278,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.229483+0000","last_change":"2023-08-25T04:45:51.229483+0000","last_active":"2023-08-25T04:45:51.229483+0000","last_peered":"2023-08-25T04:45:51.229483+0000","last_clean":"2023-08-25T04:45:51.229483+0000","last_became_active":"2023-08-25T04:43:42.896334+0000","last_became_peered":"2023-08-25T04:43:42.896334+0000","last_unstale":"2023-08-25T04:45:51.229483+0000","last_undegraded":"2023-08-25T04:45:51.229483+0000","last_fullsized":"2023-08-25T04:45:51.229483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'253","last_scrub_stamp":"2023-08-25T04:45:51.229299+0000","last_deep_scrub":"23'253","last_deep_scrub_stamp":"2023-08-25T04:45:51.229299+0000","last_clean_scrub_stamp":"2023-08-25T04:45:51.229299+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:07:04.578619+0000","scrub_duration":0.001452009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'273","reported_seq":298,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:05.288862+0000","last_change":"2023-08-25T04:46:05.288910+0000","last_active":"2023-08-25T04:46:05.288862+0000","last_peered":"2023-08-25T04:46:05.288862+0000","last_clean":"2023-08-25T04:46:05.288862+0000","last_became_active":"2023-08-25T04:43:42.894472+0000","last_became_peered":"2023-08-25T04:43:42.894472+0000","last_unstale":"2023-08-25T04:46:05.288862+0000","last_undegraded":"2023-08-25T04:46:05.288862+0000","last_fullsized":"2023-08-25T04:46:05.288862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'273","last_scrub_stamp":"2023-08-25T04:46:05.288764+0000","last_deep_scrub":"23'273","last_deep_scrub_stamp":"2023-08-25T04:46:05.288764+0000","last_clean_scrub_stamp":"2023-08-25T04:46:05.288764+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:07.432282+0000","scrub_duration":0.0024051290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:28.267320+0000","last_change":"2023-08-25T04:46:28.267405+0000","last_active":"2023-08-25T04:46:28.267320+0000","last_peered":"2023-08-25T04:46:28.267320+0000","last_clean":"2023-08-25T04:46:28.267320+0000","last_became_active":"2023-08-25T04:43:42.902184+0000","last_became_peered":"2023-08-25T04:43:42.902184+0000","last_unstale":"2023-08-25T04:46:28.267320+0000","last_undegraded":"2023-08-25T04:46:28.267320+0000","last_fullsized":"2023-08-25T04:46:28.267320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:28.267186+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:28.267186+0000","last_clean_scrub_stamp":"2023-08-25T04:46:28.267186+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:21.363371+0000","scrub_duration":0.0021385200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"23'258","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:08.143464+0000","last_change":"2023-08-25T04:46:08.143515+0000","last_active":"2023-08-25T04:46:08.143464+0000","last_peered":"2023-08-25T04:46:08.143464+0000","last_clean":"2023-08-25T04:46:08.143464+0000","last_became_active":"2023-08-25T04:43:42.888730+0000","last_became_peered":"2023-08-25T04:43:42.888730+0000","last_unstale":"2023-08-25T04:46:08.143464+0000","last_undegraded":"2023-08-25T04:46:08.143464+0000","last_fullsized":"2023-08-25T04:46:08.143464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'258","last_scrub_stamp":"2023-08-25T04:46:08.143341+0000","last_deep_scrub":"23'258","last_deep_scrub_stamp":"2023-08-25T04:46:08.143341+0000","last_clean_scrub_stamp":"2023-08-25T04:46:08.143341+0000","objects_scrubbed":1,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:07.464282+0000","scrub_duration":0.0087248789999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:16.965802+0000","last_change":"2023-08-25T04:46:16.965855+0000","last_active":"2023-08-25T04:46:16.965802+0000","last_peered":"2023-08-25T04:46:16.965802+0000","last_clean":"2023-08-25T04:46:16.965802+0000","last_became_active":"2023-08-25T04:43:42.898103+0000","last_became_peered":"2023-08-25T04:43:42.898103+0000","last_unstale":"2023-08-25T04:46:16.965802+0000","last_undegraded":"2023-08-25T04:46:16.965802+0000","last_fullsized":"2023-08-25T04:46:16.965802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:16.965676+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:16.965676+0000","last_clean_scrub_stamp":"2023-08-25T04:46:16.965676+0000","objects_scrubbed":1,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:56.395676+0000","scrub_duration":0.0080171589999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'250","reported_seq":275,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:46.166482+0000","last_change":"2023-08-25T04:46:46.166532+0000","last_active":"2023-08-25T04:46:46.166482+0000","last_peered":"2023-08-25T04:46:46.166482+0000","last_clean":"2023-08-25T04:46:46.166482+0000","last_became_active":"2023-08-25T04:43:42.891874+0000","last_became_peered":"2023-08-25T04:43:42.891874+0000","last_unstale":"2023-08-25T04:46:46.166482+0000","last_undegraded":"2023-08-25T04:46:46.166482+0000","last_fullsized":"2023-08-25T04:46:46.166482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'250","last_scrub_stamp":"2023-08-25T04:46:46.166367+0000","last_deep_scrub":"23'250","last_deep_scrub_stamp":"2023-08-25T04:46:46.166367+0000","last_clean_scrub_stamp":"2023-08-25T04:46:46.166367+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:56:19.782878+0000","scrub_duration":0.002211457,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"23'237","reported_seq":262,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.059523+0000","last_change":"2023-08-25T04:46:00.059576+0000","last_active":"2023-08-25T04:46:00.059523+0000","last_peered":"2023-08-25T04:46:00.059523+0000","last_clean":"2023-08-25T04:46:00.059523+0000","last_became_active":"2023-08-25T04:43:42.895114+0000","last_became_peered":"2023-08-25T04:43:42.895114+0000","last_unstale":"2023-08-25T04:46:00.059523+0000","last_undegraded":"2023-08-25T04:46:00.059523+0000","last_fullsized":"2023-08-25T04:46:00.059523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'237","last_scrub_stamp":"2023-08-25T04:46:00.059425+0000","last_deep_scrub":"23'237","last_deep_scrub_stamp":"2023-08-25T04:46:00.059425+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.059425+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:47:08.428439+0000","scrub_duration":0.0021392239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:02.208337+0000","last_change":"2023-08-25T04:46:02.208395+0000","last_active":"2023-08-25T04:46:02.208337+0000","last_peered":"2023-08-25T04:46:02.208337+0000","last_clean":"2023-08-25T04:46:02.208337+0000","last_became_active":"2023-08-25T04:43:42.895893+0000","last_became_peered":"2023-08-25T04:43:42.895893+0000","last_unstale":"2023-08-25T04:46:02.208337+0000","last_undegraded":"2023-08-25T04:46:02.208337+0000","last_fullsized":"2023-08-25T04:46:02.208337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:02.208224+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:02.208224+0000","last_clean_scrub_stamp":"2023-08-25T04:46:02.208224+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:28:50.652408+0000","scrub_duration":0.001791534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:34.077966+0000","last_change":"2023-08-25T04:46:34.078027+0000","last_active":"2023-08-25T04:46:34.077966+0000","last_peered":"2023-08-25T04:46:34.077966+0000","last_clean":"2023-08-25T04:46:34.077966+0000","last_became_active":"2023-08-25T04:43:42.905157+0000","last_became_peered":"2023-08-25T04:43:42.905157+0000","last_unstale":"2023-08-25T04:46:34.077966+0000","last_undegraded":"2023-08-25T04:46:34.077966+0000","last_fullsized":"2023-08-25T04:46:34.077966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:34.077841+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:34.077841+0000","last_clean_scrub_stamp":"2023-08-25T04:46:34.077841+0000","objects_scrubbed":1,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:28.982630+0000","scrub_duration":0.0101277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"23'278","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.991834+0000","last_change":"2023-08-25T04:46:00.991883+0000","last_active":"2023-08-25T04:46:00.991834+0000","last_peered":"2023-08-25T04:46:00.991834+0000","last_clean":"2023-08-25T04:46:00.991834+0000","last_became_active":"2023-08-25T04:43:42.879881+0000","last_became_peered":"2023-08-25T04:43:42.879881+0000","last_unstale":"2023-08-25T04:46:00.991834+0000","last_undegraded":"2023-08-25T04:46:00.991834+0000","last_fullsized":"2023-08-25T04:46:00.991834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'278","last_scrub_stamp":"2023-08-25T04:46:00.991708+0000","last_deep_scrub":"23'278","last_deep_scrub_stamp":"2023-08-25T04:46:00.991708+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.991708+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:59:59.525971+0000","scrub_duration":0.001818802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'246","reported_seq":266,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.998431+0000","last_change":"2023-08-25T04:46:03.998431+0000","last_active":"2023-08-25T04:46:03.998431+0000","last_peered":"2023-08-25T04:46:03.998431+0000","last_clean":"2023-08-25T04:46:03.998431+0000","last_became_active":"2023-08-25T04:44:30.818308+0000","last_became_peered":"2023-08-25T04:44:30.818308+0000","last_unstale":"2023-08-25T04:46:03.998431+0000","last_undegraded":"2023-08-25T04:46:03.998431+0000","last_fullsized":"2023-08-25T04:46:03.998431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'246","last_scrub_stamp":"2023-08-25T04:46:03.998242+0000","last_deep_scrub":"23'246","last_deep_scrub_stamp":"2023-08-25T04:46:03.998242+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.998242+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:16:04.323429+0000","scrub_duration":0.001734148,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"23'239","reported_seq":264,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:26.177269+0000","last_change":"2023-08-25T04:46:26.177340+0000","last_active":"2023-08-25T04:46:26.177269+0000","last_peered":"2023-08-25T04:46:26.177269+0000","last_clean":"2023-08-25T04:46:26.177269+0000","last_became_active":"2023-08-25T04:43:42.896869+0000","last_became_peered":"2023-08-25T04:43:42.896869+0000","last_unstale":"2023-08-25T04:46:26.177269+0000","last_undegraded":"2023-08-25T04:46:26.177269+0000","last_fullsized":"2023-08-25T04:46:26.177269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'239","last_scrub_stamp":"2023-08-25T04:46:26.177136+0000","last_deep_scrub":"23'239","last_deep_scrub_stamp":"2023-08-25T04:46:26.177136+0000","last_clean_scrub_stamp":"2023-08-25T04:46:26.177136+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:12:10.015765+0000","scrub_duration":0.0022678490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"23'255","reported_seq":280,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:22.373816+0000","last_change":"2023-08-25T04:46:22.373866+0000","last_active":"2023-08-25T04:46:22.373816+0000","last_peered":"2023-08-25T04:46:22.373816+0000","last_clean":"2023-08-25T04:46:22.373816+0000","last_became_active":"2023-08-25T04:43:42.893673+0000","last_became_peered":"2023-08-25T04:43:42.893673+0000","last_unstale":"2023-08-25T04:46:22.373816+0000","last_undegraded":"2023-08-25T04:46:22.373816+0000","last_fullsized":"2023-08-25T04:46:22.373816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'255","last_scrub_stamp":"2023-08-25T04:46:22.373701+0000","last_deep_scrub":"23'255","last_deep_scrub_stamp":"2023-08-25T04:46:22.373701+0000","last_clean_scrub_stamp":"2023-08-25T04:46:22.373701+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:32:04.054159+0000","scrub_duration":0.0023847949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'274","reported_seq":299,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:10.405513+0000","last_change":"2023-08-25T04:46:10.405567+0000","last_active":"2023-08-25T04:46:10.405513+0000","last_peered":"2023-08-25T04:46:10.405513+0000","last_clean":"2023-08-25T04:46:10.405513+0000","last_became_active":"2023-08-25T04:43:42.887831+0000","last_became_peered":"2023-08-25T04:43:42.887831+0000","last_unstale":"2023-08-25T04:46:10.405513+0000","last_undegraded":"2023-08-25T04:46:10.405513+0000","last_fullsized":"2023-08-25T04:46:10.405513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'274","last_scrub_stamp":"2023-08-25T04:46:10.405391+0000","last_deep_scrub":"23'274","last_deep_scrub_stamp":"2023-08-25T04:46:10.405391+0000","last_clean_scrub_stamp":"2023-08-25T04:46:10.405391+0000","objects_scrubbed":2,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:08.939653+0000","scrub_duration":0.013184357000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'237","reported_seq":262,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:02.351329+0000","last_change":"2023-08-25T04:46:02.351387+0000","last_active":"2023-08-25T04:46:02.351329+0000","last_peered":"2023-08-25T04:46:02.351329+0000","last_clean":"2023-08-25T04:46:02.351329+0000","last_became_active":"2023-08-25T04:43:42.894302+0000","last_became_peered":"2023-08-25T04:43:42.894302+0000","last_unstale":"2023-08-25T04:46:02.351329+0000","last_undegraded":"2023-08-25T04:46:02.351329+0000","last_fullsized":"2023-08-25T04:46:02.351329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'237","last_scrub_stamp":"2023-08-25T04:46:02.351216+0000","last_deep_scrub":"23'237","last_deep_scrub_stamp":"2023-08-25T04:46:02.351216+0000","last_clean_scrub_stamp":"2023-08-25T04:46:02.351216+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:00.885478+0000","scrub_duration":0.0016876969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:23.209215+0000","last_change":"2023-08-25T04:46:23.209320+0000","last_active":"2023-08-25T04:46:23.209215+0000","last_peered":"2023-08-25T04:46:23.209215+0000","last_clean":"2023-08-25T04:46:23.209215+0000","last_became_active":"2023-08-25T04:43:41.888339+0000","last_became_peered":"2023-08-25T04:43:41.888339+0000","last_unstale":"2023-08-25T04:46:23.209215+0000","last_undegraded":"2023-08-25T04:46:23.209215+0000","last_fullsized":"2023-08-25T04:46:23.209215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-08-25T04:46:23.209085+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-08-25T04:46:23.209085+0000","last_clean_scrub_stamp":"2023-08-25T04:46:23.209085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:18.113873+0000","scrub_duration":0.0022365309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'271","reported_seq":296,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:30.308106+0000","last_change":"2023-08-25T04:46:30.308152+0000","last_active":"2023-08-25T04:46:30.308106+0000","last_peered":"2023-08-25T04:46:30.308106+0000","last_clean":"2023-08-25T04:46:30.308106+0000","last_became_active":"2023-08-25T04:43:42.897425+0000","last_became_peered":"2023-08-25T04:43:42.897425+0000","last_unstale":"2023-08-25T04:46:30.308106+0000","last_undegraded":"2023-08-25T04:46:30.308106+0000","last_fullsized":"2023-08-25T04:46:30.308106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'271","last_scrub_stamp":"2023-08-25T04:46:30.307993+0000","last_deep_scrub":"23'271","last_deep_scrub_stamp":"2023-08-25T04:46:30.307993+0000","last_clean_scrub_stamp":"2023-08-25T04:46:30.307993+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:25.212781+0000","scrub_duration":0.001690495,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:08.410533+0000","last_change":"2023-08-25T04:46:08.410533+0000","last_active":"2023-08-25T04:46:08.410533+0000","last_peered":"2023-08-25T04:46:08.410533+0000","last_clean":"2023-08-25T04:46:08.410533+0000","last_became_active":"2023-08-25T04:43:41.885184+0000","last_became_peered":"2023-08-25T04:43:41.885184+0000","last_unstale":"2023-08-25T04:46:08.410533+0000","last_undegraded":"2023-08-25T04:46:08.410533+0000","last_fullsized":"2023-08-25T04:46:08.410533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:08.410308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:08.410308+0000","last_clean_scrub_stamp":"2023-08-25T04:46:08.410308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:17.174121+0000","scrub_duration":0.001705238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'291","reported_seq":316,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:21.972608+0000","last_change":"2023-08-25T04:46:21.972669+0000","last_active":"2023-08-25T04:46:21.972608+0000","last_peered":"2023-08-25T04:46:21.972608+0000","last_clean":"2023-08-25T04:46:21.972608+0000","last_became_active":"2023-08-25T04:43:42.890575+0000","last_became_peered":"2023-08-25T04:43:42.890575+0000","last_unstale":"2023-08-25T04:46:21.972608+0000","last_undegraded":"2023-08-25T04:46:21.972608+0000","last_fullsized":"2023-08-25T04:46:21.972608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'291","last_scrub_stamp":"2023-08-25T04:46:21.972508+0000","last_deep_scrub":"23'291","last_deep_scrub_stamp":"2023-08-25T04:46:21.972508+0000","last_clean_scrub_stamp":"2023-08-25T04:46:21.972508+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:25.669510+0000","scrub_duration":0.002317838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.805506+0000","last_change":"2023-08-25T04:45:52.805506+0000","last_active":"2023-08-25T04:45:52.805506+0000","last_peered":"2023-08-25T04:45:52.805506+0000","last_clean":"2023-08-25T04:45:52.805506+0000","last_became_active":"2023-08-25T04:43:41.885299+0000","last_became_peered":"2023-08-25T04:43:41.885299+0000","last_unstale":"2023-08-25T04:45:52.805506+0000","last_undegraded":"2023-08-25T04:45:52.805506+0000","last_fullsized":"2023-08-25T04:45:52.805506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:45:52.805353+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:45:52.805353+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.805353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:28.630344+0000","scrub_duration":0.0017761649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'269","reported_seq":294,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.678926+0000","last_change":"2023-08-25T04:46:03.678987+0000","last_active":"2023-08-25T04:46:03.678926+0000","last_peered":"2023-08-25T04:46:03.678926+0000","last_clean":"2023-08-25T04:46:03.678926+0000","last_became_active":"2023-08-25T04:43:42.898874+0000","last_became_peered":"2023-08-25T04:43:42.898874+0000","last_unstale":"2023-08-25T04:46:03.678926+0000","last_undegraded":"2023-08-25T04:46:03.678926+0000","last_fullsized":"2023-08-25T04:46:03.678926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'269","last_scrub_stamp":"2023-08-25T04:46:03.678818+0000","last_deep_scrub":"23'269","last_deep_scrub_stamp":"2023-08-25T04:46:03.678818+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.678818+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:44.606031+0000","scrub_duration":0.0016713940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.002914+0000","last_change":"2023-08-25T04:46:00.002914+0000","last_active":"2023-08-25T04:46:00.002914+0000","last_peered":"2023-08-25T04:46:00.002914+0000","last_clean":"2023-08-25T04:46:00.002914+0000","last_became_active":"2023-08-25T04:43:41.882381+0000","last_became_peered":"2023-08-25T04:43:41.882381+0000","last_unstale":"2023-08-25T04:46:00.002914+0000","last_undegraded":"2023-08-25T04:46:00.002914+0000","last_fullsized":"2023-08-25T04:46:00.002914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:46:00.002750+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:46:00.002750+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.002750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:35.827741+0000","scrub_duration":0.0019692830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'262","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:20.224044+0000","last_change":"2023-08-25T04:46:20.224100+0000","last_active":"2023-08-25T04:46:20.224044+0000","last_peered":"2023-08-25T04:46:20.224044+0000","last_clean":"2023-08-25T04:46:20.224044+0000","last_became_active":"2023-08-25T04:44:30.481273+0000","last_became_peered":"2023-08-25T04:44:30.481273+0000","last_unstale":"2023-08-25T04:46:20.224044+0000","last_undegraded":"2023-08-25T04:46:20.224044+0000","last_fullsized":"2023-08-25T04:46:20.224044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'262","last_scrub_stamp":"2023-08-25T04:46:20.223925+0000","last_deep_scrub":"23'262","last_deep_scrub_stamp":"2023-08-25T04:46:20.223925+0000","last_clean_scrub_stamp":"2023-08-25T04:46:20.223925+0000","objects_scrubbed":1,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:35:24.382164+0000","scrub_duration":0.0097733969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.353165+0000","last_change":"2023-08-25T04:46:01.353165+0000","last_active":"2023-08-25T04:46:01.353165+0000","last_peered":"2023-08-25T04:46:01.353165+0000","last_clean":"2023-08-25T04:46:01.353165+0000","last_became_active":"2023-08-25T04:43:41.882055+0000","last_became_peered":"2023-08-25T04:43:41.882055+0000","last_unstale":"2023-08-25T04:46:01.353165+0000","last_undegraded":"2023-08-25T04:46:01.353165+0000","last_fullsized":"2023-08-25T04:46:01.353165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:01.352985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:01.352985+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.352985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:37.177976+0000","scrub_duration":0.001474939,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"23'269","reported_seq":294,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:18.181975+0000","last_change":"2023-08-25T04:46:18.182082+0000","last_active":"2023-08-25T04:46:18.181975+0000","last_peered":"2023-08-25T04:46:18.181975+0000","last_clean":"2023-08-25T04:46:18.181975+0000","last_became_active":"2023-08-25T04:43:42.890100+0000","last_became_peered":"2023-08-25T04:43:42.890100+0000","last_unstale":"2023-08-25T04:46:18.181975+0000","last_undegraded":"2023-08-25T04:46:18.181975+0000","last_fullsized":"2023-08-25T04:46:18.181975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'269","last_scrub_stamp":"2023-08-25T04:46:18.181858+0000","last_deep_scrub":"23'269","last_deep_scrub_stamp":"2023-08-25T04:46:18.181858+0000","last_clean_scrub_stamp":"2023-08-25T04:46:18.181858+0000","objects_scrubbed":1,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:21.878859+0000","scrub_duration":0.010619290999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'14","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:16.038350+0000","last_change":"2023-08-25T04:46:16.038435+0000","last_active":"2023-08-25T04:46:16.038350+0000","last_peered":"2023-08-25T04:46:16.038350+0000","last_clean":"2023-08-25T04:46:16.038350+0000","last_became_active":"2023-08-25T04:43:41.887622+0000","last_became_peered":"2023-08-25T04:43:41.887622+0000","last_unstale":"2023-08-25T04:46:16.038350+0000","last_undegraded":"2023-08-25T04:46:16.038350+0000","last_fullsized":"2023-08-25T04:46:16.038350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2023-08-25T04:46:16.038244+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2023-08-25T04:46:16.038244+0000","last_clean_scrub_stamp":"2023-08-25T04:46:16.038244+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:55.468243+0000","scrub_duration":0.0038245340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"23'273","reported_seq":298,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:21.375329+0000","last_change":"2023-08-25T04:46:21.375408+0000","last_active":"2023-08-25T04:46:21.375329+0000","last_peered":"2023-08-25T04:46:21.375329+0000","last_clean":"2023-08-25T04:46:21.375329+0000","last_became_active":"2023-08-25T04:43:42.890648+0000","last_became_peered":"2023-08-25T04:43:42.890648+0000","last_unstale":"2023-08-25T04:46:21.375329+0000","last_undegraded":"2023-08-25T04:46:21.375329+0000","last_fullsized":"2023-08-25T04:46:21.375329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'273","last_scrub_stamp":"2023-08-25T04:46:21.375181+0000","last_deep_scrub":"23'273","last_deep_scrub_stamp":"2023-08-25T04:46:21.375181+0000","last_clean_scrub_stamp":"2023-08-25T04:46:21.375181+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:15.079856+0000","scrub_duration":0.002419259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'388","reported_seq":415,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:17.068231+0000","last_change":"2023-08-25T04:46:17.068287+0000","last_active":"2023-08-25T04:46:17.068231+0000","last_peered":"2023-08-25T04:46:17.068231+0000","last_clean":"2023-08-25T04:46:17.068231+0000","last_became_active":"2023-08-25T04:43:41.886491+0000","last_became_peered":"2023-08-25T04:43:41.886491+0000","last_unstale":"2023-08-25T04:46:17.068231+0000","last_undegraded":"2023-08-25T04:46:17.068231+0000","last_fullsized":"2023-08-25T04:46:17.068231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'388","last_scrub_stamp":"2023-08-25T04:46:17.068129+0000","last_deep_scrub":"23'388","last_deep_scrub_stamp":"2023-08-25T04:46:17.068129+0000","last_clean_scrub_stamp":"2023-08-25T04:46:17.068129+0000","objects_scrubbed":4,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:10.164314+0000","scrub_duration":0.0091339360000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1510889,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":385,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"23'297","reported_seq":322,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:43.181046+0000","last_change":"2023-08-25T04:46:43.181092+0000","last_active":"2023-08-25T04:46:43.181046+0000","last_peered":"2023-08-25T04:46:43.181046+0000","last_clean":"2023-08-25T04:46:43.181046+0000","last_became_active":"2023-08-25T04:43:42.893525+0000","last_became_peered":"2023-08-25T04:43:42.893525+0000","last_unstale":"2023-08-25T04:46:43.181046+0000","last_undegraded":"2023-08-25T04:46:43.181046+0000","last_fullsized":"2023-08-25T04:46:43.181046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'297","last_scrub_stamp":"2023-08-25T04:46:43.180921+0000","last_deep_scrub":"23'297","last_deep_scrub_stamp":"2023-08-25T04:46:43.180921+0000","last_clean_scrub_stamp":"2023-08-25T04:46:43.180921+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:03.208662+0000","scrub_duration":0.00175347,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'5","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:10.209723+0000","last_change":"2023-08-25T04:46:10.209775+0000","last_active":"2023-08-25T04:46:10.209723+0000","last_peered":"2023-08-25T04:46:10.209723+0000","last_clean":"2023-08-25T04:46:10.209723+0000","last_became_active":"2023-08-25T04:43:41.890673+0000","last_became_peered":"2023-08-25T04:43:41.890673+0000","last_unstale":"2023-08-25T04:46:10.209723+0000","last_undegraded":"2023-08-25T04:46:10.209723+0000","last_fullsized":"2023-08-25T04:46:10.209723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2023-08-25T04:46:10.209611+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2023-08-25T04:46:10.209611+0000","last_clean_scrub_stamp":"2023-08-25T04:46:10.209611+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:03.914286+0000","scrub_duration":0.0034207019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"23'270","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:23.191356+0000","last_change":"2023-08-25T04:46:23.191414+0000","last_active":"2023-08-25T04:46:23.191356+0000","last_peered":"2023-08-25T04:46:23.191356+0000","last_clean":"2023-08-25T04:46:23.191356+0000","last_became_active":"2023-08-25T04:43:42.897204+0000","last_became_peered":"2023-08-25T04:43:42.897204+0000","last_unstale":"2023-08-25T04:46:23.191356+0000","last_undegraded":"2023-08-25T04:46:23.191356+0000","last_fullsized":"2023-08-25T04:46:23.191356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'270","last_scrub_stamp":"2023-08-25T04:46:23.191215+0000","last_deep_scrub":"23'270","last_deep_scrub_stamp":"2023-08-25T04:46:23.191215+0000","last_clean_scrub_stamp":"2023-08-25T04:46:23.191215+0000","objects_scrubbed":1,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:16.287401+0000","scrub_duration":0.0084130279999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.983964+0000","last_change":"2023-08-25T04:45:52.983964+0000","last_active":"2023-08-25T04:45:52.983964+0000","last_peered":"2023-08-25T04:45:52.983964+0000","last_clean":"2023-08-25T04:45:52.983964+0000","last_became_active":"2023-08-25T04:43:41.881067+0000","last_became_peered":"2023-08-25T04:43:41.881067+0000","last_unstale":"2023-08-25T04:45:52.983964+0000","last_undegraded":"2023-08-25T04:45:52.983964+0000","last_fullsized":"2023-08-25T04:45:52.983964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:52.983794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:52.983794+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.983794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:28:30.719694+0000","scrub_duration":0.0024229049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'253","reported_seq":278,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:13.249412+0000","last_change":"2023-08-25T04:46:13.249462+0000","last_active":"2023-08-25T04:46:13.249412+0000","last_peered":"2023-08-25T04:46:13.249412+0000","last_clean":"2023-08-25T04:46:13.249412+0000","last_became_active":"2023-08-25T04:43:42.894807+0000","last_became_peered":"2023-08-25T04:43:42.894807+0000","last_unstale":"2023-08-25T04:46:13.249412+0000","last_undegraded":"2023-08-25T04:46:13.249412+0000","last_fullsized":"2023-08-25T04:46:13.249412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'253","last_scrub_stamp":"2023-08-25T04:46:13.249311+0000","last_deep_scrub":"23'253","last_deep_scrub_stamp":"2023-08-25T04:46:13.249311+0000","last_clean_scrub_stamp":"2023-08-25T04:46:13.249311+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:06.953986+0000","scrub_duration":0.001625549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:11.159065+0000","last_change":"2023-08-25T04:46:11.159117+0000","last_active":"2023-08-25T04:46:11.159065+0000","last_peered":"2023-08-25T04:46:11.159065+0000","last_clean":"2023-08-25T04:46:11.159065+0000","last_became_active":"2023-08-25T04:43:41.890706+0000","last_became_peered":"2023-08-25T04:43:41.890706+0000","last_unstale":"2023-08-25T04:46:11.159065+0000","last_undegraded":"2023-08-25T04:46:11.159065+0000","last_fullsized":"2023-08-25T04:46:11.159065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:46:11.158932+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:46:11.158932+0000","last_clean_scrub_stamp":"2023-08-25T04:46:11.158932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:52.839390+0000","scrub_duration":0.0015778840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"23'288","reported_seq":313,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:11.944082+0000","last_change":"2023-08-25T04:46:11.944161+0000","last_active":"2023-08-25T04:46:11.944082+0000","last_peered":"2023-08-25T04:46:11.944082+0000","last_clean":"2023-08-25T04:46:11.944082+0000","last_became_active":"2023-08-25T04:43:42.897476+0000","last_became_peered":"2023-08-25T04:43:42.897476+0000","last_unstale":"2023-08-25T04:46:11.944082+0000","last_undegraded":"2023-08-25T04:46:11.944082+0000","last_fullsized":"2023-08-25T04:46:11.944082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'288","last_scrub_stamp":"2023-08-25T04:46:11.943899+0000","last_deep_scrub":"23'288","last_deep_scrub_stamp":"2023-08-25T04:46:11.943899+0000","last_clean_scrub_stamp":"2023-08-25T04:46:11.943899+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:05.648574+0000","scrub_duration":0.0021087810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'12","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:58.712516+0000","last_change":"2023-08-25T04:45:58.712516+0000","last_active":"2023-08-25T04:45:58.712516+0000","last_peered":"2023-08-25T04:45:58.712516+0000","last_clean":"2023-08-25T04:45:58.712516+0000","last_became_active":"2023-08-25T04:43:41.892517+0000","last_became_peered":"2023-08-25T04:43:41.892517+0000","last_unstale":"2023-08-25T04:45:58.712516+0000","last_undegraded":"2023-08-25T04:45:58.712516+0000","last_fullsized":"2023-08-25T04:45:58.712516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2023-08-25T04:45:58.712345+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2023-08-25T04:45:58.712345+0000","last_clean_scrub_stamp":"2023-08-25T04:45:58.712345+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:37:12.386852+0000","scrub_duration":0.0051496449999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"23'268","reported_seq":293,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:48.424071+0000","last_change":"2023-08-25T04:46:48.424146+0000","last_active":"2023-08-25T04:46:48.424071+0000","last_peered":"2023-08-25T04:46:48.424071+0000","last_clean":"2023-08-25T04:46:48.424071+0000","last_became_active":"2023-08-25T04:43:42.904736+0000","last_became_peered":"2023-08-25T04:43:42.904736+0000","last_unstale":"2023-08-25T04:46:48.424071+0000","last_undegraded":"2023-08-25T04:46:48.424071+0000","last_fullsized":"2023-08-25T04:46:48.424071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'268","last_scrub_stamp":"2023-08-25T04:46:48.423896+0000","last_deep_scrub":"23'268","last_deep_scrub_stamp":"2023-08-25T04:46:48.423896+0000","last_clean_scrub_stamp":"2023-08-25T04:46:48.423896+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:08.451636+0000","scrub_duration":0.002426241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:24.138150+0000","last_change":"2023-08-25T04:46:24.138227+0000","last_active":"2023-08-25T04:46:24.138150+0000","last_peered":"2023-08-25T04:46:24.138150+0000","last_clean":"2023-08-25T04:46:24.138150+0000","last_became_active":"2023-08-25T04:43:41.890942+0000","last_became_peered":"2023-08-25T04:43:41.890942+0000","last_unstale":"2023-08-25T04:46:24.138150+0000","last_undegraded":"2023-08-25T04:46:24.138150+0000","last_fullsized":"2023-08-25T04:46:24.138150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-08-25T04:46:24.138037+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-08-25T04:46:24.138037+0000","last_clean_scrub_stamp":"2023-08-25T04:46:24.138037+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:27.835038+0000","scrub_duration":0.003479546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"23'238","reported_seq":263,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:14.281547+0000","last_change":"2023-08-25T04:46:14.281593+0000","last_active":"2023-08-25T04:46:14.281547+0000","last_peered":"2023-08-25T04:46:14.281547+0000","last_clean":"2023-08-25T04:46:14.281547+0000","last_became_active":"2023-08-25T04:43:42.894285+0000","last_became_peered":"2023-08-25T04:43:42.894285+0000","last_unstale":"2023-08-25T04:46:14.281547+0000","last_undegraded":"2023-08-25T04:46:14.281547+0000","last_fullsized":"2023-08-25T04:46:14.281547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'238","last_scrub_stamp":"2023-08-25T04:46:14.281430+0000","last_deep_scrub":"23'238","last_deep_scrub_stamp":"2023-08-25T04:46:14.281430+0000","last_clean_scrub_stamp":"2023-08-25T04:46:14.281430+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:55.961888+0000","scrub_duration":0.0016190309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'3","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:15.085333+0000","last_change":"2023-08-25T04:46:15.085384+0000","last_active":"2023-08-25T04:46:15.085333+0000","last_peered":"2023-08-25T04:46:15.085333+0000","last_clean":"2023-08-25T04:46:15.085333+0000","last_became_active":"2023-08-25T04:43:41.890883+0000","last_became_peered":"2023-08-25T04:43:41.890883+0000","last_unstale":"2023-08-25T04:46:15.085333+0000","last_undegraded":"2023-08-25T04:46:15.085333+0000","last_fullsized":"2023-08-25T04:46:15.085333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-08-25T04:46:15.085227+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-08-25T04:46:15.085227+0000","last_clean_scrub_stamp":"2023-08-25T04:46:15.085227+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:22.671025+0000","scrub_duration":0.0028661110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"23'265","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944660+0000","last_change":"2023-08-25T04:43:42.891686+0000","last_active":"2023-08-25T04:45:49.944660+0000","last_peered":"2023-08-25T04:45:49.944660+0000","last_clean":"2023-08-25T04:45:49.944660+0000","last_became_active":"2023-08-25T04:43:42.891443+0000","last_became_peered":"2023-08-25T04:43:42.891443+0000","last_unstale":"2023-08-25T04:45:49.944660+0000","last_undegraded":"2023-08-25T04:45:49.944660+0000","last_fullsized":"2023-08-25T04:45:49.944660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:02.258330+0000","last_change":"2023-08-25T04:46:02.258387+0000","last_active":"2023-08-25T04:46:02.258330+0000","last_peered":"2023-08-25T04:46:02.258330+0000","last_clean":"2023-08-25T04:46:02.258330+0000","last_became_active":"2023-08-25T04:43:41.888447+0000","last_became_peered":"2023-08-25T04:43:41.888447+0000","last_unstale":"2023-08-25T04:46:02.258330+0000","last_undegraded":"2023-08-25T04:46:02.258330+0000","last_fullsized":"2023-08-25T04:46:02.258330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-08-25T04:46:02.258220+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-08-25T04:46:02.258220+0000","last_clean_scrub_stamp":"2023-08-25T04:46:02.258220+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:50.337360+0000","scrub_duration":0.0030581060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"23'270","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.667962+0000","last_change":"2023-08-25T04:46:00.668030+0000","last_active":"2023-08-25T04:46:00.667962+0000","last_peered":"2023-08-25T04:46:00.667962+0000","last_clean":"2023-08-25T04:46:00.667962+0000","last_became_active":"2023-08-25T04:43:42.892191+0000","last_became_peered":"2023-08-25T04:43:42.892191+0000","last_unstale":"2023-08-25T04:46:00.667962+0000","last_undegraded":"2023-08-25T04:46:00.667962+0000","last_fullsized":"2023-08-25T04:46:00.667962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'270","last_scrub_stamp":"2023-08-25T04:46:00.667852+0000","last_deep_scrub":"23'270","last_deep_scrub_stamp":"2023-08-25T04:46:00.667852+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.667852+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:25:37.904637+0000","scrub_duration":0.002178714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:54.495493+0000","last_change":"2023-08-25T04:45:54.495493+0000","last_active":"2023-08-25T04:45:54.495493+0000","last_peered":"2023-08-25T04:45:54.495493+0000","last_clean":"2023-08-25T04:45:54.495493+0000","last_became_active":"2023-08-25T04:43:41.884098+0000","last_became_peered":"2023-08-25T04:43:41.884098+0000","last_unstale":"2023-08-25T04:45:54.495493+0000","last_undegraded":"2023-08-25T04:45:54.495493+0000","last_fullsized":"2023-08-25T04:45:54.495493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:45:54.495284+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:45:54.495284+0000","last_clean_scrub_stamp":"2023-08-25T04:45:54.495284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:35.422497+0000","scrub_duration":0.0022346089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"23'270","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:18.981074+0000","last_change":"2023-08-25T04:46:18.981133+0000","last_active":"2023-08-25T04:46:18.981074+0000","last_peered":"2023-08-25T04:46:18.981074+0000","last_clean":"2023-08-25T04:46:18.981074+0000","last_became_active":"2023-08-25T04:43:42.880104+0000","last_became_peered":"2023-08-25T04:43:42.880104+0000","last_unstale":"2023-08-25T04:46:18.981074+0000","last_undegraded":"2023-08-25T04:46:18.981074+0000","last_fullsized":"2023-08-25T04:46:18.981074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'270","last_scrub_stamp":"2023-08-25T04:46:18.980949+0000","last_deep_scrub":"23'270","last_deep_scrub_stamp":"2023-08-25T04:46:18.980949+0000","last_clean_scrub_stamp":"2023-08-25T04:46:18.980949+0000","objects_scrubbed":1,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:18.301890+0000","scrub_duration":0.0082879540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'5","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.831129+0000","last_change":"2023-08-25T04:45:57.831129+0000","last_active":"2023-08-25T04:45:57.831129+0000","last_peered":"2023-08-25T04:45:57.831129+0000","last_clean":"2023-08-25T04:45:57.831129+0000","last_became_active":"2023-08-25T04:43:41.885433+0000","last_became_peered":"2023-08-25T04:43:41.885433+0000","last_unstale":"2023-08-25T04:45:57.831129+0000","last_undegraded":"2023-08-25T04:45:57.831129+0000","last_fullsized":"2023-08-25T04:45:57.831129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2023-08-25T04:45:57.830944+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2023-08-25T04:45:57.830944+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.830944+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:45.910084+0000","scrub_duration":0.0028335420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'243","reported_seq":268,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:32.179503+0000","last_change":"2023-08-25T04:46:32.179556+0000","last_active":"2023-08-25T04:46:32.179503+0000","last_peered":"2023-08-25T04:46:32.179503+0000","last_clean":"2023-08-25T04:46:32.179503+0000","last_became_active":"2023-08-25T04:43:42.896440+0000","last_became_peered":"2023-08-25T04:43:42.896440+0000","last_unstale":"2023-08-25T04:46:32.179503+0000","last_undegraded":"2023-08-25T04:46:32.179503+0000","last_fullsized":"2023-08-25T04:46:32.179503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'243","last_scrub_stamp":"2023-08-25T04:46:32.179400+0000","last_deep_scrub":"23'243","last_deep_scrub_stamp":"2023-08-25T04:46:32.179400+0000","last_clean_scrub_stamp":"2023-08-25T04:46:32.179400+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:30:51.133770+0000","scrub_duration":0.0021692249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.718106+0000","last_change":"2023-08-25T04:45:57.718160+0000","last_active":"2023-08-25T04:45:57.718106+0000","last_peered":"2023-08-25T04:45:57.718106+0000","last_clean":"2023-08-25T04:45:57.718106+0000","last_became_active":"2023-08-25T04:43:41.890827+0000","last_became_peered":"2023-08-25T04:43:41.890827+0000","last_unstale":"2023-08-25T04:45:57.718106+0000","last_undegraded":"2023-08-25T04:45:57.718106+0000","last_fullsized":"2023-08-25T04:45:57.718106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:45:57.717976+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:45:57.717976+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.717976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:15:58.043163+0000","scrub_duration":0.0018100639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"23'288","reported_seq":305,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.944535+0000","last_change":"2023-08-25T04:43:42.897377+0000","last_active":"2023-08-25T04:45:49.944535+0000","last_peered":"2023-08-25T04:45:49.944535+0000","last_clean":"2023-08-25T04:45:49.944535+0000","last_became_active":"2023-08-25T04:43:42.897108+0000","last_became_peered":"2023-08-25T04:43:42.897108+0000","last_unstale":"2023-08-25T04:45:49.944535+0000","last_undegraded":"2023-08-25T04:45:49.944535+0000","last_fullsized":"2023-08-25T04:45:49.944535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:14.033833+0000","last_change":"2023-08-25T04:46:14.033900+0000","last_active":"2023-08-25T04:46:14.033833+0000","last_peered":"2023-08-25T04:46:14.033833+0000","last_clean":"2023-08-25T04:46:14.033833+0000","last_became_active":"2023-08-25T04:43:41.888323+0000","last_became_peered":"2023-08-25T04:43:41.888323+0000","last_unstale":"2023-08-25T04:46:14.033833+0000","last_undegraded":"2023-08-25T04:46:14.033833+0000","last_fullsized":"2023-08-25T04:46:14.033833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:14.033678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:14.033678+0000","last_clean_scrub_stamp":"2023-08-25T04:46:14.033678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:35:18.191917+0000","scrub_duration":0.0021053500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"23'285","reported_seq":310,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:04.217438+0000","last_change":"2023-08-25T04:46:04.217487+0000","last_active":"2023-08-25T04:46:04.217438+0000","last_peered":"2023-08-25T04:46:04.217438+0000","last_clean":"2023-08-25T04:46:04.217438+0000","last_became_active":"2023-08-25T04:43:42.896943+0000","last_became_peered":"2023-08-25T04:43:42.896943+0000","last_unstale":"2023-08-25T04:46:04.217438+0000","last_undegraded":"2023-08-25T04:46:04.217438+0000","last_fullsized":"2023-08-25T04:46:04.217438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'285","last_scrub_stamp":"2023-08-25T04:46:04.217330+0000","last_deep_scrub":"23'285","last_deep_scrub_stamp":"2023-08-25T04:46:04.217330+0000","last_clean_scrub_stamp":"2023-08-25T04:46:04.217330+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:11.803128+0000","scrub_duration":0.0016762509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:15.146036+0000","last_change":"2023-08-25T04:46:15.146082+0000","last_active":"2023-08-25T04:46:15.146036+0000","last_peered":"2023-08-25T04:46:15.146036+0000","last_clean":"2023-08-25T04:46:15.146036+0000","last_became_active":"2023-08-25T04:43:41.886846+0000","last_became_peered":"2023-08-25T04:43:41.886846+0000","last_unstale":"2023-08-25T04:46:15.146036+0000","last_undegraded":"2023-08-25T04:46:15.146036+0000","last_fullsized":"2023-08-25T04:46:15.146036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:15.145931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:15.145931+0000","last_clean_scrub_stamp":"2023-08-25T04:46:15.145931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:14.466872+0000","scrub_duration":0.001480068,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'280","reported_seq":305,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:26.413514+0000","last_change":"2023-08-25T04:46:26.413581+0000","last_active":"2023-08-25T04:46:26.413514+0000","last_peered":"2023-08-25T04:46:26.413514+0000","last_clean":"2023-08-25T04:46:26.413514+0000","last_became_active":"2023-08-25T04:43:42.902123+0000","last_became_peered":"2023-08-25T04:43:42.902123+0000","last_unstale":"2023-08-25T04:46:26.413514+0000","last_undegraded":"2023-08-25T04:46:26.413514+0000","last_fullsized":"2023-08-25T04:46:26.413514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'280","last_scrub_stamp":"2023-08-25T04:46:26.413389+0000","last_deep_scrub":"23'280","last_deep_scrub_stamp":"2023-08-25T04:46:26.413389+0000","last_clean_scrub_stamp":"2023-08-25T04:46:26.413389+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:06:05.843388+0000","scrub_duration":0.0016787550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'4","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:06.992606+0000","last_change":"2023-08-25T04:46:06.992658+0000","last_active":"2023-08-25T04:46:06.992606+0000","last_peered":"2023-08-25T04:46:06.992606+0000","last_clean":"2023-08-25T04:46:06.992606+0000","last_became_active":"2023-08-25T04:43:41.882776+0000","last_became_peered":"2023-08-25T04:43:41.882776+0000","last_unstale":"2023-08-25T04:46:06.992606+0000","last_undegraded":"2023-08-25T04:46:06.992606+0000","last_fullsized":"2023-08-25T04:46:06.992606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2023-08-25T04:46:06.992500+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2023-08-25T04:46:06.992500+0000","last_clean_scrub_stamp":"2023-08-25T04:46:06.992500+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:48.672959+0000","scrub_duration":0.0035735530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:13.079069+0000","last_change":"2023-08-25T04:46:13.079120+0000","last_active":"2023-08-25T04:46:13.079069+0000","last_peered":"2023-08-25T04:46:13.079069+0000","last_clean":"2023-08-25T04:46:13.079069+0000","last_became_active":"2023-08-25T04:43:36.785725+0000","last_became_peered":"2023-08-25T04:43:36.785725+0000","last_unstale":"2023-08-25T04:46:13.079069+0000","last_undegraded":"2023-08-25T04:46:13.079069+0000","last_fullsized":"2023-08-25T04:46:13.079069+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:13.078953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:13.078953+0000","last_clean_scrub_stamp":"2023-08-25T04:46:13.078953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:16.775955+0000","scrub_duration":0.0021933959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"23'254","reported_seq":279,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:16.169561+0000","last_change":"2023-08-25T04:46:16.169612+0000","last_active":"2023-08-25T04:46:16.169561+0000","last_peered":"2023-08-25T04:46:16.169561+0000","last_clean":"2023-08-25T04:46:16.169561+0000","last_became_active":"2023-08-25T04:43:42.889721+0000","last_became_peered":"2023-08-25T04:43:42.889721+0000","last_unstale":"2023-08-25T04:46:16.169561+0000","last_undegraded":"2023-08-25T04:46:16.169561+0000","last_fullsized":"2023-08-25T04:46:16.169561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'254","last_scrub_stamp":"2023-08-25T04:46:16.169445+0000","last_deep_scrub":"23'254","last_deep_scrub_stamp":"2023-08-25T04:46:16.169445+0000","last_clean_scrub_stamp":"2023-08-25T04:46:16.169445+0000","objects_scrubbed":1,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:16:29.603610+0000","scrub_duration":0.0096788659999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:50.725288+0000","last_change":"2023-08-25T04:45:50.725366+0000","last_active":"2023-08-25T04:45:50.725288+0000","last_peered":"2023-08-25T04:45:50.725288+0000","last_clean":"2023-08-25T04:45:50.725288+0000","last_became_active":"2023-08-25T04:43:36.782680+0000","last_became_peered":"2023-08-25T04:43:36.782680+0000","last_unstale":"2023-08-25T04:45:50.725288+0000","last_undegraded":"2023-08-25T04:45:50.725288+0000","last_fullsized":"2023-08-25T04:45:50.725288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:50.725133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:50.725133+0000","last_clean_scrub_stamp":"2023-08-25T04:45:50.725133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:59.488947+0000","scrub_duration":0.0018703929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'10","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:56.942806+0000","last_change":"2023-08-25T04:45:56.942911+0000","last_active":"2023-08-25T04:45:56.942806+0000","last_peered":"2023-08-25T04:45:56.942806+0000","last_clean":"2023-08-25T04:45:56.942806+0000","last_became_active":"2023-08-25T04:43:41.885363+0000","last_became_peered":"2023-08-25T04:43:41.885363+0000","last_unstale":"2023-08-25T04:45:56.942806+0000","last_undegraded":"2023-08-25T04:45:56.942806+0000","last_fullsized":"2023-08-25T04:45:56.942806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2023-08-25T04:45:56.942677+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2023-08-25T04:45:56.942677+0000","last_clean_scrub_stamp":"2023-08-25T04:45:56.942677+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:57:56.907128+0000","scrub_duration":0.002126574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'246","reported_seq":271,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:28.159508+0000","last_change":"2023-08-25T04:46:28.159573+0000","last_active":"2023-08-25T04:46:28.159508+0000","last_peered":"2023-08-25T04:46:28.159508+0000","last_clean":"2023-08-25T04:46:28.159508+0000","last_became_active":"2023-08-25T04:43:42.898942+0000","last_became_peered":"2023-08-25T04:43:42.898942+0000","last_unstale":"2023-08-25T04:46:28.159508+0000","last_undegraded":"2023-08-25T04:46:28.159508+0000","last_fullsized":"2023-08-25T04:46:28.159508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'246","last_scrub_stamp":"2023-08-25T04:46:28.159368+0000","last_deep_scrub":"23'246","last_deep_scrub_stamp":"2023-08-25T04:46:28.159368+0000","last_clean_scrub_stamp":"2023-08-25T04:46:28.159368+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:18:53.143904+0000","scrub_duration":0.001848113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.283941+0000","last_change":"2023-08-25T04:46:00.284036+0000","last_active":"2023-08-25T04:46:00.283941+0000","last_peered":"2023-08-25T04:46:00.283941+0000","last_clean":"2023-08-25T04:46:00.283941+0000","last_became_active":"2023-08-25T04:43:36.784937+0000","last_became_peered":"2023-08-25T04:43:36.784937+0000","last_unstale":"2023-08-25T04:46:00.283941+0000","last_undegraded":"2023-08-25T04:46:00.283941+0000","last_fullsized":"2023-08-25T04:46:00.283941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:00.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:00.283816+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:41.211029+0000","scrub_duration":0.001807915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"23'119","reported_seq":185,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:53.220629+0000","last_change":"2023-08-25T04:45:53.220691+0000","last_active":"2023-08-25T04:45:53.220629+0000","last_peered":"2023-08-25T04:45:53.220629+0000","last_clean":"2023-08-25T04:45:53.220629+0000","last_became_active":"2023-08-25T04:43:36.785451+0000","last_became_peered":"2023-08-25T04:43:36.785451+0000","last_unstale":"2023-08-25T04:45:53.220629+0000","last_undegraded":"2023-08-25T04:45:53.220629+0000","last_fullsized":"2023-08-25T04:45:53.220629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2023-08-25T04:45:53.220526+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2023-08-25T04:45:53.220526+0000","last_clean_scrub_stamp":"2023-08-25T04:45:53.220526+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:57:53.184978+0000","scrub_duration":0.00569083,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'14","reported_seq":54,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:50.919372+0000","last_change":"2023-08-25T04:45:50.919443+0000","last_active":"2023-08-25T04:45:50.919372+0000","last_peered":"2023-08-25T04:45:50.919372+0000","last_clean":"2023-08-25T04:45:50.919372+0000","last_became_active":"2023-08-25T04:43:41.885029+0000","last_became_peered":"2023-08-25T04:43:41.885029+0000","last_unstale":"2023-08-25T04:45:50.919372+0000","last_undegraded":"2023-08-25T04:45:50.919372+0000","last_fullsized":"2023-08-25T04:45:50.919372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2023-08-25T04:45:50.919257+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2023-08-25T04:45:50.919257+0000","last_clean_scrub_stamp":"2023-08-25T04:45:50.919257+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:18.289019+0000","scrub_duration":0.002121202,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7272,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":13,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'275","reported_seq":300,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:12.984470+0000","last_change":"2023-08-25T04:46:12.984547+0000","last_active":"2023-08-25T04:46:12.984470+0000","last_peered":"2023-08-25T04:46:12.984470+0000","last_clean":"2023-08-25T04:46:12.984470+0000","last_became_active":"2023-08-25T04:43:42.880591+0000","last_became_peered":"2023-08-25T04:43:42.880591+0000","last_unstale":"2023-08-25T04:46:12.984470+0000","last_undegraded":"2023-08-25T04:46:12.984470+0000","last_fullsized":"2023-08-25T04:46:12.984470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'275","last_scrub_stamp":"2023-08-25T04:46:12.984338+0000","last_deep_scrub":"23'275","last_deep_scrub_stamp":"2023-08-25T04:46:12.984338+0000","last_clean_scrub_stamp":"2023-08-25T04:46:12.984338+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:54.664796+0000","scrub_duration":0.001898091,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.160820+0000","last_change":"2023-08-25T04:45:57.160870+0000","last_active":"2023-08-25T04:45:57.160820+0000","last_peered":"2023-08-25T04:45:57.160820+0000","last_clean":"2023-08-25T04:45:57.160820+0000","last_became_active":"2023-08-25T04:43:37.192594+0000","last_became_peered":"2023-08-25T04:43:37.192594+0000","last_unstale":"2023-08-25T04:45:57.160820+0000","last_undegraded":"2023-08-25T04:45:57.160820+0000","last_fullsized":"2023-08-25T04:45:57.160820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:57.160708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:57.160708+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.160708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:32.985699+0000","scrub_duration":0.0019998730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.362033+0000","last_change":"2023-08-25T04:46:03.362124+0000","last_active":"2023-08-25T04:46:03.362033+0000","last_peered":"2023-08-25T04:46:03.362033+0000","last_clean":"2023-08-25T04:46:03.362033+0000","last_became_active":"2023-08-25T04:43:41.888158+0000","last_became_peered":"2023-08-25T04:43:41.888158+0000","last_unstale":"2023-08-25T04:46:03.362033+0000","last_undegraded":"2023-08-25T04:46:03.362033+0000","last_fullsized":"2023-08-25T04:46:03.362033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:03.361887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:03.361887+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.361887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:22.060209+0000","scrub_duration":0.0021121450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'249","reported_seq":274,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:29.463247+0000","last_change":"2023-08-25T04:46:29.463299+0000","last_active":"2023-08-25T04:46:29.463247+0000","last_peered":"2023-08-25T04:46:29.463247+0000","last_clean":"2023-08-25T04:46:29.463247+0000","last_became_active":"2023-08-25T04:43:42.901657+0000","last_became_peered":"2023-08-25T04:43:42.901657+0000","last_unstale":"2023-08-25T04:46:29.463247+0000","last_undegraded":"2023-08-25T04:46:29.463247+0000","last_fullsized":"2023-08-25T04:46:29.463247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'249","last_scrub_stamp":"2023-08-25T04:46:29.463120+0000","last_deep_scrub":"23'249","last_deep_scrub_stamp":"2023-08-25T04:46:29.463120+0000","last_clean_scrub_stamp":"2023-08-25T04:46:29.463120+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:16:42.897285+0000","scrub_duration":0.0024623650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:55.203439+0000","last_change":"2023-08-25T04:45:55.203486+0000","last_active":"2023-08-25T04:45:55.203439+0000","last_peered":"2023-08-25T04:45:55.203439+0000","last_clean":"2023-08-25T04:45:55.203439+0000","last_became_active":"2023-08-25T04:43:37.192427+0000","last_became_peered":"2023-08-25T04:43:37.192427+0000","last_unstale":"2023-08-25T04:45:55.203439+0000","last_undegraded":"2023-08-25T04:45:55.203439+0000","last_fullsized":"2023-08-25T04:45:55.203439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:55.203319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:55.203319+0000","last_clean_scrub_stamp":"2023-08-25T04:45:55.203319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:03.967132+0000","scrub_duration":0.0023883820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:05.948775+0000","last_change":"2023-08-25T04:46:05.948826+0000","last_active":"2023-08-25T04:46:05.948775+0000","last_peered":"2023-08-25T04:46:05.948775+0000","last_clean":"2023-08-25T04:46:05.948775+0000","last_became_active":"2023-08-25T04:43:41.883621+0000","last_became_peered":"2023-08-25T04:43:41.883621+0000","last_unstale":"2023-08-25T04:46:05.948775+0000","last_undegraded":"2023-08-25T04:46:05.948775+0000","last_fullsized":"2023-08-25T04:46:05.948775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:05.948651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:05.948651+0000","last_clean_scrub_stamp":"2023-08-25T04:46:05.948651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:59.653326+0000","scrub_duration":0.001754584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.661611+0000","last_change":"2023-08-25T04:46:01.661661+0000","last_active":"2023-08-25T04:46:01.661611+0000","last_peered":"2023-08-25T04:46:01.661611+0000","last_clean":"2023-08-25T04:46:01.661611+0000","last_became_active":"2023-08-25T04:43:42.893333+0000","last_became_peered":"2023-08-25T04:43:42.893333+0000","last_unstale":"2023-08-25T04:46:01.661611+0000","last_undegraded":"2023-08-25T04:46:01.661611+0000","last_fullsized":"2023-08-25T04:46:01.661611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:01.661506+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:01.661506+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.661506+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:29.031268+0000","scrub_duration":0.0017295419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.501952+0000","last_change":"2023-08-25T04:45:51.502008+0000","last_active":"2023-08-25T04:45:51.501952+0000","last_peered":"2023-08-25T04:45:51.501952+0000","last_clean":"2023-08-25T04:45:51.501952+0000","last_became_active":"2023-08-25T04:43:37.192432+0000","last_became_peered":"2023-08-25T04:43:37.192432+0000","last_unstale":"2023-08-25T04:45:51.501952+0000","last_undegraded":"2023-08-25T04:45:51.501952+0000","last_fullsized":"2023-08-25T04:45:51.501952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:51.501848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:51.501848+0000","last_clean_scrub_stamp":"2023-08-25T04:45:51.501848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:18.871610+0000","scrub_duration":0.0015800009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:14.988470+0000","last_change":"2023-08-25T04:46:14.988549+0000","last_active":"2023-08-25T04:46:14.988470+0000","last_peered":"2023-08-25T04:46:14.988470+0000","last_clean":"2023-08-25T04:46:14.988470+0000","last_became_active":"2023-08-25T04:43:41.889717+0000","last_became_peered":"2023-08-25T04:43:41.889717+0000","last_unstale":"2023-08-25T04:46:14.988470+0000","last_undegraded":"2023-08-25T04:46:14.988470+0000","last_fullsized":"2023-08-25T04:46:14.988470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:14.988323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:14.988323+0000","last_clean_scrub_stamp":"2023-08-25T04:46:14.988323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:11:58.826953+0000","scrub_duration":0.0019775750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"23'260","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:28.444582+0000","last_change":"2023-08-25T04:46:28.444663+0000","last_active":"2023-08-25T04:46:28.444582+0000","last_peered":"2023-08-25T04:46:28.444582+0000","last_clean":"2023-08-25T04:46:28.444582+0000","last_became_active":"2023-08-25T04:43:42.885671+0000","last_became_peered":"2023-08-25T04:43:42.885671+0000","last_unstale":"2023-08-25T04:46:28.444582+0000","last_undegraded":"2023-08-25T04:46:28.444582+0000","last_fullsized":"2023-08-25T04:46:28.444582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'260","last_scrub_stamp":"2023-08-25T04:46:28.444450+0000","last_deep_scrub":"23'260","last_deep_scrub_stamp":"2023-08-25T04:46:28.444450+0000","last_clean_scrub_stamp":"2023-08-25T04:46:28.444450+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:27.765391+0000","scrub_duration":0.001797613,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:54.771152+0000","last_change":"2023-08-25T04:45:54.771206+0000","last_active":"2023-08-25T04:45:54.771152+0000","last_peered":"2023-08-25T04:45:54.771152+0000","last_clean":"2023-08-25T04:45:54.771152+0000","last_became_active":"2023-08-25T04:43:37.192429+0000","last_became_peered":"2023-08-25T04:43:37.192429+0000","last_unstale":"2023-08-25T04:45:54.771152+0000","last_undegraded":"2023-08-25T04:45:54.771152+0000","last_fullsized":"2023-08-25T04:45:54.771152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:54.771023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:54.771023+0000","last_clean_scrub_stamp":"2023-08-25T04:45:54.771023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:36:51.613947+0000","scrub_duration":0.00223077,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"23'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:09.442864+0000","last_change":"2023-08-25T04:46:09.442913+0000","last_active":"2023-08-25T04:46:09.442864+0000","last_peered":"2023-08-25T04:46:09.442864+0000","last_clean":"2023-08-25T04:46:09.442864+0000","last_became_active":"2023-08-25T04:43:41.888207+0000","last_became_peered":"2023-08-25T04:43:41.888207+0000","last_unstale":"2023-08-25T04:46:09.442864+0000","last_undegraded":"2023-08-25T04:46:09.442864+0000","last_fullsized":"2023-08-25T04:46:09.442864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-08-25T04:46:09.442734+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-08-25T04:46:09.442734+0000","last_clean_scrub_stamp":"2023-08-25T04:46:09.442734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:45.267725+0000","scrub_duration":0.001704176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'310","reported_seq":335,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:19.995299+0000","last_change":"2023-08-25T04:46:19.995353+0000","last_active":"2023-08-25T04:46:19.995299+0000","last_peered":"2023-08-25T04:46:19.995299+0000","last_clean":"2023-08-25T04:46:19.995299+0000","last_became_active":"2023-08-25T04:43:42.900470+0000","last_became_peered":"2023-08-25T04:43:42.900470+0000","last_unstale":"2023-08-25T04:46:19.995299+0000","last_undegraded":"2023-08-25T04:46:19.995299+0000","last_fullsized":"2023-08-25T04:46:19.995299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'310","last_scrub_stamp":"2023-08-25T04:46:19.995142+0000","last_deep_scrub":"23'310","last_deep_scrub_stamp":"2023-08-25T04:46:19.995142+0000","last_clean_scrub_stamp":"2023-08-25T04:46:19.995142+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:16:33.429307+0000","scrub_duration":0.002470397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:53.765264+0000","last_change":"2023-08-25T04:45:53.765312+0000","last_active":"2023-08-25T04:45:53.765264+0000","last_peered":"2023-08-25T04:45:53.765264+0000","last_clean":"2023-08-25T04:45:53.765264+0000","last_became_active":"2023-08-25T04:43:36.784943+0000","last_became_peered":"2023-08-25T04:43:36.784943+0000","last_unstale":"2023-08-25T04:45:53.765264+0000","last_undegraded":"2023-08-25T04:45:53.765264+0000","last_fullsized":"2023-08-25T04:45:53.765264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:53.765149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:53.765149+0000","last_clean_scrub_stamp":"2023-08-25T04:45:53.765149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:47:02.134163+0000","scrub_duration":0.0021115940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.309949+0000","last_change":"2023-08-25T04:46:00.310024+0000","last_active":"2023-08-25T04:46:00.309949+0000","last_peered":"2023-08-25T04:46:00.309949+0000","last_clean":"2023-08-25T04:46:00.309949+0000","last_became_active":"2023-08-25T04:43:41.884535+0000","last_became_peered":"2023-08-25T04:43:41.884535+0000","last_unstale":"2023-08-25T04:46:00.309949+0000","last_undegraded":"2023-08-25T04:46:00.309949+0000","last_fullsized":"2023-08-25T04:46:00.309949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:46:00.309816+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:46:00.309816+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.309816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:09.073630+0000","scrub_duration":0.0020692610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"23'273","reported_seq":298,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:25.373588+0000","last_change":"2023-08-25T04:46:25.373676+0000","last_active":"2023-08-25T04:46:25.373588+0000","last_peered":"2023-08-25T04:46:25.373588+0000","last_clean":"2023-08-25T04:46:25.373588+0000","last_became_active":"2023-08-25T04:43:42.902721+0000","last_became_peered":"2023-08-25T04:43:42.902721+0000","last_unstale":"2023-08-25T04:46:25.373588+0000","last_undegraded":"2023-08-25T04:46:25.373588+0000","last_fullsized":"2023-08-25T04:46:25.373588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'273","last_scrub_stamp":"2023-08-25T04:46:25.373435+0000","last_deep_scrub":"23'273","last_deep_scrub_stamp":"2023-08-25T04:46:25.373435+0000","last_clean_scrub_stamp":"2023-08-25T04:46:25.373435+0000","objects_scrubbed":1,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:32.959233+0000","scrub_duration":0.010531183,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:55.955731+0000","last_change":"2023-08-25T04:45:55.955731+0000","last_active":"2023-08-25T04:45:55.955731+0000","last_peered":"2023-08-25T04:45:55.955731+0000","last_clean":"2023-08-25T04:45:55.955731+0000","last_became_active":"2023-08-25T04:43:41.889659+0000","last_became_peered":"2023-08-25T04:43:41.889659+0000","last_unstale":"2023-08-25T04:45:55.955731+0000","last_undegraded":"2023-08-25T04:45:55.955731+0000","last_fullsized":"2023-08-25T04:45:55.955731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-08-25T04:45:55.955491+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-08-25T04:45:55.955491+0000","last_clean_scrub_stamp":"2023-08-25T04:45:55.955491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:14.653813+0000","scrub_duration":0.0022824579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'274","reported_seq":299,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.236575+0000","last_change":"2023-08-25T04:45:52.236575+0000","last_active":"2023-08-25T04:45:52.236575+0000","last_peered":"2023-08-25T04:45:52.236575+0000","last_clean":"2023-08-25T04:45:52.236575+0000","last_became_active":"2023-08-25T04:43:42.894618+0000","last_became_peered":"2023-08-25T04:43:42.894618+0000","last_unstale":"2023-08-25T04:45:52.236575+0000","last_undegraded":"2023-08-25T04:45:52.236575+0000","last_fullsized":"2023-08-25T04:45:52.236575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'274","last_scrub_stamp":"2023-08-25T04:45:52.236416+0000","last_deep_scrub":"23'274","last_deep_scrub_stamp":"2023-08-25T04:45:52.236416+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.236416+0000","objects_scrubbed":1,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:47:56.691703+0000","scrub_duration":0.0060813940000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'3","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.399191+0000","last_change":"2023-08-25T04:45:57.399191+0000","last_active":"2023-08-25T04:45:57.399191+0000","last_peered":"2023-08-25T04:45:57.399191+0000","last_clean":"2023-08-25T04:45:57.399191+0000","last_became_active":"2023-08-25T04:43:41.886063+0000","last_became_peered":"2023-08-25T04:43:41.886063+0000","last_unstale":"2023-08-25T04:45:57.399191+0000","last_undegraded":"2023-08-25T04:45:57.399191+0000","last_fullsized":"2023-08-25T04:45:57.399191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-08-25T04:45:57.399037+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-08-25T04:45:57.399037+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.399037+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:16.097359+0000","scrub_duration":0.0030540559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'263","reported_seq":288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.167945+0000","last_change":"2023-08-25T04:45:52.167945+0000","last_active":"2023-08-25T04:45:52.167945+0000","last_peered":"2023-08-25T04:45:52.167945+0000","last_clean":"2023-08-25T04:45:52.167945+0000","last_became_active":"2023-08-25T04:43:42.900135+0000","last_became_peered":"2023-08-25T04:43:42.900135+0000","last_unstale":"2023-08-25T04:45:52.167945+0000","last_undegraded":"2023-08-25T04:45:52.167945+0000","last_fullsized":"2023-08-25T04:45:52.167945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'263","last_scrub_stamp":"2023-08-25T04:45:52.167794+0000","last_deep_scrub":"23'263","last_deep_scrub_stamp":"2023-08-25T04:45:52.167794+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.167794+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:40.246934+0000","scrub_duration":0.00190884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'4","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:59.323712+0000","last_change":"2023-08-25T04:45:59.323712+0000","last_active":"2023-08-25T04:45:59.323712+0000","last_peered":"2023-08-25T04:45:59.323712+0000","last_clean":"2023-08-25T04:45:59.323712+0000","last_became_active":"2023-08-25T04:43:41.891306+0000","last_became_peered":"2023-08-25T04:43:41.891306+0000","last_unstale":"2023-08-25T04:45:59.323712+0000","last_undegraded":"2023-08-25T04:45:59.323712+0000","last_fullsized":"2023-08-25T04:45:59.323712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2023-08-25T04:45:59.323559+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2023-08-25T04:45:59.323559+0000","last_clean_scrub_stamp":"2023-08-25T04:45:59.323559+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:57:59.288011+0000","scrub_duration":0.0028396300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'258","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:47.197070+0000","last_change":"2023-08-25T04:46:47.197121+0000","last_active":"2023-08-25T04:46:47.197070+0000","last_peered":"2023-08-25T04:46:47.197070+0000","last_clean":"2023-08-25T04:46:47.197070+0000","last_became_active":"2023-08-25T04:43:42.894386+0000","last_became_peered":"2023-08-25T04:43:42.894386+0000","last_unstale":"2023-08-25T04:46:47.197070+0000","last_undegraded":"2023-08-25T04:46:47.197070+0000","last_fullsized":"2023-08-25T04:46:47.197070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'258","last_scrub_stamp":"2023-08-25T04:46:47.196966+0000","last_deep_scrub":"23'258","last_deep_scrub_stamp":"2023-08-25T04:46:47.196966+0000","last_clean_scrub_stamp":"2023-08-25T04:46:47.196966+0000","objects_scrubbed":1,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:28:45.798013+0000","scrub_duration":0.011337738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:11.089321+0000","last_change":"2023-08-25T04:46:11.089419+0000","last_active":"2023-08-25T04:46:11.089321+0000","last_peered":"2023-08-25T04:46:11.089321+0000","last_clean":"2023-08-25T04:46:11.089321+0000","last_became_active":"2023-08-25T04:43:41.892929+0000","last_became_peered":"2023-08-25T04:43:41.892929+0000","last_unstale":"2023-08-25T04:46:11.089321+0000","last_undegraded":"2023-08-25T04:46:11.089321+0000","last_fullsized":"2023-08-25T04:46:11.089321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-08-25T04:46:11.089185+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-08-25T04:46:11.089185+0000","last_clean_scrub_stamp":"2023-08-25T04:46:11.089185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:18.674983+0000","scrub_duration":0.0021106720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'252","reported_seq":277,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:37.415181+0000","last_change":"2023-08-25T04:46:37.415247+0000","last_active":"2023-08-25T04:46:37.415181+0000","last_peered":"2023-08-25T04:46:37.415181+0000","last_clean":"2023-08-25T04:46:37.415181+0000","last_became_active":"2023-08-25T04:43:42.894239+0000","last_became_peered":"2023-08-25T04:43:42.894239+0000","last_unstale":"2023-08-25T04:46:37.415181+0000","last_undegraded":"2023-08-25T04:46:37.415181+0000","last_fullsized":"2023-08-25T04:46:37.415181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'252","last_scrub_stamp":"2023-08-25T04:46:37.415061+0000","last_deep_scrub":"23'252","last_deep_scrub_stamp":"2023-08-25T04:46:37.415061+0000","last_clean_scrub_stamp":"2023-08-25T04:46:37.415061+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:30:56.369431+0000","scrub_duration":0.0017381160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'7","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:58.974261+0000","last_change":"2023-08-25T04:45:58.974319+0000","last_active":"2023-08-25T04:45:58.974261+0000","last_peered":"2023-08-25T04:45:58.974261+0000","last_clean":"2023-08-25T04:45:58.974261+0000","last_became_active":"2023-08-25T04:43:41.882756+0000","last_became_peered":"2023-08-25T04:43:41.882756+0000","last_unstale":"2023-08-25T04:45:58.974261+0000","last_undegraded":"2023-08-25T04:45:58.974261+0000","last_fullsized":"2023-08-25T04:45:58.974261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2023-08-25T04:45:58.974148+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2023-08-25T04:45:58.974148+0000","last_clean_scrub_stamp":"2023-08-25T04:45:58.974148+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:07.737962+0000","scrub_duration":0.0040936990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'285","reported_seq":310,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.168483+0000","last_change":"2023-08-25T04:46:01.168483+0000","last_active":"2023-08-25T04:46:01.168483+0000","last_peered":"2023-08-25T04:46:01.168483+0000","last_clean":"2023-08-25T04:46:01.168483+0000","last_became_active":"2023-08-25T04:43:42.894912+0000","last_became_peered":"2023-08-25T04:43:42.894912+0000","last_unstale":"2023-08-25T04:46:01.168483+0000","last_undegraded":"2023-08-25T04:46:01.168483+0000","last_fullsized":"2023-08-25T04:46:01.168483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'285","last_scrub_stamp":"2023-08-25T04:46:01.168322+0000","last_deep_scrub":"23'285","last_deep_scrub_stamp":"2023-08-25T04:46:01.168322+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.168322+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:22:40.848712+0000","scrub_duration":0.0017623630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"23'260","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:05.706542+0000","last_change":"2023-08-25T04:46:05.706619+0000","last_active":"2023-08-25T04:46:05.706542+0000","last_peered":"2023-08-25T04:46:05.706542+0000","last_clean":"2023-08-25T04:46:05.706542+0000","last_became_active":"2023-08-25T04:43:42.893255+0000","last_became_peered":"2023-08-25T04:43:42.893255+0000","last_unstale":"2023-08-25T04:46:05.706542+0000","last_undegraded":"2023-08-25T04:46:05.706542+0000","last_fullsized":"2023-08-25T04:46:05.706542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'260","last_scrub_stamp":"2023-08-25T04:46:05.706403+0000","last_deep_scrub":"23'260","last_deep_scrub_stamp":"2023-08-25T04:46:05.706403+0000","last_clean_scrub_stamp":"2023-08-25T04:46:05.706403+0000","objects_scrubbed":1,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:24.404725+0000","scrub_duration":0.0087624350000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"23'306","reported_seq":331,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:31.339911+0000","last_change":"2023-08-25T04:46:31.339990+0000","last_active":"2023-08-25T04:46:31.339911+0000","last_peered":"2023-08-25T04:46:31.339911+0000","last_clean":"2023-08-25T04:46:31.339911+0000","last_became_active":"2023-08-25T04:43:42.897394+0000","last_became_peered":"2023-08-25T04:43:42.897394+0000","last_unstale":"2023-08-25T04:46:31.339911+0000","last_undegraded":"2023-08-25T04:46:31.339911+0000","last_fullsized":"2023-08-25T04:46:31.339911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'306","last_scrub_stamp":"2023-08-25T04:46:31.339737+0000","last_deep_scrub":"23'306","last_deep_scrub_stamp":"2023-08-25T04:46:31.339737+0000","last_clean_scrub_stamp":"2023-08-25T04:46:31.339737+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:46.943234+0000","scrub_duration":0.0019072749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'286","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:49.408186+0000","last_change":"2023-08-25T04:43:42.894698+0000","last_active":"2023-08-25T04:45:49.408186+0000","last_peered":"2023-08-25T04:45:49.408186+0000","last_clean":"2023-08-25T04:45:49.408186+0000","last_became_active":"2023-08-25T04:43:42.894176+0000","last_became_peered":"2023-08-25T04:43:42.894176+0000","last_unstale":"2023-08-25T04:45:49.408186+0000","last_undegraded":"2023-08-25T04:45:49.408186+0000","last_fullsized":"2023-08-25T04:45:49.408186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:43:41.863923+0000","last_clean_scrub_stamp":"2023-08-25T04:43:41.863923+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"23'256","reported_seq":281,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:33.425915+0000","last_change":"2023-08-25T04:46:33.425963+0000","last_active":"2023-08-25T04:46:33.425915+0000","last_peered":"2023-08-25T04:46:33.425915+0000","last_clean":"2023-08-25T04:46:33.425915+0000","last_became_active":"2023-08-25T04:43:42.898842+0000","last_became_peered":"2023-08-25T04:43:42.898842+0000","last_unstale":"2023-08-25T04:46:33.425915+0000","last_undegraded":"2023-08-25T04:46:33.425915+0000","last_fullsized":"2023-08-25T04:46:33.425915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'256","last_scrub_stamp":"2023-08-25T04:46:33.425793+0000","last_deep_scrub":"23'256","last_deep_scrub_stamp":"2023-08-25T04:46:33.425793+0000","last_clean_scrub_stamp":"2023-08-25T04:46:33.425793+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:18:58.410329+0000","scrub_duration":0.0023056079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:13.322386+0000","last_change":"2023-08-25T04:46:13.322439+0000","last_active":"2023-08-25T04:46:13.322386+0000","last_peered":"2023-08-25T04:46:13.322386+0000","last_clean":"2023-08-25T04:46:13.322386+0000","last_became_active":"2023-08-25T04:43:42.889849+0000","last_became_peered":"2023-08-25T04:43:42.889849+0000","last_unstale":"2023-08-25T04:46:13.322386+0000","last_undegraded":"2023-08-25T04:46:13.322386+0000","last_fullsized":"2023-08-25T04:46:13.322386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:13.322282+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:13.322282+0000","last_clean_scrub_stamp":"2023-08-25T04:46:13.322282+0000","objects_scrubbed":1,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:15.465800+0000","scrub_duration":0.0081659450000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":524,"num_write_kb":1101824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16975,"ondisk_log_size":16975,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1518959,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":463,"num_write_kb":1785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3096576,"data_stored":3037918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66388,"kb_used_data":26892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94305452,"statfs":{"total":96636764160,"available":96568782848,"internally_reserved":0,"allocated":27537408,"data_stored":27359168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":1.8160000000000001,"15min":0.96299999999999997},"min":{"1min":0.27900000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.72699999999999998,"5min":18.02,"15min":18.02},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":1.96,"15min":1.014},"min":{"1min":0.317,"5min":0.316,"15min":0.316},"max":{"1min":0.70999999999999996,"5min":22.920999999999999,"15min":22.920999999999999},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":2.0139999999999998,"15min":1.093},"min":{"1min":0.435,"5min":0.314,"15min":0.314},"max":{"1min":0.96799999999999997,"5min":21.199999999999999,"15min":21.199999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":1.9690000000000001,"15min":1.032},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68200000000000005,"5min":22.437999999999999,"15min":22.437999999999999},"last":0.55100000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":1.7829999999999999,"15min":1.0389999999999999},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70899999999999996,"5min":17.844000000000001,"15min":17.844000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":2.0510000000000002,"15min":1.216},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90900000000000003,"5min":19.690999999999999,"15min":19.690999999999999},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":1.8180000000000001,"15min":0.995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76500000000000001,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":2.0409999999999999,"15min":1.2549999999999999},"min":{"1min":0.41199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.72199999999999998,"5min":21.143999999999998,"15min":21.143999999999998},"last":0.72099999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":1.4670000000000001,"15min":0.80100000000000005},"min":{"1min":0.34899999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65500000000000003,"5min":22.465,"15min":22.465},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":1.3740000000000001,"15min":0.79200000000000004},"min":{"1min":0.36199999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70899999999999996,"5min":14.042999999999999,"15min":14.042999999999999},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":1.232,"15min":0.77800000000000002},"min":{"1min":0.371,"5min":0.307,"15min":0.307},"max":{"1min":0.755,"5min":14.117000000000001,"15min":14.117000000000001},"last":0.44},{"interface":"front","average":{"1min":0.57299999999999995,"5min":1.617,"15min":0.91900000000000004},"min":{"1min":0.44500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73799999999999999,"5min":22.334,"15min":22.334},"last":0.46100000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":2.0179999999999998,"15min":1.0489999999999999},"min":{"1min":0.44400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76500000000000001,"5min":22.385000000000002,"15min":22.385000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":1.2509999999999999,"15min":0.81000000000000005},"min":{"1min":0.45700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68999999999999995,"5min":17.623000000000001,"15min":17.623000000000001},"last":0.53900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47924,"kb_used_data":8428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323916,"statfs":{"total":96636764160,"available":96587689984,"internally_reserved":0,"allocated":8630272,"data_stored":8480479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":1.7050000000000001,"15min":0.94499999999999995},"min":{"1min":0.35299999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.72199999999999998,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.7350000000000001,"15min":0.97699999999999998},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.83399999999999996,"5min":21.109000000000002,"15min":21.109000000000002},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.6919999999999999,"15min":1.272},"min":{"1min":0.39800000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78500000000000003,"5min":16.664999999999999,"15min":16.664999999999999},"last":0.432},{"interface":"front","average":{"1min":0.58099999999999996,"5min":1.6180000000000001,"15min":1.073},"min":{"1min":0.38200000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72299999999999998,"5min":22.042000000000002,"15min":22.042000000000002},"last":0.61099999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":1.73,"15min":1.3080000000000001},"min":{"1min":0.47399999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76700000000000002,"5min":19.658000000000001,"15min":19.658000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":1.4710000000000001,"15min":0.90700000000000003},"min":{"1min":0.39800000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77900000000000003,"5min":21.138999999999999,"15min":21.138999999999999},"last":0.58599999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":1.7250000000000001,"15min":0.98999999999999999},"min":{"1min":0.48099999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77800000000000002,"5min":21.971,"15min":21.971},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":2.0139999999999998,"15min":1.385},"min":{"1min":0.44500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81000000000000005,"5min":23.931000000000001,"15min":23.931000000000001},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":1.3049999999999999,"15min":0.77500000000000002},"min":{"1min":0.35299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79600000000000004,"5min":14.532999999999999,"15min":14.532999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":1.2629999999999999,"15min":0.78100000000000003},"min":{"1min":0.38700000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.65600000000000003,"5min":21.081,"15min":21.081},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.94499999999999995,"15min":0.67600000000000005},"min":{"1min":0.38900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.755,"5min":12.946,"15min":12.946},"last":0.497},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.98099999999999998,"15min":0.70299999999999996},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.82199999999999995,"5min":19.597000000000001,"15min":19.597000000000001},"last":0.68999999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":1.0009999999999999,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81799999999999995,"5min":11.266999999999999,"15min":11.266999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":1.331,"15min":0.84499999999999997},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.84699999999999998,"5min":16.693000000000001,"15min":16.693000000000001},"last":0.59999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76984,"kb_used_data":49968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94294856,"statfs":{"total":96636764160,"available":96557932544,"internally_reserved":0,"allocated":51167232,"data_stored":51013887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":1.4339999999999999,"15min":0.71399999999999997},"min":{"1min":0.26400000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":23.989999999999998,"15min":23.989999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":1.3100000000000001,"15min":0.68400000000000005},"min":{"1min":0.253,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60299999999999998,"5min":15.622,"15min":15.622},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":1.4490000000000001,"15min":0.74299999999999999},"min":{"1min":0.311,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57199999999999995,"5min":23.954000000000001,"15min":23.954000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":1.4550000000000001,"15min":0.78500000000000003},"min":{"1min":0.30599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60099999999999998,"5min":20.946000000000002,"15min":20.946000000000002},"last":0.57999999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":1.4179999999999999,"15min":0.76200000000000001},"min":{"1min":0.32400000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.67700000000000005,"5min":27.884,"15min":27.884},"last":0.63},{"interface":"front","average":{"1min":0.433,"5min":1.452,"15min":0.75},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61299999999999999,"5min":23.018000000000001,"15min":23.018000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":1.9450000000000001,"15min":1.0669999999999999},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.008,"5min":24.044,"15min":24.044},"last":0.746},{"interface":"front","average":{"1min":0.62,"5min":2.0819999999999999,"15min":1.113},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":27.940000000000001,"15min":27.940000000000001},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":2.198,"15min":1.1459999999999999},"min":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":26.969999999999999,"15min":26.969999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":1.9219999999999999,"15min":1.0700000000000001},"min":{"1min":0.35599999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90200000000000002,"5min":24.018000000000001,"15min":24.018000000000001},"last":0.84499999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":2.089,"15min":1.125},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":22.899999999999999,"15min":22.899999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":1.952,"15min":1.0980000000000001},"min":{"1min":0.42499999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97099999999999997,"5min":23.898,"15min":23.898},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":2.0750000000000002,"15min":1.137},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93200000000000005,"5min":21.010999999999999,"15min":21.010999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":1.768,"15min":1.0249999999999999},"min":{"1min":0.52800000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94799999999999995,"5min":23.053999999999998,"15min":23.053999999999998},"last":0.79000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64316,"kb_used_data":24820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94307524,"statfs":{"total":96636764160,"available":96570904576,"internally_reserved":0,"allocated":25415680,"data_stored":25264588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":1.0649999999999999,"15min":0.59499999999999997},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.50800000000000001,"5min":19.956,"15min":19.956},"last":0.433},{"interface":"front","average":{"1min":0.46800000000000003,"5min":1.2270000000000001,"15min":0.68100000000000005},"min":{"1min":0.27300000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.79400000000000004,"5min":14.029999999999999,"15min":14.029999999999999},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":1.6319999999999999,"15min":0.84299999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65900000000000003,"5min":22.942,"15min":22.942},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.435,"5min":0.879,"15min":0.55300000000000005},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58799999999999997,"5min":11.016,"15min":11.016},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":1.3109999999999999,"15min":0.70899999999999996},"min":{"1min":0.32300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58499999999999996,"5min":19.997,"15min":19.997},"last":0.498},{"interface":"front","average":{"1min":0.504,"5min":1.538,"15min":0.79500000000000004},"min":{"1min":0.36199999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68300000000000005,"5min":17.045999999999999,"15min":17.045999999999999},"last":0.62}]},{"osd":4,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":1.6990000000000001,"15min":1.3069999999999999},"min":{"1min":0.45800000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79200000000000004,"5min":21.001000000000001,"15min":21.001000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":2.165,"15min":1.1459999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.89100000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.88900000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":2.4849999999999999,"15min":1.256},"min":{"1min":0.47099999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.83699999999999997,"5min":23.93,"15min":23.93},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":1.853,"15min":1.0509999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":17.010000000000002,"15min":17.010000000000002},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":2.048,"15min":1.1120000000000001},"min":{"1min":0.498,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95499999999999996,"5min":27.701000000000001,"15min":27.701000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":1.504,"15min":0.96099999999999997},"min":{"1min":0.48999999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.98599999999999999,"5min":20.942,"15min":20.942},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":1.6850000000000001,"15min":1.0249999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.878,"5min":21.030999999999999,"15min":21.030999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":2.1219999999999999,"15min":1.1579999999999999},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93200000000000005,"5min":20.902999999999999,"15min":20.902999999999999},"last":0.95699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56116,"kb_used_data":16620,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315724,"statfs":{"total":96636764160,"available":96579301376,"internally_reserved":0,"allocated":17018880,"data_stored":16869087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":1.119,"15min":0.61899999999999999},"min":{"1min":0.27800000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55400000000000005,"5min":18.98,"15min":18.98},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.44,"5min":1.3109999999999999,"15min":0.70099999999999996},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.66300000000000003,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.316}]},{"osd":1,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":1.133,"15min":0.66700000000000004},"min":{"1min":0.29399999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.74199999999999999,"5min":20.995999999999999,"15min":20.995999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":1.0660000000000001,"15min":0.63500000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57299999999999995,"5min":12.052,"15min":12.052},"last":0.34100000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":1.3440000000000001,"15min":0.72999999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.63500000000000001,"5min":19.925999999999998,"15min":19.925999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.498,"5min":1.264,"15min":0.73599999999999999},"min":{"1min":0.35099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66800000000000004,"5min":20.916,"15min":20.916},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":1.9830000000000001,"15min":1.097},"min":{"1min":0.47699999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94299999999999995,"5min":19.940999999999999,"15min":19.940999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":2.1619999999999999,"15min":1.1259999999999999},"min":{"1min":0.44400000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.95999999999999996,"5min":22.038,"15min":22.038},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.8100000000000001,"15min":1.0600000000000001},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88200000000000001,"5min":19.98,"15min":19.98},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":2.0920000000000001,"15min":1.1180000000000001},"min":{"1min":0.504,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97599999999999998,"5min":21.050999999999998,"15min":21.050999999999998},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":1.9970000000000001,"15min":1.101},"min":{"1min":0.49299999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.90900000000000003,"5min":22.021999999999998,"15min":22.021999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":1.9279999999999999,"15min":1.0840000000000001},"min":{"1min":0.50900000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.84099999999999997,"5min":19.007999999999999,"15min":19.007999999999999},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":1.8959999999999999,"15min":1.0680000000000001},"min":{"1min":0.48599999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0069999999999999,"5min":21.023,"15min":21.023},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":2.4159999999999999,"15min":1.2569999999999999},"min":{"1min":0.49099999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.86599999999999999,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.74199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64120,"kb_used_data":37104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94307720,"statfs":{"total":96636764160,"available":96571105280,"internally_reserved":0,"allocated":37994496,"data_stored":37840697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":1.256,"15min":0.70199999999999996},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":23.542000000000002,"15min":23.542000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":1.272,"15min":0.76000000000000001},"min":{"1min":0.29799999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.628,"5min":20.547000000000001,"15min":20.547000000000001},"last":0.39800000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":1.2589999999999999,"15min":0.748},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66000000000000003,"5min":18.984999999999999,"15min":18.984999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.443,"5min":1.3400000000000001,"15min":0.73599999999999999},"min":{"1min":0.33600000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67700000000000005,"5min":20.052,"15min":20.052},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":1.524,"15min":0.83499999999999996},"min":{"1min":0.32000000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.64300000000000002,"5min":20.861000000000001,"15min":20.861000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.45500000000000002,"5min":1.395,"15min":0.80100000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60299999999999998,"5min":21.984000000000002,"15min":21.984000000000002},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":2.0990000000000002,"15min":1.1859999999999999},"min":{"1min":0.48199999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.97299999999999998,"5min":22.015999999999998,"15min":22.015999999999998},"last":0.621},{"interface":"front","average":{"1min":0.65300000000000002,"5min":1.8320000000000001,"15min":1.0680000000000001},"min":{"1min":0.41299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.171,"5min":20.934999999999999,"15min":20.934999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":1.897,"15min":1.0760000000000001},"min":{"1min":0.46999999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.095,"5min":23.474,"15min":23.474},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":2.0470000000000002,"15min":1.1990000000000001},"min":{"1min":0.51100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.012,"5min":21.975999999999999,"15min":21.975999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":2.1379999999999999,"15min":1.1719999999999999},"min":{"1min":0.45200000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.90400000000000003,"5min":20.898,"15min":20.898},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":1.823,"15min":1.0569999999999999},"min":{"1min":0.46200000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.145,"5min":23.513000000000002,"15min":23.513000000000002},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":2.1850000000000001,"15min":1.2569999999999999},"min":{"1min":0.57799999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91900000000000004,"5min":22.039999999999999,"15min":22.039999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":2.0329999999999999,"15min":1.175},"min":{"1min":0.49099999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.123,"5min":20.905000000000001,"15min":20.905000000000001},"last":0.78700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53328,"kb_used_data":26312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94318512,"statfs":{"total":96636764160,"available":96582156288,"internally_reserved":0,"allocated":26943488,"data_stored":26775912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":1.6539999999999999,"15min":0.89800000000000002},"min":{"1min":0.28100000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70899999999999996,"5min":17.920000000000002,"15min":17.920000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":1.716,"15min":0.92300000000000004},"min":{"1min":0.40400000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69099999999999995,"5min":20.904,"15min":20.904},"last":0.69999999999999996}]},{"osd":1,"last update":"Fri Aug 25 04:46:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":1.716,"15min":0.94599999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69399999999999995,"5min":23.911000000000001,"15min":23.911000000000001},"last":0.621},{"interface":"front","average":{"1min":0.53000000000000003,"5min":1.752,"15min":0.95199999999999996},"min":{"1min":0.36499999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":21.952999999999999,"15min":21.952999999999999},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:46:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":1.8280000000000001,"15min":0.98399999999999999},"min":{"1min":0.33400000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.68400000000000005,"5min":21.847999999999999,"15min":21.847999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":2.077,"15min":1.073},"min":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72499999999999998,"5min":33.182000000000002,"15min":33.182000000000002},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:46:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.8700000000000001,"15min":0.99299999999999999},"min":{"1min":0.45700000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70699999999999996,"5min":17.010999999999999,"15min":17.010999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":1.5669999999999999,"15min":0.91500000000000004},"min":{"1min":0.43099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64100000000000001,"5min":15.022,"15min":15.022},"last":0.52100000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:46:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":1.1870000000000001,"15min":0.71099999999999997},"min":{"1min":0.313,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67500000000000004,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.47599999999999998,"5min":1.446,"15min":0.83499999999999996},"min":{"1min":0.34499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67100000000000004,"5min":30.946999999999999,"15min":30.946999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:46:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":1.5740000000000001,"15min":0.86499999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68899999999999995,"5min":15.936999999999999,"15min":15.936999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":1.4550000000000001,"15min":0.85499999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.753,"5min":20.937000000000001,"15min":20.937000000000001},"last":0.58499999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:46:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":1.3300000000000001,"15min":0.81399999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.66300000000000003,"5min":12.914,"15min":12.914},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":1.6000000000000001,"15min":0.92600000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.71699999999999997,"5min":15.045999999999999,"15min":15.045999999999999},"last":0.66500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52028,"kb_used_data":12532,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319812,"statfs":{"total":96636764160,"available":96583487488,"internally_reserved":0,"allocated":12832768,"data_stored":12675435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":1.8919999999999999,"15min":0.97999999999999998},"min":{"1min":0.46100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.79900000000000004,"5min":27.048999999999999,"15min":27.048999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":1.7390000000000001,"15min":0.93500000000000005},"min":{"1min":0.40600000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.78900000000000003,"5min":20.956,"15min":20.956},"last":0.63200000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:46:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":1.8200000000000001,"15min":0.95599999999999996},"min":{"1min":0.38100000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79000000000000004,"5min":20.923999999999999,"15min":20.923999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.7909999999999999,"15min":0.97499999999999998},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.755,"5min":24.927,"15min":24.927},"last":0.64600000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:46:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":1.9850000000000001,"15min":1.042},"min":{"1min":0.39100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.77000000000000002,"5min":18.602,"15min":18.602},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":1.728,"15min":0.98399999999999999},"min":{"1min":0.49399999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76700000000000002,"5min":15.946999999999999,"15min":15.946999999999999},"last":0.748}]},{"osd":3,"last update":"Fri Aug 25 04:46:44 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":2.0219999999999998,"15min":1.044},"min":{"1min":0.51800000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.753,"5min":17.782,"15min":17.782},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.623,"5min":2.0659999999999998,"15min":1.1180000000000001},"min":{"1min":0.48999999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77200000000000002,"5min":27.077000000000002,"15min":27.077000000000002},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:46:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":1.21,"15min":0.71699999999999997},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64200000000000002,"5min":19.172999999999998,"15min":19.172999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":1.482,"15min":0.85599999999999998},"min":{"1min":0.39800000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74399999999999999,"5min":17.693999999999999,"15min":17.693999999999999},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:46:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":1.6160000000000001,"15min":0.874},"min":{"1min":0.33600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67100000000000004,"5min":27.103000000000002,"15min":27.103000000000002},"last":0.442},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.4390000000000001,"15min":0.84899999999999998},"min":{"1min":0.41899999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.68500000000000005,"5min":22.154,"15min":22.154},"last":0.57999999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:46:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":1.2809999999999999,"15min":0.81699999999999995},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":19.253,"15min":19.253},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":1.238,"15min":0.77700000000000002},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77900000000000003,"5min":27.001000000000001,"15min":27.001000000000001},"last":0.55300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":7854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1536000,"data_stored":1518217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1536000,"data_stored":1511105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50331648,"data_stored":50331648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37748736,"data_stored":37748736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:46:53.380 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:53.381 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:53.382 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:53.382 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:53.383 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:53.384 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-08-25T04:43:41.863923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=43, tm_sec=41, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=45, tm_sec=46, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T04:46:53.384 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-25T04:47:13.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:47:13.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.524+0000 7f1147ee9700 1 Processor -- start 2023-08-25T04:47:13.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.524+0000 7f1147ee9700 1 -- start start 2023-08-25T04:47:13.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1147ee9700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f11400cc830 0x7f11400ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1147ee9700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f11400cedc0 0x7f114006d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1147ee9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400cbfe0 con 0x7f11400caf10 2023-08-25T04:47:13.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1147ee9700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400cd150 con 0x7f11400cc830 2023-08-25T04:47:13.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1147ee9700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400cb3d0 con 0x7f11400cedc0 2023-08-25T04:47:13.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1145c85700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f11400cc830 0x7f11400ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1145c85700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f11400cc830 0x7f11400ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50608/0 (socket says 172.21.15.16:50608) 2023-08-25T04:47:13.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1145c85700 1 -- 172.21.15.16:0/979757242 learned_addr learned my addr 172.21.15.16:0/979757242 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:47:13.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1146486700 1 --2- 172.21.15.16:0/979757242 >> v2:172.21.15.117:3300/0 conn(0x7f11400cedc0 0x7f114006d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1145c85700 1 -- 172.21.15.16:0/979757242 >> v2:172.21.15.117:3300/0 conn(0x7f11400cedc0 msgr2=0x7f114006d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:13.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1145c85700 1 --2- 172.21.15.16:0/979757242 >> v2:172.21.15.117:3300/0 conn(0x7f11400cedc0 0x7f114006d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1145c85700 1 -- 172.21.15.16:0/979757242 >> v1:172.21.15.117:6789/0 conn(0x7f11400caf10 legacy=0x7f114006ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:13.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1145c85700 1 -- 172.21.15.16:0/979757242 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400cb6b0 con 0x7f11400cc830 2023-08-25T04:47:13.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1145c85700 1 --2- 172.21.15.16:0/979757242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11400cc830 0x7f11400ccc10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f11400cc780 tx=0x7f113c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccb6859e9329734 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:13.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1144c83700 1 -- 172.21.15.16:0/979757242 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c004230 con 0x7f11400cc830 2023-08-25T04:47:13.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.525+0000 7f1144c83700 1 -- 172.21.15.16:0/979757242 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c004390 con 0x7f11400cc830 2023-08-25T04:47:13.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.526+0000 7f1144c83700 1 -- 172.21.15.16:0/979757242 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0036a0 con 0x7f11400cc830 2023-08-25T04:47:13.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.526+0000 7f1147ee9700 1 -- 172.21.15.16:0/979757242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11400cc830 msgr2=0x7f11400ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.526+0000 7f1147ee9700 1 --2- 172.21.15.16:0/979757242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11400cc830 0x7f11400ccc10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f11400cc780 tx=0x7f113c009bd0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.526+0000 7f1147ee9700 1 -- 172.21.15.16:0/979757242 shutdown_connections 2023-08-25T04:47:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.526+0000 7f1147ee9700 1 --2- 172.21.15.16:0/979757242 >> v2:172.21.15.117:3300/0 conn(0x7f11400cedc0 0x7f114006d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.526+0000 7f1147ee9700 1 --2- 172.21.15.16:0/979757242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11400cc830 0x7f11400ccc10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.526+0000 7f1147ee9700 1 -- 172.21.15.16:0/979757242 >> 172.21.15.16:0/979757242 conn(0x7f11400b1a10 msgr2=0x7f11400b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:13.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.526+0000 7f1147ee9700 1 -- 172.21.15.16:0/979757242 shutdown_connections 2023-08-25T04:47:13.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.526+0000 7f1147ee9700 1 -- 172.21.15.16:0/979757242 wait complete. 2023-08-25T04:47:13.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.527+0000 7f1147ee9700 1 Processor -- start 2023-08-25T04:47:13.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.527+0000 7f1147ee9700 1 -- start start 2023-08-25T04:47:13.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.528+0000 7f1147ee9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11400caf10 0x7f114015bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.528+0000 7f1147ee9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11400cc830 0x7f1140158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.528+0000 7f1147ee9700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11400cedc0 0x7f11400c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.528+0000 7f1147ee9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1140158100 con 0x7f11400caf10 2023-08-25T04:47:13.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.528+0000 7f1147ee9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1140158910 con 0x7f11400cc830 2023-08-25T04:47:13.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.528+0000 7f1147ee9700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114015c250 con 0x7f11400cedc0 2023-08-25T04:47:13.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.528+0000 7f1145c85700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11400caf10 0x7f114015bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.528+0000 7f1145c85700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11400caf10 0x7f114015bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50614/0 (socket says 172.21.15.16:50614) 2023-08-25T04:47:13.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.528+0000 7f1145c85700 1 -- 172.21.15.16:0/387078156 learned_addr learned my addr 172.21.15.16:0/387078156 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:47:13.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.528+0000 7f1146486700 1 --2- 172.21.15.16:0/387078156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11400cedc0 0x7f11400c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.528+0000 7f1145484700 1 --2- 172.21.15.16:0/387078156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11400cc830 0x7f1140158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.528+0000 7f1145c85700 1 -- 172.21.15.16:0/387078156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11400cedc0 msgr2=0x7f11400c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:13.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.528+0000 7f1145c85700 1 --2- 172.21.15.16:0/387078156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11400cedc0 0x7f11400c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.529+0000 7f1145c85700 1 -- 172.21.15.16:0/387078156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11400cc830 msgr2=0x7f1140158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:13.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.529+0000 7f1145c85700 1 --2- 172.21.15.16:0/387078156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11400cc830 0x7f1140158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.529+0000 7f1145c85700 1 -- 172.21.15.16:0/387078156 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c009550 con 0x7f11400caf10 2023-08-25T04:47:13.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.529+0000 7f1145c85700 1 --2- 172.21.15.16:0/387078156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11400caf10 0x7f114015bd10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f113c009130 tx=0x7f113c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:13.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.529+0000 7f11367fc700 1 -- 172.21.15.16:0/387078156 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c011630 con 0x7f11400caf10 2023-08-25T04:47:13.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.529+0000 7f11367fc700 1 -- 172.21.15.16:0/387078156 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c011790 con 0x7f11400caf10 2023-08-25T04:47:13.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.529+0000 7f1147ee9700 1 -- 172.21.15.16:0/387078156 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1140158350 con 0x7f11400caf10 2023-08-25T04:47:13.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.529+0000 7f11367fc700 1 -- 172.21.15.16:0/387078156 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c011b40 con 0x7f11400caf10 2023-08-25T04:47:13.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.529+0000 7f1147ee9700 1 -- 172.21.15.16:0/387078156 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114015b510 con 0x7f11400caf10 2023-08-25T04:47:13.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.530+0000 7f1147ee9700 1 -- 172.21.15.16:0/387078156 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114004ee70 con 0x7f11400caf10 2023-08-25T04:47:13.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.530+0000 7f11367fc700 1 -- 172.21.15.16:0/387078156 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f113c011ca0 con 0x7f11400caf10 2023-08-25T04:47:13.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.531+0000 7f11367fc700 1 --2- 172.21.15.16:0/387078156 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f112406a0e0 0x7f112406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.531+0000 7f11367fc700 1 -- 172.21.15.16:0/387078156 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f113c089c20 con 0x7f11400caf10 2023-08-25T04:47:13.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.531+0000 7f1145484700 1 --2- 172.21.15.16:0/387078156 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f112406a0e0 0x7f112406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.531+0000 7f1145484700 1 --2- 172.21.15.16:0/387078156 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f112406a0e0 0x7f112406c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f114014e950 tx=0x7f1130008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:13.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.535+0000 7f11367fc700 1 -- 172.21.15.16:0/387078156 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f113c055410 con 0x7f11400caf10 2023-08-25T04:47:13.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.731+0000 7f1147ee9700 1 -- 172.21.15.16:0/387078156 --> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11400cbc70 con 0x7f112406a0e0 2023-08-25T04:47:13.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.740+0000 7f11367fc700 1 -- 172.21.15.16:0/387078156 <== mgr.4108 v2:172.21.15.117:6832/3170738628 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+314207 (secure 0 0 0) 0x7f1130009510 con 0x7f112406a0e0 2023-08-25T04:47:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:47:13.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.744+0000 7f1147ee9700 1 -- 172.21.15.16:0/387078156 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f112406a0e0 msgr2=0x7f112406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:13.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.744+0000 7f1147ee9700 1 --2- 172.21.15.16:0/387078156 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f112406a0e0 0x7f112406c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f114014e950 tx=0x7f1130008040 comp rx=0 tx=0).stop 2023-08-25T04:47:13.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.744+0000 7f1147ee9700 1 -- 172.21.15.16:0/387078156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11400caf10 msgr2=0x7f114015bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:13.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.744+0000 7f1147ee9700 1 --2- 172.21.15.16:0/387078156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11400caf10 0x7f114015bd10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f113c009130 tx=0x7f113c004750 comp rx=0 tx=0).stop 2023-08-25T04:47:13.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.744+0000 7f1147ee9700 1 -- 172.21.15.16:0/387078156 shutdown_connections 2023-08-25T04:47:13.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.744+0000 7f1147ee9700 1 --2- 172.21.15.16:0/387078156 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f112406a0e0 0x7f112406c5a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.744+0000 7f1147ee9700 1 --2- 172.21.15.16:0/387078156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11400cedc0 0x7f11400c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.744+0000 7f1147ee9700 1 --2- 172.21.15.16:0/387078156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11400caf10 0x7f114015bd10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.744+0000 7f1147ee9700 1 --2- 172.21.15.16:0/387078156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11400cc830 0x7f1140158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.744+0000 7f1147ee9700 1 -- 172.21.15.16:0/387078156 >> 172.21.15.16:0/387078156 conn(0x7f11400b1a10 msgr2=0x7f11400aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:13.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.744+0000 7f1147ee9700 1 -- 172.21.15.16:0/387078156 shutdown_connections 2023-08-25T04:47:13.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.744+0000 7f1147ee9700 1 -- 172.21.15.16:0/387078156 wait complete. 2023-08-25T04:47:13.749 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-08-25T04:47:13.757 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2023-08-25T04:47:13.428762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102772623,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":129,"num_read_kb":115,"num_write":1146,"num_write_kb":1106025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17582,"ondisk_log_size":17582,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":481204,"kb_used_data":202676,"kb_used_omap":13,"kb_used_meta":278450,"kb_avail":754493516,"statfs":{"total":773094113280,"available":772601360384,"internally_reserved":0,"allocated":207540224,"data_stored":206279253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":285132888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003412"},"pg_stats":[{"pgid":"4.3f","version":"23'232","reported_seq":257,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.038106+0000","last_change":"2023-08-25T04:46:01.038166+0000","last_active":"2023-08-25T04:46:01.038106+0000","last_peered":"2023-08-25T04:46:01.038106+0000","last_clean":"2023-08-25T04:46:01.038106+0000","last_became_active":"2023-08-25T04:43:42.894831+0000","last_became_peered":"2023-08-25T04:43:42.894831+0000","last_unstale":"2023-08-25T04:46:01.038106+0000","last_undegraded":"2023-08-25T04:46:01.038106+0000","last_fullsized":"2023-08-25T04:46:01.038106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'232","last_scrub_stamp":"2023-08-25T04:46:01.037985+0000","last_deep_scrub":"23'232","last_deep_scrub_stamp":"2023-08-25T04:46:01.037985+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.037985+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:36:57.880910+0000","scrub_duration":0.0016765160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'220","reported_seq":245,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:23.267930+0000","last_change":"2023-08-25T04:46:23.267988+0000","last_active":"2023-08-25T04:46:23.267930+0000","last_peered":"2023-08-25T04:46:23.267930+0000","last_clean":"2023-08-25T04:46:23.267930+0000","last_became_active":"2023-08-25T04:43:42.895245+0000","last_became_peered":"2023-08-25T04:43:42.895245+0000","last_unstale":"2023-08-25T04:46:23.267930+0000","last_undegraded":"2023-08-25T04:46:23.267930+0000","last_fullsized":"2023-08-25T04:46:23.267930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'220","last_scrub_stamp":"2023-08-25T04:46:23.267814+0000","last_deep_scrub":"23'220","last_deep_scrub_stamp":"2023-08-25T04:46:23.267814+0000","last_clean_scrub_stamp":"2023-08-25T04:46:23.267814+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:16:36.701979+0000","scrub_duration":0.0021392400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"23'276","reported_seq":301,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:47:02.112863+0000","last_change":"2023-08-25T04:47:02.112909+0000","last_active":"2023-08-25T04:47:02.112863+0000","last_peered":"2023-08-25T04:47:02.112863+0000","last_clean":"2023-08-25T04:47:02.112863+0000","last_became_active":"2023-08-25T04:43:42.888568+0000","last_became_peered":"2023-08-25T04:43:42.888568+0000","last_unstale":"2023-08-25T04:47:02.112863+0000","last_undegraded":"2023-08-25T04:47:02.112863+0000","last_fullsized":"2023-08-25T04:47:02.112863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'276","last_scrub_stamp":"2023-08-25T04:47:02.112756+0000","last_deep_scrub":"23'276","last_deep_scrub_stamp":"2023-08-25T04:47:02.112756+0000","last_clean_scrub_stamp":"2023-08-25T04:47:02.112756+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:39:04.822439+0000","scrub_duration":0.002430696,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"23'253","reported_seq":278,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:04.727265+0000","last_change":"2023-08-25T04:46:04.727316+0000","last_active":"2023-08-25T04:46:04.727265+0000","last_peered":"2023-08-25T04:46:04.727265+0000","last_clean":"2023-08-25T04:46:04.727265+0000","last_became_active":"2023-08-25T04:43:42.893534+0000","last_became_peered":"2023-08-25T04:43:42.893534+0000","last_unstale":"2023-08-25T04:46:04.727265+0000","last_undegraded":"2023-08-25T04:46:04.727265+0000","last_fullsized":"2023-08-25T04:46:04.727265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'253","last_scrub_stamp":"2023-08-25T04:46:04.727143+0000","last_deep_scrub":"23'253","last_deep_scrub_stamp":"2023-08-25T04:46:04.727143+0000","last_clean_scrub_stamp":"2023-08-25T04:46:04.727143+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:48:03.426061+0000","scrub_duration":0.0023240380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"23'256","reported_seq":281,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.953954+0000","last_change":"2023-08-25T04:46:03.953954+0000","last_active":"2023-08-25T04:46:03.953954+0000","last_peered":"2023-08-25T04:46:03.953954+0000","last_clean":"2023-08-25T04:46:03.953954+0000","last_became_active":"2023-08-25T04:43:42.901963+0000","last_became_peered":"2023-08-25T04:43:42.901963+0000","last_unstale":"2023-08-25T04:46:03.953954+0000","last_undegraded":"2023-08-25T04:46:03.953954+0000","last_fullsized":"2023-08-25T04:46:03.953954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'256","last_scrub_stamp":"2023-08-25T04:46:03.953767+0000","last_deep_scrub":"23'256","last_deep_scrub_stamp":"2023-08-25T04:46:03.953767+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.953767+0000","objects_scrubbed":1,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:06.097285+0000","scrub_duration":0.0078404019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'278","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:47:05.108579+0000","last_change":"2023-08-25T04:47:05.108626+0000","last_active":"2023-08-25T04:47:05.108579+0000","last_peered":"2023-08-25T04:47:05.108579+0000","last_clean":"2023-08-25T04:47:05.108579+0000","last_became_active":"2023-08-25T04:43:42.888567+0000","last_became_peered":"2023-08-25T04:43:42.888567+0000","last_unstale":"2023-08-25T04:47:05.108579+0000","last_undegraded":"2023-08-25T04:47:05.108579+0000","last_fullsized":"2023-08-25T04:47:05.108579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'278","last_scrub_stamp":"2023-08-25T04:47:05.108443+0000","last_deep_scrub":"23'278","last_deep_scrub_stamp":"2023-08-25T04:47:05.108443+0000","last_clean_scrub_stamp":"2023-08-25T04:47:05.108443+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:06:12.827753+0000","scrub_duration":0.0020744240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"23'295","reported_seq":320,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:25.174949+0000","last_change":"2023-08-25T04:46:25.175012+0000","last_active":"2023-08-25T04:46:25.174949+0000","last_peered":"2023-08-25T04:46:25.174949+0000","last_clean":"2023-08-25T04:46:25.174949+0000","last_became_active":"2023-08-25T04:43:42.902156+0000","last_became_peered":"2023-08-25T04:43:42.902156+0000","last_unstale":"2023-08-25T04:46:25.174949+0000","last_undegraded":"2023-08-25T04:46:25.174949+0000","last_fullsized":"2023-08-25T04:46:25.174949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'295","last_scrub_stamp":"2023-08-25T04:46:25.174849+0000","last_deep_scrub":"23'295","last_deep_scrub_stamp":"2023-08-25T04:46:25.174849+0000","last_clean_scrub_stamp":"2023-08-25T04:46:25.174849+0000","objects_scrubbed":2,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:35:29.333088+0000","scrub_duration":0.017116702000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"23'270","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:17.296005+0000","last_change":"2023-08-25T04:46:17.296066+0000","last_active":"2023-08-25T04:46:17.296005+0000","last_peered":"2023-08-25T04:46:17.296005+0000","last_clean":"2023-08-25T04:46:17.296005+0000","last_became_active":"2023-08-25T04:43:42.895410+0000","last_became_peered":"2023-08-25T04:43:42.895410+0000","last_unstale":"2023-08-25T04:46:17.296005+0000","last_undegraded":"2023-08-25T04:46:17.296005+0000","last_fullsized":"2023-08-25T04:46:17.296005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'270","last_scrub_stamp":"2023-08-25T04:46:17.295895+0000","last_deep_scrub":"23'270","last_deep_scrub_stamp":"2023-08-25T04:46:17.295895+0000","last_clean_scrub_stamp":"2023-08-25T04:46:17.295895+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:24.881693+0000","scrub_duration":0.001880591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"23'249","reported_seq":274,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:15.980943+0000","last_change":"2023-08-25T04:46:15.981007+0000","last_active":"2023-08-25T04:46:15.980943+0000","last_peered":"2023-08-25T04:46:15.980943+0000","last_clean":"2023-08-25T04:46:15.980943+0000","last_became_active":"2023-08-25T04:43:42.896949+0000","last_became_peered":"2023-08-25T04:43:42.896949+0000","last_unstale":"2023-08-25T04:46:15.980943+0000","last_undegraded":"2023-08-25T04:46:15.980943+0000","last_fullsized":"2023-08-25T04:46:15.980943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'249","last_scrub_stamp":"2023-08-25T04:46:15.980802+0000","last_deep_scrub":"23'249","last_deep_scrub_stamp":"2023-08-25T04:46:15.980802+0000","last_clean_scrub_stamp":"2023-08-25T04:46:15.980802+0000","objects_scrubbed":1,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:23.566600+0000","scrub_duration":0.0083634850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'283","reported_seq":308,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:18.321487+0000","last_change":"2023-08-25T04:46:18.321541+0000","last_active":"2023-08-25T04:46:18.321487+0000","last_peered":"2023-08-25T04:46:18.321487+0000","last_clean":"2023-08-25T04:46:18.321487+0000","last_became_active":"2023-08-25T04:43:42.894786+0000","last_became_peered":"2023-08-25T04:43:42.894786+0000","last_unstale":"2023-08-25T04:46:18.321487+0000","last_undegraded":"2023-08-25T04:46:18.321487+0000","last_fullsized":"2023-08-25T04:46:18.321487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'283","last_scrub_stamp":"2023-08-25T04:46:18.321394+0000","last_deep_scrub":"23'283","last_deep_scrub_stamp":"2023-08-25T04:46:18.321394+0000","last_clean_scrub_stamp":"2023-08-25T04:46:18.321394+0000","objects_scrubbed":1,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:57.751393+0000","scrub_duration":0.012244069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"23'244","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:59.178315+0000","last_change":"2023-08-25T04:46:59.178371+0000","last_active":"2023-08-25T04:46:59.178315+0000","last_peered":"2023-08-25T04:46:59.178315+0000","last_clean":"2023-08-25T04:46:59.178315+0000","last_became_active":"2023-08-25T04:43:42.892558+0000","last_became_peered":"2023-08-25T04:43:42.892558+0000","last_unstale":"2023-08-25T04:46:59.178315+0000","last_undegraded":"2023-08-25T04:46:59.178315+0000","last_fullsized":"2023-08-25T04:46:59.178315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'244","last_scrub_stamp":"2023-08-25T04:46:59.178212+0000","last_deep_scrub":"23'244","last_deep_scrub_stamp":"2023-08-25T04:46:59.178212+0000","last_clean_scrub_stamp":"2023-08-25T04:46:59.178212+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:22:10.321900+0000","scrub_duration":0.0022813059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"23'260","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.103144+0000","last_change":"2023-08-25T04:45:57.103144+0000","last_active":"2023-08-25T04:45:57.103144+0000","last_peered":"2023-08-25T04:45:57.103144+0000","last_clean":"2023-08-25T04:45:57.103144+0000","last_became_active":"2023-08-25T04:43:42.891782+0000","last_became_peered":"2023-08-25T04:43:42.891782+0000","last_unstale":"2023-08-25T04:45:57.103144+0000","last_undegraded":"2023-08-25T04:45:57.103144+0000","last_fullsized":"2023-08-25T04:45:57.103144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'260","last_scrub_stamp":"2023-08-25T04:45:57.102967+0000","last_deep_scrub":"23'260","last_deep_scrub_stamp":"2023-08-25T04:45:57.102967+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.102967+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:11:20.262318+0000","scrub_duration":0.0024717099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'253","reported_seq":278,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.229483+0000","last_change":"2023-08-25T04:45:51.229483+0000","last_active":"2023-08-25T04:45:51.229483+0000","last_peered":"2023-08-25T04:45:51.229483+0000","last_clean":"2023-08-25T04:45:51.229483+0000","last_became_active":"2023-08-25T04:43:42.896334+0000","last_became_peered":"2023-08-25T04:43:42.896334+0000","last_unstale":"2023-08-25T04:45:51.229483+0000","last_undegraded":"2023-08-25T04:45:51.229483+0000","last_fullsized":"2023-08-25T04:45:51.229483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'253","last_scrub_stamp":"2023-08-25T04:45:51.229299+0000","last_deep_scrub":"23'253","last_deep_scrub_stamp":"2023-08-25T04:45:51.229299+0000","last_clean_scrub_stamp":"2023-08-25T04:45:51.229299+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:07:04.578619+0000","scrub_duration":0.001452009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'273","reported_seq":298,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:05.288862+0000","last_change":"2023-08-25T04:46:05.288910+0000","last_active":"2023-08-25T04:46:05.288862+0000","last_peered":"2023-08-25T04:46:05.288862+0000","last_clean":"2023-08-25T04:46:05.288862+0000","last_became_active":"2023-08-25T04:43:42.894472+0000","last_became_peered":"2023-08-25T04:43:42.894472+0000","last_unstale":"2023-08-25T04:46:05.288862+0000","last_undegraded":"2023-08-25T04:46:05.288862+0000","last_fullsized":"2023-08-25T04:46:05.288862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'273","last_scrub_stamp":"2023-08-25T04:46:05.288764+0000","last_deep_scrub":"23'273","last_deep_scrub_stamp":"2023-08-25T04:46:05.288764+0000","last_clean_scrub_stamp":"2023-08-25T04:46:05.288764+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:07.432282+0000","scrub_duration":0.0024051290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:28.267320+0000","last_change":"2023-08-25T04:46:28.267405+0000","last_active":"2023-08-25T04:46:28.267320+0000","last_peered":"2023-08-25T04:46:28.267320+0000","last_clean":"2023-08-25T04:46:28.267320+0000","last_became_active":"2023-08-25T04:43:42.902184+0000","last_became_peered":"2023-08-25T04:43:42.902184+0000","last_unstale":"2023-08-25T04:46:28.267320+0000","last_undegraded":"2023-08-25T04:46:28.267320+0000","last_fullsized":"2023-08-25T04:46:28.267320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:28.267186+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:28.267186+0000","last_clean_scrub_stamp":"2023-08-25T04:46:28.267186+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:21.363371+0000","scrub_duration":0.0021385200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"23'258","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:08.143464+0000","last_change":"2023-08-25T04:46:08.143515+0000","last_active":"2023-08-25T04:46:08.143464+0000","last_peered":"2023-08-25T04:46:08.143464+0000","last_clean":"2023-08-25T04:46:08.143464+0000","last_became_active":"2023-08-25T04:43:42.888730+0000","last_became_peered":"2023-08-25T04:43:42.888730+0000","last_unstale":"2023-08-25T04:46:08.143464+0000","last_undegraded":"2023-08-25T04:46:08.143464+0000","last_fullsized":"2023-08-25T04:46:08.143464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'258","last_scrub_stamp":"2023-08-25T04:46:08.143341+0000","last_deep_scrub":"23'258","last_deep_scrub_stamp":"2023-08-25T04:46:08.143341+0000","last_clean_scrub_stamp":"2023-08-25T04:46:08.143341+0000","objects_scrubbed":1,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:07.464282+0000","scrub_duration":0.0087248789999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:16.965802+0000","last_change":"2023-08-25T04:46:16.965855+0000","last_active":"2023-08-25T04:46:16.965802+0000","last_peered":"2023-08-25T04:46:16.965802+0000","last_clean":"2023-08-25T04:46:16.965802+0000","last_became_active":"2023-08-25T04:43:42.898103+0000","last_became_peered":"2023-08-25T04:43:42.898103+0000","last_unstale":"2023-08-25T04:46:16.965802+0000","last_undegraded":"2023-08-25T04:46:16.965802+0000","last_fullsized":"2023-08-25T04:46:16.965802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:16.965676+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:16.965676+0000","last_clean_scrub_stamp":"2023-08-25T04:46:16.965676+0000","objects_scrubbed":1,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:56.395676+0000","scrub_duration":0.0080171589999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'250","reported_seq":275,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:46.166482+0000","last_change":"2023-08-25T04:46:46.166532+0000","last_active":"2023-08-25T04:46:46.166482+0000","last_peered":"2023-08-25T04:46:46.166482+0000","last_clean":"2023-08-25T04:46:46.166482+0000","last_became_active":"2023-08-25T04:43:42.891874+0000","last_became_peered":"2023-08-25T04:43:42.891874+0000","last_unstale":"2023-08-25T04:46:46.166482+0000","last_undegraded":"2023-08-25T04:46:46.166482+0000","last_fullsized":"2023-08-25T04:46:46.166482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'250","last_scrub_stamp":"2023-08-25T04:46:46.166367+0000","last_deep_scrub":"23'250","last_deep_scrub_stamp":"2023-08-25T04:46:46.166367+0000","last_clean_scrub_stamp":"2023-08-25T04:46:46.166367+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:56:19.782878+0000","scrub_duration":0.002211457,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"23'237","reported_seq":262,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.059523+0000","last_change":"2023-08-25T04:46:00.059576+0000","last_active":"2023-08-25T04:46:00.059523+0000","last_peered":"2023-08-25T04:46:00.059523+0000","last_clean":"2023-08-25T04:46:00.059523+0000","last_became_active":"2023-08-25T04:43:42.895114+0000","last_became_peered":"2023-08-25T04:43:42.895114+0000","last_unstale":"2023-08-25T04:46:00.059523+0000","last_undegraded":"2023-08-25T04:46:00.059523+0000","last_fullsized":"2023-08-25T04:46:00.059523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'237","last_scrub_stamp":"2023-08-25T04:46:00.059425+0000","last_deep_scrub":"23'237","last_deep_scrub_stamp":"2023-08-25T04:46:00.059425+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.059425+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:47:08.428439+0000","scrub_duration":0.0021392239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:02.208337+0000","last_change":"2023-08-25T04:46:02.208395+0000","last_active":"2023-08-25T04:46:02.208337+0000","last_peered":"2023-08-25T04:46:02.208337+0000","last_clean":"2023-08-25T04:46:02.208337+0000","last_became_active":"2023-08-25T04:43:42.895893+0000","last_became_peered":"2023-08-25T04:43:42.895893+0000","last_unstale":"2023-08-25T04:46:02.208337+0000","last_undegraded":"2023-08-25T04:46:02.208337+0000","last_fullsized":"2023-08-25T04:46:02.208337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:02.208224+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:02.208224+0000","last_clean_scrub_stamp":"2023-08-25T04:46:02.208224+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:28:50.652408+0000","scrub_duration":0.001791534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:34.077966+0000","last_change":"2023-08-25T04:46:34.078027+0000","last_active":"2023-08-25T04:46:34.077966+0000","last_peered":"2023-08-25T04:46:34.077966+0000","last_clean":"2023-08-25T04:46:34.077966+0000","last_became_active":"2023-08-25T04:43:42.905157+0000","last_became_peered":"2023-08-25T04:43:42.905157+0000","last_unstale":"2023-08-25T04:46:34.077966+0000","last_undegraded":"2023-08-25T04:46:34.077966+0000","last_fullsized":"2023-08-25T04:46:34.077966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:34.077841+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:34.077841+0000","last_clean_scrub_stamp":"2023-08-25T04:46:34.077841+0000","objects_scrubbed":1,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:28.982630+0000","scrub_duration":0.0101277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"23'278","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.991834+0000","last_change":"2023-08-25T04:46:00.991883+0000","last_active":"2023-08-25T04:46:00.991834+0000","last_peered":"2023-08-25T04:46:00.991834+0000","last_clean":"2023-08-25T04:46:00.991834+0000","last_became_active":"2023-08-25T04:43:42.879881+0000","last_became_peered":"2023-08-25T04:43:42.879881+0000","last_unstale":"2023-08-25T04:46:00.991834+0000","last_undegraded":"2023-08-25T04:46:00.991834+0000","last_fullsized":"2023-08-25T04:46:00.991834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'278","last_scrub_stamp":"2023-08-25T04:46:00.991708+0000","last_deep_scrub":"23'278","last_deep_scrub_stamp":"2023-08-25T04:46:00.991708+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.991708+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:59:59.525971+0000","scrub_duration":0.001818802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'246","reported_seq":266,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.998431+0000","last_change":"2023-08-25T04:46:03.998431+0000","last_active":"2023-08-25T04:46:03.998431+0000","last_peered":"2023-08-25T04:46:03.998431+0000","last_clean":"2023-08-25T04:46:03.998431+0000","last_became_active":"2023-08-25T04:44:30.818308+0000","last_became_peered":"2023-08-25T04:44:30.818308+0000","last_unstale":"2023-08-25T04:46:03.998431+0000","last_undegraded":"2023-08-25T04:46:03.998431+0000","last_fullsized":"2023-08-25T04:46:03.998431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'246","last_scrub_stamp":"2023-08-25T04:46:03.998242+0000","last_deep_scrub":"23'246","last_deep_scrub_stamp":"2023-08-25T04:46:03.998242+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.998242+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:16:04.323429+0000","scrub_duration":0.001734148,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"23'239","reported_seq":264,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:26.177269+0000","last_change":"2023-08-25T04:46:26.177340+0000","last_active":"2023-08-25T04:46:26.177269+0000","last_peered":"2023-08-25T04:46:26.177269+0000","last_clean":"2023-08-25T04:46:26.177269+0000","last_became_active":"2023-08-25T04:43:42.896869+0000","last_became_peered":"2023-08-25T04:43:42.896869+0000","last_unstale":"2023-08-25T04:46:26.177269+0000","last_undegraded":"2023-08-25T04:46:26.177269+0000","last_fullsized":"2023-08-25T04:46:26.177269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'239","last_scrub_stamp":"2023-08-25T04:46:26.177136+0000","last_deep_scrub":"23'239","last_deep_scrub_stamp":"2023-08-25T04:46:26.177136+0000","last_clean_scrub_stamp":"2023-08-25T04:46:26.177136+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:12:10.015765+0000","scrub_duration":0.0022678490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"23'255","reported_seq":280,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:22.373816+0000","last_change":"2023-08-25T04:46:22.373866+0000","last_active":"2023-08-25T04:46:22.373816+0000","last_peered":"2023-08-25T04:46:22.373816+0000","last_clean":"2023-08-25T04:46:22.373816+0000","last_became_active":"2023-08-25T04:43:42.893673+0000","last_became_peered":"2023-08-25T04:43:42.893673+0000","last_unstale":"2023-08-25T04:46:22.373816+0000","last_undegraded":"2023-08-25T04:46:22.373816+0000","last_fullsized":"2023-08-25T04:46:22.373816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'255","last_scrub_stamp":"2023-08-25T04:46:22.373701+0000","last_deep_scrub":"23'255","last_deep_scrub_stamp":"2023-08-25T04:46:22.373701+0000","last_clean_scrub_stamp":"2023-08-25T04:46:22.373701+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:32:04.054159+0000","scrub_duration":0.0023847949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'274","reported_seq":299,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:10.405513+0000","last_change":"2023-08-25T04:46:10.405567+0000","last_active":"2023-08-25T04:46:10.405513+0000","last_peered":"2023-08-25T04:46:10.405513+0000","last_clean":"2023-08-25T04:46:10.405513+0000","last_became_active":"2023-08-25T04:43:42.887831+0000","last_became_peered":"2023-08-25T04:43:42.887831+0000","last_unstale":"2023-08-25T04:46:10.405513+0000","last_undegraded":"2023-08-25T04:46:10.405513+0000","last_fullsized":"2023-08-25T04:46:10.405513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'274","last_scrub_stamp":"2023-08-25T04:46:10.405391+0000","last_deep_scrub":"23'274","last_deep_scrub_stamp":"2023-08-25T04:46:10.405391+0000","last_clean_scrub_stamp":"2023-08-25T04:46:10.405391+0000","objects_scrubbed":2,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:08.939653+0000","scrub_duration":0.013184357000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'237","reported_seq":262,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:02.351329+0000","last_change":"2023-08-25T04:46:02.351387+0000","last_active":"2023-08-25T04:46:02.351329+0000","last_peered":"2023-08-25T04:46:02.351329+0000","last_clean":"2023-08-25T04:46:02.351329+0000","last_became_active":"2023-08-25T04:43:42.894302+0000","last_became_peered":"2023-08-25T04:43:42.894302+0000","last_unstale":"2023-08-25T04:46:02.351329+0000","last_undegraded":"2023-08-25T04:46:02.351329+0000","last_fullsized":"2023-08-25T04:46:02.351329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'237","last_scrub_stamp":"2023-08-25T04:46:02.351216+0000","last_deep_scrub":"23'237","last_deep_scrub_stamp":"2023-08-25T04:46:02.351216+0000","last_clean_scrub_stamp":"2023-08-25T04:46:02.351216+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:00.885478+0000","scrub_duration":0.0016876969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:23.209215+0000","last_change":"2023-08-25T04:46:23.209320+0000","last_active":"2023-08-25T04:46:23.209215+0000","last_peered":"2023-08-25T04:46:23.209215+0000","last_clean":"2023-08-25T04:46:23.209215+0000","last_became_active":"2023-08-25T04:43:41.888339+0000","last_became_peered":"2023-08-25T04:43:41.888339+0000","last_unstale":"2023-08-25T04:46:23.209215+0000","last_undegraded":"2023-08-25T04:46:23.209215+0000","last_fullsized":"2023-08-25T04:46:23.209215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-08-25T04:46:23.209085+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-08-25T04:46:23.209085+0000","last_clean_scrub_stamp":"2023-08-25T04:46:23.209085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:18.113873+0000","scrub_duration":0.0022365309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'271","reported_seq":296,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:30.308106+0000","last_change":"2023-08-25T04:46:30.308152+0000","last_active":"2023-08-25T04:46:30.308106+0000","last_peered":"2023-08-25T04:46:30.308106+0000","last_clean":"2023-08-25T04:46:30.308106+0000","last_became_active":"2023-08-25T04:43:42.897425+0000","last_became_peered":"2023-08-25T04:43:42.897425+0000","last_unstale":"2023-08-25T04:46:30.308106+0000","last_undegraded":"2023-08-25T04:46:30.308106+0000","last_fullsized":"2023-08-25T04:46:30.308106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'271","last_scrub_stamp":"2023-08-25T04:46:30.307993+0000","last_deep_scrub":"23'271","last_deep_scrub_stamp":"2023-08-25T04:46:30.307993+0000","last_clean_scrub_stamp":"2023-08-25T04:46:30.307993+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:25.212781+0000","scrub_duration":0.001690495,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:08.410533+0000","last_change":"2023-08-25T04:46:08.410533+0000","last_active":"2023-08-25T04:46:08.410533+0000","last_peered":"2023-08-25T04:46:08.410533+0000","last_clean":"2023-08-25T04:46:08.410533+0000","last_became_active":"2023-08-25T04:43:41.885184+0000","last_became_peered":"2023-08-25T04:43:41.885184+0000","last_unstale":"2023-08-25T04:46:08.410533+0000","last_undegraded":"2023-08-25T04:46:08.410533+0000","last_fullsized":"2023-08-25T04:46:08.410533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:08.410308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:08.410308+0000","last_clean_scrub_stamp":"2023-08-25T04:46:08.410308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:17.174121+0000","scrub_duration":0.001705238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'291","reported_seq":316,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:21.972608+0000","last_change":"2023-08-25T04:46:21.972669+0000","last_active":"2023-08-25T04:46:21.972608+0000","last_peered":"2023-08-25T04:46:21.972608+0000","last_clean":"2023-08-25T04:46:21.972608+0000","last_became_active":"2023-08-25T04:43:42.890575+0000","last_became_peered":"2023-08-25T04:43:42.890575+0000","last_unstale":"2023-08-25T04:46:21.972608+0000","last_undegraded":"2023-08-25T04:46:21.972608+0000","last_fullsized":"2023-08-25T04:46:21.972608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'291","last_scrub_stamp":"2023-08-25T04:46:21.972508+0000","last_deep_scrub":"23'291","last_deep_scrub_stamp":"2023-08-25T04:46:21.972508+0000","last_clean_scrub_stamp":"2023-08-25T04:46:21.972508+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:25.669510+0000","scrub_duration":0.002317838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.805506+0000","last_change":"2023-08-25T04:45:52.805506+0000","last_active":"2023-08-25T04:45:52.805506+0000","last_peered":"2023-08-25T04:45:52.805506+0000","last_clean":"2023-08-25T04:45:52.805506+0000","last_became_active":"2023-08-25T04:43:41.885299+0000","last_became_peered":"2023-08-25T04:43:41.885299+0000","last_unstale":"2023-08-25T04:45:52.805506+0000","last_undegraded":"2023-08-25T04:45:52.805506+0000","last_fullsized":"2023-08-25T04:45:52.805506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:45:52.805353+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:45:52.805353+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.805353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:28.630344+0000","scrub_duration":0.0017761649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'269","reported_seq":294,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.678926+0000","last_change":"2023-08-25T04:46:03.678987+0000","last_active":"2023-08-25T04:46:03.678926+0000","last_peered":"2023-08-25T04:46:03.678926+0000","last_clean":"2023-08-25T04:46:03.678926+0000","last_became_active":"2023-08-25T04:43:42.898874+0000","last_became_peered":"2023-08-25T04:43:42.898874+0000","last_unstale":"2023-08-25T04:46:03.678926+0000","last_undegraded":"2023-08-25T04:46:03.678926+0000","last_fullsized":"2023-08-25T04:46:03.678926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'269","last_scrub_stamp":"2023-08-25T04:46:03.678818+0000","last_deep_scrub":"23'269","last_deep_scrub_stamp":"2023-08-25T04:46:03.678818+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.678818+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:44.606031+0000","scrub_duration":0.0016713940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.002914+0000","last_change":"2023-08-25T04:46:00.002914+0000","last_active":"2023-08-25T04:46:00.002914+0000","last_peered":"2023-08-25T04:46:00.002914+0000","last_clean":"2023-08-25T04:46:00.002914+0000","last_became_active":"2023-08-25T04:43:41.882381+0000","last_became_peered":"2023-08-25T04:43:41.882381+0000","last_unstale":"2023-08-25T04:46:00.002914+0000","last_undegraded":"2023-08-25T04:46:00.002914+0000","last_fullsized":"2023-08-25T04:46:00.002914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:46:00.002750+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:46:00.002750+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.002750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:35.827741+0000","scrub_duration":0.0019692830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'262","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:20.224044+0000","last_change":"2023-08-25T04:46:20.224100+0000","last_active":"2023-08-25T04:46:20.224044+0000","last_peered":"2023-08-25T04:46:20.224044+0000","last_clean":"2023-08-25T04:46:20.224044+0000","last_became_active":"2023-08-25T04:44:30.481273+0000","last_became_peered":"2023-08-25T04:44:30.481273+0000","last_unstale":"2023-08-25T04:46:20.224044+0000","last_undegraded":"2023-08-25T04:46:20.224044+0000","last_fullsized":"2023-08-25T04:46:20.224044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'262","last_scrub_stamp":"2023-08-25T04:46:20.223925+0000","last_deep_scrub":"23'262","last_deep_scrub_stamp":"2023-08-25T04:46:20.223925+0000","last_clean_scrub_stamp":"2023-08-25T04:46:20.223925+0000","objects_scrubbed":1,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:35:24.382164+0000","scrub_duration":0.0097733969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.353165+0000","last_change":"2023-08-25T04:46:01.353165+0000","last_active":"2023-08-25T04:46:01.353165+0000","last_peered":"2023-08-25T04:46:01.353165+0000","last_clean":"2023-08-25T04:46:01.353165+0000","last_became_active":"2023-08-25T04:43:41.882055+0000","last_became_peered":"2023-08-25T04:43:41.882055+0000","last_unstale":"2023-08-25T04:46:01.353165+0000","last_undegraded":"2023-08-25T04:46:01.353165+0000","last_fullsized":"2023-08-25T04:46:01.353165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:01.352985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:01.352985+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.352985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:37.177976+0000","scrub_duration":0.001474939,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"23'269","reported_seq":294,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:18.181975+0000","last_change":"2023-08-25T04:46:18.182082+0000","last_active":"2023-08-25T04:46:18.181975+0000","last_peered":"2023-08-25T04:46:18.181975+0000","last_clean":"2023-08-25T04:46:18.181975+0000","last_became_active":"2023-08-25T04:43:42.890100+0000","last_became_peered":"2023-08-25T04:43:42.890100+0000","last_unstale":"2023-08-25T04:46:18.181975+0000","last_undegraded":"2023-08-25T04:46:18.181975+0000","last_fullsized":"2023-08-25T04:46:18.181975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'269","last_scrub_stamp":"2023-08-25T04:46:18.181858+0000","last_deep_scrub":"23'269","last_deep_scrub_stamp":"2023-08-25T04:46:18.181858+0000","last_clean_scrub_stamp":"2023-08-25T04:46:18.181858+0000","objects_scrubbed":1,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:21.878859+0000","scrub_duration":0.010619290999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'14","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:16.038350+0000","last_change":"2023-08-25T04:46:16.038435+0000","last_active":"2023-08-25T04:46:16.038350+0000","last_peered":"2023-08-25T04:46:16.038350+0000","last_clean":"2023-08-25T04:46:16.038350+0000","last_became_active":"2023-08-25T04:43:41.887622+0000","last_became_peered":"2023-08-25T04:43:41.887622+0000","last_unstale":"2023-08-25T04:46:16.038350+0000","last_undegraded":"2023-08-25T04:46:16.038350+0000","last_fullsized":"2023-08-25T04:46:16.038350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2023-08-25T04:46:16.038244+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2023-08-25T04:46:16.038244+0000","last_clean_scrub_stamp":"2023-08-25T04:46:16.038244+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:55.468243+0000","scrub_duration":0.0038245340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"23'273","reported_seq":298,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:21.375329+0000","last_change":"2023-08-25T04:46:21.375408+0000","last_active":"2023-08-25T04:46:21.375329+0000","last_peered":"2023-08-25T04:46:21.375329+0000","last_clean":"2023-08-25T04:46:21.375329+0000","last_became_active":"2023-08-25T04:43:42.890648+0000","last_became_peered":"2023-08-25T04:43:42.890648+0000","last_unstale":"2023-08-25T04:46:21.375329+0000","last_undegraded":"2023-08-25T04:46:21.375329+0000","last_fullsized":"2023-08-25T04:46:21.375329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'273","last_scrub_stamp":"2023-08-25T04:46:21.375181+0000","last_deep_scrub":"23'273","last_deep_scrub_stamp":"2023-08-25T04:46:21.375181+0000","last_clean_scrub_stamp":"2023-08-25T04:46:21.375181+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:15.079856+0000","scrub_duration":0.002419259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'388","reported_seq":415,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:17.068231+0000","last_change":"2023-08-25T04:46:17.068287+0000","last_active":"2023-08-25T04:46:17.068231+0000","last_peered":"2023-08-25T04:46:17.068231+0000","last_clean":"2023-08-25T04:46:17.068231+0000","last_became_active":"2023-08-25T04:43:41.886491+0000","last_became_peered":"2023-08-25T04:43:41.886491+0000","last_unstale":"2023-08-25T04:46:17.068231+0000","last_undegraded":"2023-08-25T04:46:17.068231+0000","last_fullsized":"2023-08-25T04:46:17.068231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'388","last_scrub_stamp":"2023-08-25T04:46:17.068129+0000","last_deep_scrub":"23'388","last_deep_scrub_stamp":"2023-08-25T04:46:17.068129+0000","last_clean_scrub_stamp":"2023-08-25T04:46:17.068129+0000","objects_scrubbed":4,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:10.164314+0000","scrub_duration":0.0091339360000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1510889,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":385,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"23'297","reported_seq":322,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:43.181046+0000","last_change":"2023-08-25T04:46:43.181092+0000","last_active":"2023-08-25T04:46:43.181046+0000","last_peered":"2023-08-25T04:46:43.181046+0000","last_clean":"2023-08-25T04:46:43.181046+0000","last_became_active":"2023-08-25T04:43:42.893525+0000","last_became_peered":"2023-08-25T04:43:42.893525+0000","last_unstale":"2023-08-25T04:46:43.181046+0000","last_undegraded":"2023-08-25T04:46:43.181046+0000","last_fullsized":"2023-08-25T04:46:43.181046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'297","last_scrub_stamp":"2023-08-25T04:46:43.180921+0000","last_deep_scrub":"23'297","last_deep_scrub_stamp":"2023-08-25T04:46:43.180921+0000","last_clean_scrub_stamp":"2023-08-25T04:46:43.180921+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:03.208662+0000","scrub_duration":0.00175347,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'5","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:10.209723+0000","last_change":"2023-08-25T04:46:10.209775+0000","last_active":"2023-08-25T04:46:10.209723+0000","last_peered":"2023-08-25T04:46:10.209723+0000","last_clean":"2023-08-25T04:46:10.209723+0000","last_became_active":"2023-08-25T04:43:41.890673+0000","last_became_peered":"2023-08-25T04:43:41.890673+0000","last_unstale":"2023-08-25T04:46:10.209723+0000","last_undegraded":"2023-08-25T04:46:10.209723+0000","last_fullsized":"2023-08-25T04:46:10.209723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2023-08-25T04:46:10.209611+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2023-08-25T04:46:10.209611+0000","last_clean_scrub_stamp":"2023-08-25T04:46:10.209611+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:03.914286+0000","scrub_duration":0.0034207019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"23'270","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:23.191356+0000","last_change":"2023-08-25T04:46:23.191414+0000","last_active":"2023-08-25T04:46:23.191356+0000","last_peered":"2023-08-25T04:46:23.191356+0000","last_clean":"2023-08-25T04:46:23.191356+0000","last_became_active":"2023-08-25T04:43:42.897204+0000","last_became_peered":"2023-08-25T04:43:42.897204+0000","last_unstale":"2023-08-25T04:46:23.191356+0000","last_undegraded":"2023-08-25T04:46:23.191356+0000","last_fullsized":"2023-08-25T04:46:23.191356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'270","last_scrub_stamp":"2023-08-25T04:46:23.191215+0000","last_deep_scrub":"23'270","last_deep_scrub_stamp":"2023-08-25T04:46:23.191215+0000","last_clean_scrub_stamp":"2023-08-25T04:46:23.191215+0000","objects_scrubbed":1,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:16.287401+0000","scrub_duration":0.0084130279999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.983964+0000","last_change":"2023-08-25T04:45:52.983964+0000","last_active":"2023-08-25T04:45:52.983964+0000","last_peered":"2023-08-25T04:45:52.983964+0000","last_clean":"2023-08-25T04:45:52.983964+0000","last_became_active":"2023-08-25T04:43:41.881067+0000","last_became_peered":"2023-08-25T04:43:41.881067+0000","last_unstale":"2023-08-25T04:45:52.983964+0000","last_undegraded":"2023-08-25T04:45:52.983964+0000","last_fullsized":"2023-08-25T04:45:52.983964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:52.983794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:52.983794+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.983794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:28:30.719694+0000","scrub_duration":0.0024229049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'253","reported_seq":278,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:13.249412+0000","last_change":"2023-08-25T04:46:13.249462+0000","last_active":"2023-08-25T04:46:13.249412+0000","last_peered":"2023-08-25T04:46:13.249412+0000","last_clean":"2023-08-25T04:46:13.249412+0000","last_became_active":"2023-08-25T04:43:42.894807+0000","last_became_peered":"2023-08-25T04:43:42.894807+0000","last_unstale":"2023-08-25T04:46:13.249412+0000","last_undegraded":"2023-08-25T04:46:13.249412+0000","last_fullsized":"2023-08-25T04:46:13.249412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'253","last_scrub_stamp":"2023-08-25T04:46:13.249311+0000","last_deep_scrub":"23'253","last_deep_scrub_stamp":"2023-08-25T04:46:13.249311+0000","last_clean_scrub_stamp":"2023-08-25T04:46:13.249311+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:06.953986+0000","scrub_duration":0.001625549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:11.159065+0000","last_change":"2023-08-25T04:46:11.159117+0000","last_active":"2023-08-25T04:46:11.159065+0000","last_peered":"2023-08-25T04:46:11.159065+0000","last_clean":"2023-08-25T04:46:11.159065+0000","last_became_active":"2023-08-25T04:43:41.890706+0000","last_became_peered":"2023-08-25T04:43:41.890706+0000","last_unstale":"2023-08-25T04:46:11.159065+0000","last_undegraded":"2023-08-25T04:46:11.159065+0000","last_fullsized":"2023-08-25T04:46:11.159065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:46:11.158932+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:46:11.158932+0000","last_clean_scrub_stamp":"2023-08-25T04:46:11.158932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:52.839390+0000","scrub_duration":0.0015778840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"23'288","reported_seq":313,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:11.944082+0000","last_change":"2023-08-25T04:46:11.944161+0000","last_active":"2023-08-25T04:46:11.944082+0000","last_peered":"2023-08-25T04:46:11.944082+0000","last_clean":"2023-08-25T04:46:11.944082+0000","last_became_active":"2023-08-25T04:43:42.897476+0000","last_became_peered":"2023-08-25T04:43:42.897476+0000","last_unstale":"2023-08-25T04:46:11.944082+0000","last_undegraded":"2023-08-25T04:46:11.944082+0000","last_fullsized":"2023-08-25T04:46:11.944082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'288","last_scrub_stamp":"2023-08-25T04:46:11.943899+0000","last_deep_scrub":"23'288","last_deep_scrub_stamp":"2023-08-25T04:46:11.943899+0000","last_clean_scrub_stamp":"2023-08-25T04:46:11.943899+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:05.648574+0000","scrub_duration":0.0021087810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'12","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:58.712516+0000","last_change":"2023-08-25T04:45:58.712516+0000","last_active":"2023-08-25T04:45:58.712516+0000","last_peered":"2023-08-25T04:45:58.712516+0000","last_clean":"2023-08-25T04:45:58.712516+0000","last_became_active":"2023-08-25T04:43:41.892517+0000","last_became_peered":"2023-08-25T04:43:41.892517+0000","last_unstale":"2023-08-25T04:45:58.712516+0000","last_undegraded":"2023-08-25T04:45:58.712516+0000","last_fullsized":"2023-08-25T04:45:58.712516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2023-08-25T04:45:58.712345+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2023-08-25T04:45:58.712345+0000","last_clean_scrub_stamp":"2023-08-25T04:45:58.712345+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:37:12.386852+0000","scrub_duration":0.0051496449999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"23'268","reported_seq":293,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:48.424071+0000","last_change":"2023-08-25T04:46:48.424146+0000","last_active":"2023-08-25T04:46:48.424071+0000","last_peered":"2023-08-25T04:46:48.424071+0000","last_clean":"2023-08-25T04:46:48.424071+0000","last_became_active":"2023-08-25T04:43:42.904736+0000","last_became_peered":"2023-08-25T04:43:42.904736+0000","last_unstale":"2023-08-25T04:46:48.424071+0000","last_undegraded":"2023-08-25T04:46:48.424071+0000","last_fullsized":"2023-08-25T04:46:48.424071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'268","last_scrub_stamp":"2023-08-25T04:46:48.423896+0000","last_deep_scrub":"23'268","last_deep_scrub_stamp":"2023-08-25T04:46:48.423896+0000","last_clean_scrub_stamp":"2023-08-25T04:46:48.423896+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:08.451636+0000","scrub_duration":0.002426241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:24.138150+0000","last_change":"2023-08-25T04:46:24.138227+0000","last_active":"2023-08-25T04:46:24.138150+0000","last_peered":"2023-08-25T04:46:24.138150+0000","last_clean":"2023-08-25T04:46:24.138150+0000","last_became_active":"2023-08-25T04:43:41.890942+0000","last_became_peered":"2023-08-25T04:43:41.890942+0000","last_unstale":"2023-08-25T04:46:24.138150+0000","last_undegraded":"2023-08-25T04:46:24.138150+0000","last_fullsized":"2023-08-25T04:46:24.138150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-08-25T04:46:24.138037+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-08-25T04:46:24.138037+0000","last_clean_scrub_stamp":"2023-08-25T04:46:24.138037+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:27.835038+0000","scrub_duration":0.003479546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"23'238","reported_seq":263,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:14.281547+0000","last_change":"2023-08-25T04:46:14.281593+0000","last_active":"2023-08-25T04:46:14.281547+0000","last_peered":"2023-08-25T04:46:14.281547+0000","last_clean":"2023-08-25T04:46:14.281547+0000","last_became_active":"2023-08-25T04:43:42.894285+0000","last_became_peered":"2023-08-25T04:43:42.894285+0000","last_unstale":"2023-08-25T04:46:14.281547+0000","last_undegraded":"2023-08-25T04:46:14.281547+0000","last_fullsized":"2023-08-25T04:46:14.281547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'238","last_scrub_stamp":"2023-08-25T04:46:14.281430+0000","last_deep_scrub":"23'238","last_deep_scrub_stamp":"2023-08-25T04:46:14.281430+0000","last_clean_scrub_stamp":"2023-08-25T04:46:14.281430+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:55.961888+0000","scrub_duration":0.0016190309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'3","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:15.085333+0000","last_change":"2023-08-25T04:46:15.085384+0000","last_active":"2023-08-25T04:46:15.085333+0000","last_peered":"2023-08-25T04:46:15.085333+0000","last_clean":"2023-08-25T04:46:15.085333+0000","last_became_active":"2023-08-25T04:43:41.890883+0000","last_became_peered":"2023-08-25T04:43:41.890883+0000","last_unstale":"2023-08-25T04:46:15.085333+0000","last_undegraded":"2023-08-25T04:46:15.085333+0000","last_fullsized":"2023-08-25T04:46:15.085333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-08-25T04:46:15.085227+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-08-25T04:46:15.085227+0000","last_clean_scrub_stamp":"2023-08-25T04:46:15.085227+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:22.671025+0000","scrub_duration":0.0028661110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"23'268","reported_seq":293,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:52.258344+0000","last_change":"2023-08-25T04:46:52.258398+0000","last_active":"2023-08-25T04:46:52.258344+0000","last_peered":"2023-08-25T04:46:52.258344+0000","last_clean":"2023-08-25T04:46:52.258344+0000","last_became_active":"2023-08-25T04:43:42.891443+0000","last_became_peered":"2023-08-25T04:43:42.891443+0000","last_unstale":"2023-08-25T04:46:52.258344+0000","last_undegraded":"2023-08-25T04:46:52.258344+0000","last_fullsized":"2023-08-25T04:46:52.258344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'268","last_scrub_stamp":"2023-08-25T04:46:52.258236+0000","last_deep_scrub":"23'268","last_deep_scrub_stamp":"2023-08-25T04:46:52.258236+0000","last_clean_scrub_stamp":"2023-08-25T04:46:52.258236+0000","objects_scrubbed":3,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:41.183035+0000","scrub_duration":0.027168114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:02.258330+0000","last_change":"2023-08-25T04:46:02.258387+0000","last_active":"2023-08-25T04:46:02.258330+0000","last_peered":"2023-08-25T04:46:02.258330+0000","last_clean":"2023-08-25T04:46:02.258330+0000","last_became_active":"2023-08-25T04:43:41.888447+0000","last_became_peered":"2023-08-25T04:43:41.888447+0000","last_unstale":"2023-08-25T04:46:02.258330+0000","last_undegraded":"2023-08-25T04:46:02.258330+0000","last_fullsized":"2023-08-25T04:46:02.258330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-08-25T04:46:02.258220+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-08-25T04:46:02.258220+0000","last_clean_scrub_stamp":"2023-08-25T04:46:02.258220+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:50.337360+0000","scrub_duration":0.0030581060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"23'270","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.667962+0000","last_change":"2023-08-25T04:46:00.668030+0000","last_active":"2023-08-25T04:46:00.667962+0000","last_peered":"2023-08-25T04:46:00.667962+0000","last_clean":"2023-08-25T04:46:00.667962+0000","last_became_active":"2023-08-25T04:43:42.892191+0000","last_became_peered":"2023-08-25T04:43:42.892191+0000","last_unstale":"2023-08-25T04:46:00.667962+0000","last_undegraded":"2023-08-25T04:46:00.667962+0000","last_fullsized":"2023-08-25T04:46:00.667962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'270","last_scrub_stamp":"2023-08-25T04:46:00.667852+0000","last_deep_scrub":"23'270","last_deep_scrub_stamp":"2023-08-25T04:46:00.667852+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.667852+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:25:37.904637+0000","scrub_duration":0.002178714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:54.495493+0000","last_change":"2023-08-25T04:45:54.495493+0000","last_active":"2023-08-25T04:45:54.495493+0000","last_peered":"2023-08-25T04:45:54.495493+0000","last_clean":"2023-08-25T04:45:54.495493+0000","last_became_active":"2023-08-25T04:43:41.884098+0000","last_became_peered":"2023-08-25T04:43:41.884098+0000","last_unstale":"2023-08-25T04:45:54.495493+0000","last_undegraded":"2023-08-25T04:45:54.495493+0000","last_fullsized":"2023-08-25T04:45:54.495493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:45:54.495284+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:45:54.495284+0000","last_clean_scrub_stamp":"2023-08-25T04:45:54.495284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:35.422497+0000","scrub_duration":0.0022346089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"23'270","reported_seq":295,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:18.981074+0000","last_change":"2023-08-25T04:46:18.981133+0000","last_active":"2023-08-25T04:46:18.981074+0000","last_peered":"2023-08-25T04:46:18.981074+0000","last_clean":"2023-08-25T04:46:18.981074+0000","last_became_active":"2023-08-25T04:43:42.880104+0000","last_became_peered":"2023-08-25T04:43:42.880104+0000","last_unstale":"2023-08-25T04:46:18.981074+0000","last_undegraded":"2023-08-25T04:46:18.981074+0000","last_fullsized":"2023-08-25T04:46:18.981074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'270","last_scrub_stamp":"2023-08-25T04:46:18.980949+0000","last_deep_scrub":"23'270","last_deep_scrub_stamp":"2023-08-25T04:46:18.980949+0000","last_clean_scrub_stamp":"2023-08-25T04:46:18.980949+0000","objects_scrubbed":1,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:18.301890+0000","scrub_duration":0.0082879540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'5","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.831129+0000","last_change":"2023-08-25T04:45:57.831129+0000","last_active":"2023-08-25T04:45:57.831129+0000","last_peered":"2023-08-25T04:45:57.831129+0000","last_clean":"2023-08-25T04:45:57.831129+0000","last_became_active":"2023-08-25T04:43:41.885433+0000","last_became_peered":"2023-08-25T04:43:41.885433+0000","last_unstale":"2023-08-25T04:45:57.831129+0000","last_undegraded":"2023-08-25T04:45:57.831129+0000","last_fullsized":"2023-08-25T04:45:57.831129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2023-08-25T04:45:57.830944+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2023-08-25T04:45:57.830944+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.830944+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:45.910084+0000","scrub_duration":0.0028335420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'243","reported_seq":268,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:32.179503+0000","last_change":"2023-08-25T04:46:32.179556+0000","last_active":"2023-08-25T04:46:32.179503+0000","last_peered":"2023-08-25T04:46:32.179503+0000","last_clean":"2023-08-25T04:46:32.179503+0000","last_became_active":"2023-08-25T04:43:42.896440+0000","last_became_peered":"2023-08-25T04:43:42.896440+0000","last_unstale":"2023-08-25T04:46:32.179503+0000","last_undegraded":"2023-08-25T04:46:32.179503+0000","last_fullsized":"2023-08-25T04:46:32.179503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'243","last_scrub_stamp":"2023-08-25T04:46:32.179400+0000","last_deep_scrub":"23'243","last_deep_scrub_stamp":"2023-08-25T04:46:32.179400+0000","last_clean_scrub_stamp":"2023-08-25T04:46:32.179400+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:30:51.133770+0000","scrub_duration":0.0021692249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.718106+0000","last_change":"2023-08-25T04:45:57.718160+0000","last_active":"2023-08-25T04:45:57.718106+0000","last_peered":"2023-08-25T04:45:57.718106+0000","last_clean":"2023-08-25T04:45:57.718106+0000","last_became_active":"2023-08-25T04:43:41.890827+0000","last_became_peered":"2023-08-25T04:43:41.890827+0000","last_unstale":"2023-08-25T04:45:57.718106+0000","last_undegraded":"2023-08-25T04:45:57.718106+0000","last_fullsized":"2023-08-25T04:45:57.718106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:45:57.717976+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:45:57.717976+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.717976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:15:58.043163+0000","scrub_duration":0.0018100639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"23'288","reported_seq":313,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:47:03.119076+0000","last_change":"2023-08-25T04:47:03.119128+0000","last_active":"2023-08-25T04:47:03.119076+0000","last_peered":"2023-08-25T04:47:03.119076+0000","last_clean":"2023-08-25T04:47:03.119076+0000","last_became_active":"2023-08-25T04:43:42.897108+0000","last_became_peered":"2023-08-25T04:43:42.897108+0000","last_unstale":"2023-08-25T04:47:03.119076+0000","last_undegraded":"2023-08-25T04:47:03.119076+0000","last_fullsized":"2023-08-25T04:47:03.119076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'288","last_scrub_stamp":"2023-08-25T04:47:03.118961+0000","last_deep_scrub":"23'288","last_deep_scrub_stamp":"2023-08-25T04:47:03.118961+0000","last_clean_scrub_stamp":"2023-08-25T04:47:03.118961+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:21:04.429711+0000","scrub_duration":0.0023515239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:14.033833+0000","last_change":"2023-08-25T04:46:14.033900+0000","last_active":"2023-08-25T04:46:14.033833+0000","last_peered":"2023-08-25T04:46:14.033833+0000","last_clean":"2023-08-25T04:46:14.033833+0000","last_became_active":"2023-08-25T04:43:41.888323+0000","last_became_peered":"2023-08-25T04:43:41.888323+0000","last_unstale":"2023-08-25T04:46:14.033833+0000","last_undegraded":"2023-08-25T04:46:14.033833+0000","last_fullsized":"2023-08-25T04:46:14.033833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:14.033678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:14.033678+0000","last_clean_scrub_stamp":"2023-08-25T04:46:14.033678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:35:18.191917+0000","scrub_duration":0.0021053500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"23'285","reported_seq":310,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:04.217438+0000","last_change":"2023-08-25T04:46:04.217487+0000","last_active":"2023-08-25T04:46:04.217438+0000","last_peered":"2023-08-25T04:46:04.217438+0000","last_clean":"2023-08-25T04:46:04.217438+0000","last_became_active":"2023-08-25T04:43:42.896943+0000","last_became_peered":"2023-08-25T04:43:42.896943+0000","last_unstale":"2023-08-25T04:46:04.217438+0000","last_undegraded":"2023-08-25T04:46:04.217438+0000","last_fullsized":"2023-08-25T04:46:04.217438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'285","last_scrub_stamp":"2023-08-25T04:46:04.217330+0000","last_deep_scrub":"23'285","last_deep_scrub_stamp":"2023-08-25T04:46:04.217330+0000","last_clean_scrub_stamp":"2023-08-25T04:46:04.217330+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:11.803128+0000","scrub_duration":0.0016762509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:15.146036+0000","last_change":"2023-08-25T04:46:15.146082+0000","last_active":"2023-08-25T04:46:15.146036+0000","last_peered":"2023-08-25T04:46:15.146036+0000","last_clean":"2023-08-25T04:46:15.146036+0000","last_became_active":"2023-08-25T04:43:41.886846+0000","last_became_peered":"2023-08-25T04:43:41.886846+0000","last_unstale":"2023-08-25T04:46:15.146036+0000","last_undegraded":"2023-08-25T04:46:15.146036+0000","last_fullsized":"2023-08-25T04:46:15.146036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:15.145931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:15.145931+0000","last_clean_scrub_stamp":"2023-08-25T04:46:15.145931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:14.466872+0000","scrub_duration":0.001480068,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'280","reported_seq":305,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:26.413514+0000","last_change":"2023-08-25T04:46:26.413581+0000","last_active":"2023-08-25T04:46:26.413514+0000","last_peered":"2023-08-25T04:46:26.413514+0000","last_clean":"2023-08-25T04:46:26.413514+0000","last_became_active":"2023-08-25T04:43:42.902123+0000","last_became_peered":"2023-08-25T04:43:42.902123+0000","last_unstale":"2023-08-25T04:46:26.413514+0000","last_undegraded":"2023-08-25T04:46:26.413514+0000","last_fullsized":"2023-08-25T04:46:26.413514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'280","last_scrub_stamp":"2023-08-25T04:46:26.413389+0000","last_deep_scrub":"23'280","last_deep_scrub_stamp":"2023-08-25T04:46:26.413389+0000","last_clean_scrub_stamp":"2023-08-25T04:46:26.413389+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:06:05.843388+0000","scrub_duration":0.0016787550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'4","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:06.992606+0000","last_change":"2023-08-25T04:46:06.992658+0000","last_active":"2023-08-25T04:46:06.992606+0000","last_peered":"2023-08-25T04:46:06.992606+0000","last_clean":"2023-08-25T04:46:06.992606+0000","last_became_active":"2023-08-25T04:43:41.882776+0000","last_became_peered":"2023-08-25T04:43:41.882776+0000","last_unstale":"2023-08-25T04:46:06.992606+0000","last_undegraded":"2023-08-25T04:46:06.992606+0000","last_fullsized":"2023-08-25T04:46:06.992606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2023-08-25T04:46:06.992500+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2023-08-25T04:46:06.992500+0000","last_clean_scrub_stamp":"2023-08-25T04:46:06.992500+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:48.672959+0000","scrub_duration":0.0035735530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:13.079069+0000","last_change":"2023-08-25T04:46:13.079120+0000","last_active":"2023-08-25T04:46:13.079069+0000","last_peered":"2023-08-25T04:46:13.079069+0000","last_clean":"2023-08-25T04:46:13.079069+0000","last_became_active":"2023-08-25T04:43:36.785725+0000","last_became_peered":"2023-08-25T04:43:36.785725+0000","last_unstale":"2023-08-25T04:46:13.079069+0000","last_undegraded":"2023-08-25T04:46:13.079069+0000","last_fullsized":"2023-08-25T04:46:13.079069+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:13.078953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:13.078953+0000","last_clean_scrub_stamp":"2023-08-25T04:46:13.078953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:16.775955+0000","scrub_duration":0.0021933959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"23'254","reported_seq":279,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:16.169561+0000","last_change":"2023-08-25T04:46:16.169612+0000","last_active":"2023-08-25T04:46:16.169561+0000","last_peered":"2023-08-25T04:46:16.169561+0000","last_clean":"2023-08-25T04:46:16.169561+0000","last_became_active":"2023-08-25T04:43:42.889721+0000","last_became_peered":"2023-08-25T04:43:42.889721+0000","last_unstale":"2023-08-25T04:46:16.169561+0000","last_undegraded":"2023-08-25T04:46:16.169561+0000","last_fullsized":"2023-08-25T04:46:16.169561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'254","last_scrub_stamp":"2023-08-25T04:46:16.169445+0000","last_deep_scrub":"23'254","last_deep_scrub_stamp":"2023-08-25T04:46:16.169445+0000","last_clean_scrub_stamp":"2023-08-25T04:46:16.169445+0000","objects_scrubbed":1,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:16:29.603610+0000","scrub_duration":0.0096788659999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:50.725288+0000","last_change":"2023-08-25T04:45:50.725366+0000","last_active":"2023-08-25T04:45:50.725288+0000","last_peered":"2023-08-25T04:45:50.725288+0000","last_clean":"2023-08-25T04:45:50.725288+0000","last_became_active":"2023-08-25T04:43:36.782680+0000","last_became_peered":"2023-08-25T04:43:36.782680+0000","last_unstale":"2023-08-25T04:45:50.725288+0000","last_undegraded":"2023-08-25T04:45:50.725288+0000","last_fullsized":"2023-08-25T04:45:50.725288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:50.725133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:50.725133+0000","last_clean_scrub_stamp":"2023-08-25T04:45:50.725133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:59.488947+0000","scrub_duration":0.0018703929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'10","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:56.942806+0000","last_change":"2023-08-25T04:45:56.942911+0000","last_active":"2023-08-25T04:45:56.942806+0000","last_peered":"2023-08-25T04:45:56.942806+0000","last_clean":"2023-08-25T04:45:56.942806+0000","last_became_active":"2023-08-25T04:43:41.885363+0000","last_became_peered":"2023-08-25T04:43:41.885363+0000","last_unstale":"2023-08-25T04:45:56.942806+0000","last_undegraded":"2023-08-25T04:45:56.942806+0000","last_fullsized":"2023-08-25T04:45:56.942806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2023-08-25T04:45:56.942677+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2023-08-25T04:45:56.942677+0000","last_clean_scrub_stamp":"2023-08-25T04:45:56.942677+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:57:56.907128+0000","scrub_duration":0.002126574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'246","reported_seq":271,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:28.159508+0000","last_change":"2023-08-25T04:46:28.159573+0000","last_active":"2023-08-25T04:46:28.159508+0000","last_peered":"2023-08-25T04:46:28.159508+0000","last_clean":"2023-08-25T04:46:28.159508+0000","last_became_active":"2023-08-25T04:43:42.898942+0000","last_became_peered":"2023-08-25T04:43:42.898942+0000","last_unstale":"2023-08-25T04:46:28.159508+0000","last_undegraded":"2023-08-25T04:46:28.159508+0000","last_fullsized":"2023-08-25T04:46:28.159508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'246","last_scrub_stamp":"2023-08-25T04:46:28.159368+0000","last_deep_scrub":"23'246","last_deep_scrub_stamp":"2023-08-25T04:46:28.159368+0000","last_clean_scrub_stamp":"2023-08-25T04:46:28.159368+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:18:53.143904+0000","scrub_duration":0.001848113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.283941+0000","last_change":"2023-08-25T04:46:00.284036+0000","last_active":"2023-08-25T04:46:00.283941+0000","last_peered":"2023-08-25T04:46:00.283941+0000","last_clean":"2023-08-25T04:46:00.283941+0000","last_became_active":"2023-08-25T04:43:36.784937+0000","last_became_peered":"2023-08-25T04:43:36.784937+0000","last_unstale":"2023-08-25T04:46:00.283941+0000","last_undegraded":"2023-08-25T04:46:00.283941+0000","last_fullsized":"2023-08-25T04:46:00.283941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:00.283816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:00.283816+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.283816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:41.211029+0000","scrub_duration":0.001807915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"23'119","reported_seq":185,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:53.220629+0000","last_change":"2023-08-25T04:45:53.220691+0000","last_active":"2023-08-25T04:45:53.220629+0000","last_peered":"2023-08-25T04:45:53.220629+0000","last_clean":"2023-08-25T04:45:53.220629+0000","last_became_active":"2023-08-25T04:43:36.785451+0000","last_became_peered":"2023-08-25T04:43:36.785451+0000","last_unstale":"2023-08-25T04:45:53.220629+0000","last_undegraded":"2023-08-25T04:45:53.220629+0000","last_fullsized":"2023-08-25T04:45:53.220629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2023-08-25T04:45:53.220526+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2023-08-25T04:45:53.220526+0000","last_clean_scrub_stamp":"2023-08-25T04:45:53.220526+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:57:53.184978+0000","scrub_duration":0.00569083,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'14","reported_seq":54,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:50.919372+0000","last_change":"2023-08-25T04:45:50.919443+0000","last_active":"2023-08-25T04:45:50.919372+0000","last_peered":"2023-08-25T04:45:50.919372+0000","last_clean":"2023-08-25T04:45:50.919372+0000","last_became_active":"2023-08-25T04:43:41.885029+0000","last_became_peered":"2023-08-25T04:43:41.885029+0000","last_unstale":"2023-08-25T04:45:50.919372+0000","last_undegraded":"2023-08-25T04:45:50.919372+0000","last_fullsized":"2023-08-25T04:45:50.919372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2023-08-25T04:45:50.919257+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2023-08-25T04:45:50.919257+0000","last_clean_scrub_stamp":"2023-08-25T04:45:50.919257+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:18.289019+0000","scrub_duration":0.002121202,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7272,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":13,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'275","reported_seq":300,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:12.984470+0000","last_change":"2023-08-25T04:46:12.984547+0000","last_active":"2023-08-25T04:46:12.984470+0000","last_peered":"2023-08-25T04:46:12.984470+0000","last_clean":"2023-08-25T04:46:12.984470+0000","last_became_active":"2023-08-25T04:43:42.880591+0000","last_became_peered":"2023-08-25T04:43:42.880591+0000","last_unstale":"2023-08-25T04:46:12.984470+0000","last_undegraded":"2023-08-25T04:46:12.984470+0000","last_fullsized":"2023-08-25T04:46:12.984470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'275","last_scrub_stamp":"2023-08-25T04:46:12.984338+0000","last_deep_scrub":"23'275","last_deep_scrub_stamp":"2023-08-25T04:46:12.984338+0000","last_clean_scrub_stamp":"2023-08-25T04:46:12.984338+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:54.664796+0000","scrub_duration":0.001898091,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.160820+0000","last_change":"2023-08-25T04:45:57.160870+0000","last_active":"2023-08-25T04:45:57.160820+0000","last_peered":"2023-08-25T04:45:57.160820+0000","last_clean":"2023-08-25T04:45:57.160820+0000","last_became_active":"2023-08-25T04:43:37.192594+0000","last_became_peered":"2023-08-25T04:43:37.192594+0000","last_unstale":"2023-08-25T04:45:57.160820+0000","last_undegraded":"2023-08-25T04:45:57.160820+0000","last_fullsized":"2023-08-25T04:45:57.160820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:57.160708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:57.160708+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.160708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:32.985699+0000","scrub_duration":0.0019998730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:03.362033+0000","last_change":"2023-08-25T04:46:03.362124+0000","last_active":"2023-08-25T04:46:03.362033+0000","last_peered":"2023-08-25T04:46:03.362033+0000","last_clean":"2023-08-25T04:46:03.362033+0000","last_became_active":"2023-08-25T04:43:41.888158+0000","last_became_peered":"2023-08-25T04:43:41.888158+0000","last_unstale":"2023-08-25T04:46:03.362033+0000","last_undegraded":"2023-08-25T04:46:03.362033+0000","last_fullsized":"2023-08-25T04:46:03.362033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:03.361887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:03.361887+0000","last_clean_scrub_stamp":"2023-08-25T04:46:03.361887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:22.060209+0000","scrub_duration":0.0021121450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'249","reported_seq":274,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:29.463247+0000","last_change":"2023-08-25T04:46:29.463299+0000","last_active":"2023-08-25T04:46:29.463247+0000","last_peered":"2023-08-25T04:46:29.463247+0000","last_clean":"2023-08-25T04:46:29.463247+0000","last_became_active":"2023-08-25T04:43:42.901657+0000","last_became_peered":"2023-08-25T04:43:42.901657+0000","last_unstale":"2023-08-25T04:46:29.463247+0000","last_undegraded":"2023-08-25T04:46:29.463247+0000","last_fullsized":"2023-08-25T04:46:29.463247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'249","last_scrub_stamp":"2023-08-25T04:46:29.463120+0000","last_deep_scrub":"23'249","last_deep_scrub_stamp":"2023-08-25T04:46:29.463120+0000","last_clean_scrub_stamp":"2023-08-25T04:46:29.463120+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:16:42.897285+0000","scrub_duration":0.0024623650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:55.203439+0000","last_change":"2023-08-25T04:45:55.203486+0000","last_active":"2023-08-25T04:45:55.203439+0000","last_peered":"2023-08-25T04:45:55.203439+0000","last_clean":"2023-08-25T04:45:55.203439+0000","last_became_active":"2023-08-25T04:43:37.192427+0000","last_became_peered":"2023-08-25T04:43:37.192427+0000","last_unstale":"2023-08-25T04:45:55.203439+0000","last_undegraded":"2023-08-25T04:45:55.203439+0000","last_fullsized":"2023-08-25T04:45:55.203439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:55.203319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:55.203319+0000","last_clean_scrub_stamp":"2023-08-25T04:45:55.203319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:03.967132+0000","scrub_duration":0.0023883820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:05.948775+0000","last_change":"2023-08-25T04:46:05.948826+0000","last_active":"2023-08-25T04:46:05.948775+0000","last_peered":"2023-08-25T04:46:05.948775+0000","last_clean":"2023-08-25T04:46:05.948775+0000","last_became_active":"2023-08-25T04:43:41.883621+0000","last_became_peered":"2023-08-25T04:43:41.883621+0000","last_unstale":"2023-08-25T04:46:05.948775+0000","last_undegraded":"2023-08-25T04:46:05.948775+0000","last_fullsized":"2023-08-25T04:46:05.948775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:05.948651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:05.948651+0000","last_clean_scrub_stamp":"2023-08-25T04:46:05.948651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:59.653326+0000","scrub_duration":0.001754584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.661611+0000","last_change":"2023-08-25T04:46:01.661661+0000","last_active":"2023-08-25T04:46:01.661611+0000","last_peered":"2023-08-25T04:46:01.661611+0000","last_clean":"2023-08-25T04:46:01.661611+0000","last_became_active":"2023-08-25T04:43:42.893333+0000","last_became_peered":"2023-08-25T04:43:42.893333+0000","last_unstale":"2023-08-25T04:46:01.661611+0000","last_undegraded":"2023-08-25T04:46:01.661611+0000","last_fullsized":"2023-08-25T04:46:01.661611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:01.661506+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:01.661506+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.661506+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:29.031268+0000","scrub_duration":0.0017295419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:51.501952+0000","last_change":"2023-08-25T04:45:51.502008+0000","last_active":"2023-08-25T04:45:51.501952+0000","last_peered":"2023-08-25T04:45:51.501952+0000","last_clean":"2023-08-25T04:45:51.501952+0000","last_became_active":"2023-08-25T04:43:37.192432+0000","last_became_peered":"2023-08-25T04:43:37.192432+0000","last_unstale":"2023-08-25T04:45:51.501952+0000","last_undegraded":"2023-08-25T04:45:51.501952+0000","last_fullsized":"2023-08-25T04:45:51.501952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:51.501848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:51.501848+0000","last_clean_scrub_stamp":"2023-08-25T04:45:51.501848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:18.871610+0000","scrub_duration":0.0015800009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:14.988470+0000","last_change":"2023-08-25T04:46:14.988549+0000","last_active":"2023-08-25T04:46:14.988470+0000","last_peered":"2023-08-25T04:46:14.988470+0000","last_clean":"2023-08-25T04:46:14.988470+0000","last_became_active":"2023-08-25T04:43:41.889717+0000","last_became_peered":"2023-08-25T04:43:41.889717+0000","last_unstale":"2023-08-25T04:46:14.988470+0000","last_undegraded":"2023-08-25T04:46:14.988470+0000","last_fullsized":"2023-08-25T04:46:14.988470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:46:14.988323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:46:14.988323+0000","last_clean_scrub_stamp":"2023-08-25T04:46:14.988323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:11:58.826953+0000","scrub_duration":0.0019775750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"23'260","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:28.444582+0000","last_change":"2023-08-25T04:46:28.444663+0000","last_active":"2023-08-25T04:46:28.444582+0000","last_peered":"2023-08-25T04:46:28.444582+0000","last_clean":"2023-08-25T04:46:28.444582+0000","last_became_active":"2023-08-25T04:43:42.885671+0000","last_became_peered":"2023-08-25T04:43:42.885671+0000","last_unstale":"2023-08-25T04:46:28.444582+0000","last_undegraded":"2023-08-25T04:46:28.444582+0000","last_fullsized":"2023-08-25T04:46:28.444582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'260","last_scrub_stamp":"2023-08-25T04:46:28.444450+0000","last_deep_scrub":"23'260","last_deep_scrub_stamp":"2023-08-25T04:46:28.444450+0000","last_clean_scrub_stamp":"2023-08-25T04:46:28.444450+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:27.765391+0000","scrub_duration":0.001797613,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:54.771152+0000","last_change":"2023-08-25T04:45:54.771206+0000","last_active":"2023-08-25T04:45:54.771152+0000","last_peered":"2023-08-25T04:45:54.771152+0000","last_clean":"2023-08-25T04:45:54.771152+0000","last_became_active":"2023-08-25T04:43:37.192429+0000","last_became_peered":"2023-08-25T04:43:37.192429+0000","last_unstale":"2023-08-25T04:45:54.771152+0000","last_undegraded":"2023-08-25T04:45:54.771152+0000","last_fullsized":"2023-08-25T04:45:54.771152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:54.771023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:54.771023+0000","last_clean_scrub_stamp":"2023-08-25T04:45:54.771023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:36:51.613947+0000","scrub_duration":0.00223077,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"23'2","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:09.442864+0000","last_change":"2023-08-25T04:46:09.442913+0000","last_active":"2023-08-25T04:46:09.442864+0000","last_peered":"2023-08-25T04:46:09.442864+0000","last_clean":"2023-08-25T04:46:09.442864+0000","last_became_active":"2023-08-25T04:43:41.888207+0000","last_became_peered":"2023-08-25T04:43:41.888207+0000","last_unstale":"2023-08-25T04:46:09.442864+0000","last_undegraded":"2023-08-25T04:46:09.442864+0000","last_fullsized":"2023-08-25T04:46:09.442864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-08-25T04:46:09.442734+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-08-25T04:46:09.442734+0000","last_clean_scrub_stamp":"2023-08-25T04:46:09.442734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:45.267725+0000","scrub_duration":0.001704176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'310","reported_seq":335,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:19.995299+0000","last_change":"2023-08-25T04:46:19.995353+0000","last_active":"2023-08-25T04:46:19.995299+0000","last_peered":"2023-08-25T04:46:19.995299+0000","last_clean":"2023-08-25T04:46:19.995299+0000","last_became_active":"2023-08-25T04:43:42.900470+0000","last_became_peered":"2023-08-25T04:43:42.900470+0000","last_unstale":"2023-08-25T04:46:19.995299+0000","last_undegraded":"2023-08-25T04:46:19.995299+0000","last_fullsized":"2023-08-25T04:46:19.995299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'310","last_scrub_stamp":"2023-08-25T04:46:19.995142+0000","last_deep_scrub":"23'310","last_deep_scrub_stamp":"2023-08-25T04:46:19.995142+0000","last_clean_scrub_stamp":"2023-08-25T04:46:19.995142+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:16:33.429307+0000","scrub_duration":0.002470397,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:53.765264+0000","last_change":"2023-08-25T04:45:53.765312+0000","last_active":"2023-08-25T04:45:53.765264+0000","last_peered":"2023-08-25T04:45:53.765264+0000","last_clean":"2023-08-25T04:45:53.765264+0000","last_became_active":"2023-08-25T04:43:36.784943+0000","last_became_peered":"2023-08-25T04:43:36.784943+0000","last_unstale":"2023-08-25T04:45:53.765264+0000","last_undegraded":"2023-08-25T04:45:53.765264+0000","last_fullsized":"2023-08-25T04:45:53.765264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:53.765149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:53.765149+0000","last_clean_scrub_stamp":"2023-08-25T04:45:53.765149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:47:02.134163+0000","scrub_duration":0.0021115940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"23'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:00.309949+0000","last_change":"2023-08-25T04:46:00.310024+0000","last_active":"2023-08-25T04:46:00.309949+0000","last_peered":"2023-08-25T04:46:00.309949+0000","last_clean":"2023-08-25T04:46:00.309949+0000","last_became_active":"2023-08-25T04:43:41.884535+0000","last_became_peered":"2023-08-25T04:43:41.884535+0000","last_unstale":"2023-08-25T04:46:00.309949+0000","last_undegraded":"2023-08-25T04:46:00.309949+0000","last_fullsized":"2023-08-25T04:46:00.309949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-08-25T04:46:00.309816+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-08-25T04:46:00.309816+0000","last_clean_scrub_stamp":"2023-08-25T04:46:00.309816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:09.073630+0000","scrub_duration":0.0020692610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"23'273","reported_seq":298,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:25.373588+0000","last_change":"2023-08-25T04:46:25.373676+0000","last_active":"2023-08-25T04:46:25.373588+0000","last_peered":"2023-08-25T04:46:25.373588+0000","last_clean":"2023-08-25T04:46:25.373588+0000","last_became_active":"2023-08-25T04:43:42.902721+0000","last_became_peered":"2023-08-25T04:43:42.902721+0000","last_unstale":"2023-08-25T04:46:25.373588+0000","last_undegraded":"2023-08-25T04:46:25.373588+0000","last_fullsized":"2023-08-25T04:46:25.373588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'273","last_scrub_stamp":"2023-08-25T04:46:25.373435+0000","last_deep_scrub":"23'273","last_deep_scrub_stamp":"2023-08-25T04:46:25.373435+0000","last_clean_scrub_stamp":"2023-08-25T04:46:25.373435+0000","objects_scrubbed":1,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:32.959233+0000","scrub_duration":0.010531183,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:55.955731+0000","last_change":"2023-08-25T04:45:55.955731+0000","last_active":"2023-08-25T04:45:55.955731+0000","last_peered":"2023-08-25T04:45:55.955731+0000","last_clean":"2023-08-25T04:45:55.955731+0000","last_became_active":"2023-08-25T04:43:41.889659+0000","last_became_peered":"2023-08-25T04:43:41.889659+0000","last_unstale":"2023-08-25T04:45:55.955731+0000","last_undegraded":"2023-08-25T04:45:55.955731+0000","last_fullsized":"2023-08-25T04:45:55.955731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-08-25T04:45:55.955491+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-08-25T04:45:55.955491+0000","last_clean_scrub_stamp":"2023-08-25T04:45:55.955491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:14.653813+0000","scrub_duration":0.0022824579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'274","reported_seq":299,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.236575+0000","last_change":"2023-08-25T04:45:52.236575+0000","last_active":"2023-08-25T04:45:52.236575+0000","last_peered":"2023-08-25T04:45:52.236575+0000","last_clean":"2023-08-25T04:45:52.236575+0000","last_became_active":"2023-08-25T04:43:42.894618+0000","last_became_peered":"2023-08-25T04:43:42.894618+0000","last_unstale":"2023-08-25T04:45:52.236575+0000","last_undegraded":"2023-08-25T04:45:52.236575+0000","last_fullsized":"2023-08-25T04:45:52.236575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'274","last_scrub_stamp":"2023-08-25T04:45:52.236416+0000","last_deep_scrub":"23'274","last_deep_scrub_stamp":"2023-08-25T04:45:52.236416+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.236416+0000","objects_scrubbed":1,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:47:56.691703+0000","scrub_duration":0.0060813940000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'3","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:57.399191+0000","last_change":"2023-08-25T04:45:57.399191+0000","last_active":"2023-08-25T04:45:57.399191+0000","last_peered":"2023-08-25T04:45:57.399191+0000","last_clean":"2023-08-25T04:45:57.399191+0000","last_became_active":"2023-08-25T04:43:41.886063+0000","last_became_peered":"2023-08-25T04:43:41.886063+0000","last_unstale":"2023-08-25T04:45:57.399191+0000","last_undegraded":"2023-08-25T04:45:57.399191+0000","last_fullsized":"2023-08-25T04:45:57.399191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-08-25T04:45:57.399037+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-08-25T04:45:57.399037+0000","last_clean_scrub_stamp":"2023-08-25T04:45:57.399037+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:16.097359+0000","scrub_duration":0.0030540559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'263","reported_seq":288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:52.167945+0000","last_change":"2023-08-25T04:45:52.167945+0000","last_active":"2023-08-25T04:45:52.167945+0000","last_peered":"2023-08-25T04:45:52.167945+0000","last_clean":"2023-08-25T04:45:52.167945+0000","last_became_active":"2023-08-25T04:43:42.900135+0000","last_became_peered":"2023-08-25T04:43:42.900135+0000","last_unstale":"2023-08-25T04:45:52.167945+0000","last_undegraded":"2023-08-25T04:45:52.167945+0000","last_fullsized":"2023-08-25T04:45:52.167945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'263","last_scrub_stamp":"2023-08-25T04:45:52.167794+0000","last_deep_scrub":"23'263","last_deep_scrub_stamp":"2023-08-25T04:45:52.167794+0000","last_clean_scrub_stamp":"2023-08-25T04:45:52.167794+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:40.246934+0000","scrub_duration":0.00190884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'4","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:59.323712+0000","last_change":"2023-08-25T04:45:59.323712+0000","last_active":"2023-08-25T04:45:59.323712+0000","last_peered":"2023-08-25T04:45:59.323712+0000","last_clean":"2023-08-25T04:45:59.323712+0000","last_became_active":"2023-08-25T04:43:41.891306+0000","last_became_peered":"2023-08-25T04:43:41.891306+0000","last_unstale":"2023-08-25T04:45:59.323712+0000","last_undegraded":"2023-08-25T04:45:59.323712+0000","last_fullsized":"2023-08-25T04:45:59.323712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2023-08-25T04:45:59.323559+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2023-08-25T04:45:59.323559+0000","last_clean_scrub_stamp":"2023-08-25T04:45:59.323559+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:57:59.288011+0000","scrub_duration":0.0028396300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'258","reported_seq":283,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:47.197070+0000","last_change":"2023-08-25T04:46:47.197121+0000","last_active":"2023-08-25T04:46:47.197070+0000","last_peered":"2023-08-25T04:46:47.197070+0000","last_clean":"2023-08-25T04:46:47.197070+0000","last_became_active":"2023-08-25T04:43:42.894386+0000","last_became_peered":"2023-08-25T04:43:42.894386+0000","last_unstale":"2023-08-25T04:46:47.197070+0000","last_undegraded":"2023-08-25T04:46:47.197070+0000","last_fullsized":"2023-08-25T04:46:47.197070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'258","last_scrub_stamp":"2023-08-25T04:46:47.196966+0000","last_deep_scrub":"23'258","last_deep_scrub_stamp":"2023-08-25T04:46:47.196966+0000","last_clean_scrub_stamp":"2023-08-25T04:46:47.196966+0000","objects_scrubbed":1,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:28:45.798013+0000","scrub_duration":0.011337738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:11.089321+0000","last_change":"2023-08-25T04:46:11.089419+0000","last_active":"2023-08-25T04:46:11.089321+0000","last_peered":"2023-08-25T04:46:11.089321+0000","last_clean":"2023-08-25T04:46:11.089321+0000","last_became_active":"2023-08-25T04:43:41.892929+0000","last_became_peered":"2023-08-25T04:43:41.892929+0000","last_unstale":"2023-08-25T04:46:11.089321+0000","last_undegraded":"2023-08-25T04:46:11.089321+0000","last_fullsized":"2023-08-25T04:46:11.089321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-08-25T04:46:11.089185+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-08-25T04:46:11.089185+0000","last_clean_scrub_stamp":"2023-08-25T04:46:11.089185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:18.674983+0000","scrub_duration":0.0021106720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'252","reported_seq":277,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:37.415181+0000","last_change":"2023-08-25T04:46:37.415247+0000","last_active":"2023-08-25T04:46:37.415181+0000","last_peered":"2023-08-25T04:46:37.415181+0000","last_clean":"2023-08-25T04:46:37.415181+0000","last_became_active":"2023-08-25T04:43:42.894239+0000","last_became_peered":"2023-08-25T04:43:42.894239+0000","last_unstale":"2023-08-25T04:46:37.415181+0000","last_undegraded":"2023-08-25T04:46:37.415181+0000","last_fullsized":"2023-08-25T04:46:37.415181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'252","last_scrub_stamp":"2023-08-25T04:46:37.415061+0000","last_deep_scrub":"23'252","last_deep_scrub_stamp":"2023-08-25T04:46:37.415061+0000","last_clean_scrub_stamp":"2023-08-25T04:46:37.415061+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:30:56.369431+0000","scrub_duration":0.0017381160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'7","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:45:58.974261+0000","last_change":"2023-08-25T04:45:58.974319+0000","last_active":"2023-08-25T04:45:58.974261+0000","last_peered":"2023-08-25T04:45:58.974261+0000","last_clean":"2023-08-25T04:45:58.974261+0000","last_became_active":"2023-08-25T04:43:41.882756+0000","last_became_peered":"2023-08-25T04:43:41.882756+0000","last_unstale":"2023-08-25T04:45:58.974261+0000","last_undegraded":"2023-08-25T04:45:58.974261+0000","last_fullsized":"2023-08-25T04:45:58.974261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2023-08-25T04:45:58.974148+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2023-08-25T04:45:58.974148+0000","last_clean_scrub_stamp":"2023-08-25T04:45:58.974148+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:07.737962+0000","scrub_duration":0.0040936990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'285","reported_seq":310,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:01.168483+0000","last_change":"2023-08-25T04:46:01.168483+0000","last_active":"2023-08-25T04:46:01.168483+0000","last_peered":"2023-08-25T04:46:01.168483+0000","last_clean":"2023-08-25T04:46:01.168483+0000","last_became_active":"2023-08-25T04:43:42.894912+0000","last_became_peered":"2023-08-25T04:43:42.894912+0000","last_unstale":"2023-08-25T04:46:01.168483+0000","last_undegraded":"2023-08-25T04:46:01.168483+0000","last_fullsized":"2023-08-25T04:46:01.168483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'285","last_scrub_stamp":"2023-08-25T04:46:01.168322+0000","last_deep_scrub":"23'285","last_deep_scrub_stamp":"2023-08-25T04:46:01.168322+0000","last_clean_scrub_stamp":"2023-08-25T04:46:01.168322+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:22:40.848712+0000","scrub_duration":0.0017623630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"23'260","reported_seq":285,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:05.706542+0000","last_change":"2023-08-25T04:46:05.706619+0000","last_active":"2023-08-25T04:46:05.706542+0000","last_peered":"2023-08-25T04:46:05.706542+0000","last_clean":"2023-08-25T04:46:05.706542+0000","last_became_active":"2023-08-25T04:43:42.893255+0000","last_became_peered":"2023-08-25T04:43:42.893255+0000","last_unstale":"2023-08-25T04:46:05.706542+0000","last_undegraded":"2023-08-25T04:46:05.706542+0000","last_fullsized":"2023-08-25T04:46:05.706542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'260","last_scrub_stamp":"2023-08-25T04:46:05.706403+0000","last_deep_scrub":"23'260","last_deep_scrub_stamp":"2023-08-25T04:46:05.706403+0000","last_clean_scrub_stamp":"2023-08-25T04:46:05.706403+0000","objects_scrubbed":1,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:24.404725+0000","scrub_duration":0.0087624350000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"23'306","reported_seq":331,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:31.339911+0000","last_change":"2023-08-25T04:46:31.339990+0000","last_active":"2023-08-25T04:46:31.339911+0000","last_peered":"2023-08-25T04:46:31.339911+0000","last_clean":"2023-08-25T04:46:31.339911+0000","last_became_active":"2023-08-25T04:43:42.897394+0000","last_became_peered":"2023-08-25T04:43:42.897394+0000","last_unstale":"2023-08-25T04:46:31.339911+0000","last_undegraded":"2023-08-25T04:46:31.339911+0000","last_fullsized":"2023-08-25T04:46:31.339911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'306","last_scrub_stamp":"2023-08-25T04:46:31.339737+0000","last_deep_scrub":"23'306","last_deep_scrub_stamp":"2023-08-25T04:46:31.339737+0000","last_clean_scrub_stamp":"2023-08-25T04:46:31.339737+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:46.943234+0000","scrub_duration":0.0019072749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'287","reported_seq":312,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:58.201960+0000","last_change":"2023-08-25T04:46:58.202044+0000","last_active":"2023-08-25T04:46:58.201960+0000","last_peered":"2023-08-25T04:46:58.201960+0000","last_clean":"2023-08-25T04:46:58.201960+0000","last_became_active":"2023-08-25T04:43:42.894176+0000","last_became_peered":"2023-08-25T04:43:42.894176+0000","last_unstale":"2023-08-25T04:46:58.201960+0000","last_undegraded":"2023-08-25T04:46:58.201960+0000","last_fullsized":"2023-08-25T04:46:58.201960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'287","last_scrub_stamp":"2023-08-25T04:46:58.201836+0000","last_deep_scrub":"23'287","last_deep_scrub_stamp":"2023-08-25T04:46:58.201836+0000","last_clean_scrub_stamp":"2023-08-25T04:46:58.201836+0000","objects_scrubbed":1,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:55.244173+0000","scrub_duration":0.010684816999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"23'256","reported_seq":281,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:33.425915+0000","last_change":"2023-08-25T04:46:33.425963+0000","last_active":"2023-08-25T04:46:33.425915+0000","last_peered":"2023-08-25T04:46:33.425915+0000","last_clean":"2023-08-25T04:46:33.425915+0000","last_became_active":"2023-08-25T04:43:42.898842+0000","last_became_peered":"2023-08-25T04:43:42.898842+0000","last_unstale":"2023-08-25T04:46:33.425915+0000","last_undegraded":"2023-08-25T04:46:33.425915+0000","last_fullsized":"2023-08-25T04:46:33.425915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'256","last_scrub_stamp":"2023-08-25T04:46:33.425793+0000","last_deep_scrub":"23'256","last_deep_scrub_stamp":"2023-08-25T04:46:33.425793+0000","last_clean_scrub_stamp":"2023-08-25T04:46:33.425793+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:18:58.410329+0000","scrub_duration":0.0023056079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'267","reported_seq":292,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:46:13.322386+0000","last_change":"2023-08-25T04:46:13.322439+0000","last_active":"2023-08-25T04:46:13.322386+0000","last_peered":"2023-08-25T04:46:13.322386+0000","last_clean":"2023-08-25T04:46:13.322386+0000","last_became_active":"2023-08-25T04:43:42.889849+0000","last_became_peered":"2023-08-25T04:43:42.889849+0000","last_unstale":"2023-08-25T04:46:13.322386+0000","last_undegraded":"2023-08-25T04:46:13.322386+0000","last_fullsized":"2023-08-25T04:46:13.322386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'267","last_scrub_stamp":"2023-08-25T04:46:13.322282+0000","last_deep_scrub":"23'267","last_deep_scrub_stamp":"2023-08-25T04:46:13.322282+0000","last_clean_scrub_stamp":"2023-08-25T04:46:13.322282+0000","objects_scrubbed":1,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:15.465800+0000","scrub_duration":0.0081659450000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":524,"num_write_kb":1101824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16979,"ondisk_log_size":16979,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1518959,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":15,"num_write":463,"num_write_kb":1785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3096576,"data_stored":3037918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66388,"kb_used_data":26892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94305452,"statfs":{"total":96636764160,"available":96568782848,"internally_reserved":0,"allocated":27537408,"data_stored":27359168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":1.8160000000000001,"15min":0.96299999999999997},"min":{"1min":0.27900000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.72699999999999998,"5min":18.02,"15min":18.02},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":1.96,"15min":1.014},"min":{"1min":0.317,"5min":0.316,"15min":0.316},"max":{"1min":0.70999999999999996,"5min":22.920999999999999,"15min":22.920999999999999},"last":0.41699999999999998}]},{"osd":1,"last update":"Fri Aug 25 04:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":2.0139999999999998,"15min":1.093},"min":{"1min":0.435,"5min":0.314,"15min":0.314},"max":{"1min":0.96799999999999997,"5min":21.199999999999999,"15min":21.199999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":1.9690000000000001,"15min":1.032},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68200000000000005,"5min":22.437999999999999,"15min":22.437999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":1.7829999999999999,"15min":1.0389999999999999},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70899999999999996,"5min":17.844000000000001,"15min":17.844000000000001},"last":0.629},{"interface":"front","average":{"1min":0.59799999999999998,"5min":2.0510000000000002,"15min":1.216},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90900000000000003,"5min":19.690999999999999,"15min":19.690999999999999},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":1.8180000000000001,"15min":0.995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76500000000000001,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":2.0409999999999999,"15min":1.2549999999999999},"min":{"1min":0.41199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.72199999999999998,"5min":21.143999999999998,"15min":21.143999999999998},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":1.4670000000000001,"15min":0.80100000000000005},"min":{"1min":0.34899999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65500000000000003,"5min":22.465,"15min":22.465},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":1.3740000000000001,"15min":0.79200000000000004},"min":{"1min":0.36199999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70899999999999996,"5min":14.042999999999999,"15min":14.042999999999999},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":1.232,"15min":0.77800000000000002},"min":{"1min":0.371,"5min":0.307,"15min":0.307},"max":{"1min":0.755,"5min":14.117000000000001,"15min":14.117000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":1.617,"15min":0.91900000000000004},"min":{"1min":0.44500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73799999999999999,"5min":22.334,"15min":22.334},"last":0.501}]},{"osd":6,"last update":"Fri Aug 25 04:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":2.0179999999999998,"15min":1.0489999999999999},"min":{"1min":0.44400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76500000000000001,"5min":22.385000000000002,"15min":22.385000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":1.2509999999999999,"15min":0.81000000000000005},"min":{"1min":0.45700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68999999999999995,"5min":17.623000000000001,"15min":17.623000000000001},"last":0.44400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47924,"kb_used_data":8428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323916,"statfs":{"total":96636764160,"available":96587689984,"internally_reserved":0,"allocated":8630272,"data_stored":8480479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":1.7050000000000001,"15min":0.94499999999999995},"min":{"1min":0.35299999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.72199999999999998,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.7350000000000001,"15min":0.97699999999999998},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.83399999999999996,"5min":21.109000000000002,"15min":21.109000000000002},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.6919999999999999,"15min":1.272},"min":{"1min":0.39800000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78500000000000003,"5min":16.664999999999999,"15min":16.664999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":1.6180000000000001,"15min":1.073},"min":{"1min":0.38200000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72299999999999998,"5min":22.042000000000002,"15min":22.042000000000002},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":1.73,"15min":1.3080000000000001},"min":{"1min":0.47399999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76700000000000002,"5min":19.658000000000001,"15min":19.658000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.58899999999999997,"5min":1.4710000000000001,"15min":0.90700000000000003},"min":{"1min":0.39800000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77900000000000003,"5min":21.138999999999999,"15min":21.138999999999999},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":1.7250000000000001,"15min":0.98999999999999999},"min":{"1min":0.48099999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77800000000000002,"5min":21.971,"15min":21.971},"last":0.75},{"interface":"front","average":{"1min":0.58699999999999997,"5min":2.0139999999999998,"15min":1.385},"min":{"1min":0.44500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81000000000000005,"5min":23.931000000000001,"15min":23.931000000000001},"last":0.72599999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":1.3049999999999999,"15min":0.77500000000000002},"min":{"1min":0.35299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79600000000000004,"5min":14.532999999999999,"15min":14.532999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":1.2629999999999999,"15min":0.78100000000000003},"min":{"1min":0.38700000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.65600000000000003,"5min":21.081,"15min":21.081},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.94499999999999995,"15min":0.67600000000000005},"min":{"1min":0.38900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.755,"5min":12.946,"15min":12.946},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.98099999999999998,"15min":0.70299999999999996},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.82199999999999995,"5min":19.597000000000001,"15min":19.597000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":1.0009999999999999,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81799999999999995,"5min":11.266999999999999,"15min":11.266999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":1.331,"15min":0.84499999999999997},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.84699999999999998,"5min":16.693000000000001,"15min":16.693000000000001},"last":0.67000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76984,"kb_used_data":49968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94294856,"statfs":{"total":96636764160,"available":96557932544,"internally_reserved":0,"allocated":51167232,"data_stored":51013887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":1.4339999999999999,"15min":0.71399999999999997},"min":{"1min":0.26400000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":23.989999999999998,"15min":23.989999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":1.3100000000000001,"15min":0.68400000000000005},"min":{"1min":0.253,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60299999999999998,"5min":15.622,"15min":15.622},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":1.4490000000000001,"15min":0.74299999999999999},"min":{"1min":0.311,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57199999999999995,"5min":23.954000000000001,"15min":23.954000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":1.4550000000000001,"15min":0.78500000000000003},"min":{"1min":0.30599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60099999999999998,"5min":20.946000000000002,"15min":20.946000000000002},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":1.4179999999999999,"15min":0.76200000000000001},"min":{"1min":0.32400000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.67700000000000005,"5min":27.884,"15min":27.884},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.433,"5min":1.452,"15min":0.75},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61299999999999999,"5min":23.018000000000001,"15min":23.018000000000001},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":1.9450000000000001,"15min":1.0669999999999999},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.008,"5min":24.044,"15min":24.044},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.62,"5min":2.0819999999999999,"15min":1.113},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":27.940000000000001,"15min":27.940000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":2.198,"15min":1.1459999999999999},"min":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":26.969999999999999,"15min":26.969999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":1.9219999999999999,"15min":1.0700000000000001},"min":{"1min":0.35599999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90200000000000002,"5min":24.018000000000001,"15min":24.018000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":2.089,"15min":1.125},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":22.899999999999999,"15min":22.899999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":1.952,"15min":1.0980000000000001},"min":{"1min":0.42499999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97099999999999997,"5min":23.898,"15min":23.898},"last":0.69699999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":2.0750000000000002,"15min":1.137},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93200000000000005,"5min":21.010999999999999,"15min":21.010999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":1.768,"15min":1.0249999999999999},"min":{"1min":0.52800000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94799999999999995,"5min":23.053999999999998,"15min":23.053999999999998},"last":0.72299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64316,"kb_used_data":24820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94307524,"statfs":{"total":96636764160,"available":96570904576,"internally_reserved":0,"allocated":25415680,"data_stored":25264588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":1.0649999999999999,"15min":0.59499999999999997},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.50800000000000001,"5min":19.956,"15min":19.956},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":1.2270000000000001,"15min":0.68100000000000005},"min":{"1min":0.27300000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.79400000000000004,"5min":14.029999999999999,"15min":14.029999999999999},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":1.6319999999999999,"15min":0.84299999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65900000000000003,"5min":22.942,"15min":22.942},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.879,"15min":0.55300000000000005},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58799999999999997,"5min":11.016,"15min":11.016},"last":0.377}]},{"osd":3,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":1.3109999999999999,"15min":0.70899999999999996},"min":{"1min":0.32300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58499999999999996,"5min":19.997,"15min":19.997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.504,"5min":1.538,"15min":0.79500000000000004},"min":{"1min":0.36199999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68300000000000005,"5min":17.045999999999999,"15min":17.045999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":1.6990000000000001,"15min":1.3069999999999999},"min":{"1min":0.45800000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79200000000000004,"5min":21.001000000000001,"15min":21.001000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":2.165,"15min":1.1459999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.89100000000000001,"5min":20.986000000000001,"15min":20.986000000000001},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":2.4849999999999999,"15min":1.256},"min":{"1min":0.47099999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.83699999999999997,"5min":23.93,"15min":23.93},"last":0.621},{"interface":"front","average":{"1min":0.66400000000000003,"5min":1.853,"15min":1.0509999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":17.010000000000002,"15min":17.010000000000002},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":2.048,"15min":1.1120000000000001},"min":{"1min":0.498,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95499999999999996,"5min":27.701000000000001,"15min":27.701000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":1.504,"15min":0.96099999999999997},"min":{"1min":0.48999999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.98599999999999999,"5min":20.942,"15min":20.942},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":1.6850000000000001,"15min":1.0249999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.878,"5min":21.030999999999999,"15min":21.030999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":2.1219999999999999,"15min":1.1579999999999999},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93200000000000005,"5min":20.902999999999999,"15min":20.902999999999999},"last":0.56799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56116,"kb_used_data":16620,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315724,"statfs":{"total":96636764160,"available":96579301376,"internally_reserved":0,"allocated":17018880,"data_stored":16869087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":1.119,"15min":0.61899999999999999},"min":{"1min":0.27800000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55400000000000005,"5min":18.98,"15min":18.98},"last":0.441},{"interface":"front","average":{"1min":0.44,"5min":1.3109999999999999,"15min":0.70099999999999996},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.66300000000000003,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.39900000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":1.133,"15min":0.66700000000000004},"min":{"1min":0.29399999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.74199999999999999,"5min":20.995999999999999,"15min":20.995999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":1.0660000000000001,"15min":0.63500000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57299999999999995,"5min":12.052,"15min":12.052},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":1.3440000000000001,"15min":0.72999999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.63500000000000001,"5min":19.925999999999998,"15min":19.925999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.498,"5min":1.264,"15min":0.73599999999999999},"min":{"1min":0.35099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66800000000000004,"5min":20.916,"15min":20.916},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":1.9830000000000001,"15min":1.097},"min":{"1min":0.47699999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94299999999999995,"5min":19.940999999999999,"15min":19.940999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":2.1619999999999999,"15min":1.1259999999999999},"min":{"1min":0.44400000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.95999999999999996,"5min":22.038,"15min":22.038},"last":0.73999999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.8100000000000001,"15min":1.0600000000000001},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88200000000000001,"5min":19.98,"15min":19.98},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":2.0920000000000001,"15min":1.1180000000000001},"min":{"1min":0.504,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97599999999999998,"5min":21.050999999999998,"15min":21.050999999999998},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":1.9970000000000001,"15min":1.101},"min":{"1min":0.49299999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.90900000000000003,"5min":22.021999999999998,"15min":22.021999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":1.9279999999999999,"15min":1.0840000000000001},"min":{"1min":0.50900000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.84099999999999997,"5min":19.007999999999999,"15min":19.007999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:46:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":1.8959999999999999,"15min":1.0680000000000001},"min":{"1min":0.48599999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0069999999999999,"5min":21.023,"15min":21.023},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":2.4159999999999999,"15min":1.2569999999999999},"min":{"1min":0.49099999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.86599999999999999,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.71199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64120,"kb_used_data":37104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94307720,"statfs":{"total":96636764160,"available":96571105280,"internally_reserved":0,"allocated":37994496,"data_stored":37840697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":1.256,"15min":0.70199999999999996},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":23.542000000000002,"15min":23.542000000000002},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":1.272,"15min":0.76000000000000001},"min":{"1min":0.29799999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.628,"5min":20.547000000000001,"15min":20.547000000000001},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":1.2589999999999999,"15min":0.748},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66000000000000003,"5min":18.984999999999999,"15min":18.984999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.443,"5min":1.3400000000000001,"15min":0.73599999999999999},"min":{"1min":0.33600000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67700000000000005,"5min":20.052,"15min":20.052},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":1.524,"15min":0.83499999999999996},"min":{"1min":0.32000000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.64300000000000002,"5min":20.861000000000001,"15min":20.861000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":1.395,"15min":0.80100000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60299999999999998,"5min":21.984000000000002,"15min":21.984000000000002},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":2.0990000000000002,"15min":1.1859999999999999},"min":{"1min":0.48199999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.97299999999999998,"5min":22.015999999999998,"15min":22.015999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":1.8320000000000001,"15min":1.0680000000000001},"min":{"1min":0.41299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.171,"5min":20.934999999999999,"15min":20.934999999999999},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":1.897,"15min":1.0760000000000001},"min":{"1min":0.46999999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.095,"5min":23.474,"15min":23.474},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":2.0470000000000002,"15min":1.1990000000000001},"min":{"1min":0.51100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.012,"5min":21.975999999999999,"15min":21.975999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":2.1379999999999999,"15min":1.1719999999999999},"min":{"1min":0.45200000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.90400000000000003,"5min":20.898,"15min":20.898},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":1.823,"15min":1.0569999999999999},"min":{"1min":0.46200000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.145,"5min":23.513000000000002,"15min":23.513000000000002},"last":0.70099999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:46:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":2.1850000000000001,"15min":1.2569999999999999},"min":{"1min":0.57799999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91900000000000004,"5min":22.039999999999999,"15min":22.039999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":2.0329999999999999,"15min":1.175},"min":{"1min":0.49099999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.123,"5min":20.905000000000001,"15min":20.905000000000001},"last":0.75900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53328,"kb_used_data":26312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94318512,"statfs":{"total":96636764160,"available":96582156288,"internally_reserved":0,"allocated":26943488,"data_stored":26775912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":1.6539999999999999,"15min":0.89800000000000002},"min":{"1min":0.28100000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70899999999999996,"5min":17.920000000000002,"15min":17.920000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":1.716,"15min":0.92300000000000004},"min":{"1min":0.40400000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69099999999999995,"5min":20.904,"15min":20.904},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Aug 25 04:46:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":1.716,"15min":0.94599999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69399999999999995,"5min":23.911000000000001,"15min":23.911000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":1.752,"15min":0.95199999999999996},"min":{"1min":0.36499999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":21.952999999999999,"15min":21.952999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:46:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":1.8280000000000001,"15min":0.98399999999999999},"min":{"1min":0.33400000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.68400000000000005,"5min":21.847999999999999,"15min":21.847999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":2.077,"15min":1.073},"min":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72499999999999998,"5min":33.182000000000002,"15min":33.182000000000002},"last":0.626}]},{"osd":3,"last update":"Fri Aug 25 04:46:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.8700000000000001,"15min":0.99299999999999999},"min":{"1min":0.45700000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70699999999999996,"5min":17.010999999999999,"15min":17.010999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":1.5669999999999999,"15min":0.91500000000000004},"min":{"1min":0.43099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64100000000000001,"5min":15.022,"15min":15.022},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:46:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":1.1870000000000001,"15min":0.71099999999999997},"min":{"1min":0.313,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67500000000000004,"5min":20.963999999999999,"15min":20.963999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":1.446,"15min":0.83499999999999996},"min":{"1min":0.34499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67100000000000004,"5min":30.946999999999999,"15min":30.946999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:46:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":1.5740000000000001,"15min":0.86499999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68899999999999995,"5min":15.936999999999999,"15min":15.936999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":1.4550000000000001,"15min":0.85499999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.753,"5min":20.937000000000001,"15min":20.937000000000001},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:46:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":1.3300000000000001,"15min":0.81399999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.66300000000000003,"5min":12.914,"15min":12.914},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":1.6000000000000001,"15min":0.92600000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.71699999999999997,"5min":15.045999999999999,"15min":15.045999999999999},"last":0.51200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52028,"kb_used_data":12532,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319812,"statfs":{"total":96636764160,"available":96583487488,"internally_reserved":0,"allocated":12832768,"data_stored":12675435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":1.8919999999999999,"15min":0.97999999999999998},"min":{"1min":0.46100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.79900000000000004,"5min":27.048999999999999,"15min":27.048999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":1.7390000000000001,"15min":0.93500000000000005},"min":{"1min":0.40600000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.78900000000000003,"5min":20.956,"15min":20.956},"last":0.57399999999999995}]},{"osd":1,"last update":"Fri Aug 25 04:46:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":1.8200000000000001,"15min":0.95599999999999996},"min":{"1min":0.38100000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79000000000000004,"5min":20.923999999999999,"15min":20.923999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.7909999999999999,"15min":0.97499999999999998},"min":{"1min":0.35799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.755,"5min":24.927,"15min":24.927},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Aug 25 04:46:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":1.9850000000000001,"15min":1.042},"min":{"1min":0.39100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.77000000000000002,"5min":18.602,"15min":18.602},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":1.728,"15min":0.98399999999999999},"min":{"1min":0.49399999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76700000000000002,"5min":15.946999999999999,"15min":15.946999999999999},"last":0.627}]},{"osd":3,"last update":"Fri Aug 25 04:46:44 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":2.0219999999999998,"15min":1.044},"min":{"1min":0.51800000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.753,"5min":17.782,"15min":17.782},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.623,"5min":2.0659999999999998,"15min":1.1180000000000001},"min":{"1min":0.48999999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77200000000000002,"5min":27.077000000000002,"15min":27.077000000000002},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:46:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":1.21,"15min":0.71699999999999997},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64200000000000002,"5min":19.172999999999998,"15min":19.172999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":1.482,"15min":0.85599999999999998},"min":{"1min":0.39800000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74399999999999999,"5min":17.693999999999999,"15min":17.693999999999999},"last":0.36699999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:46:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":1.6160000000000001,"15min":0.874},"min":{"1min":0.33600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67100000000000004,"5min":27.103000000000002,"15min":27.103000000000002},"last":0.437},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.4390000000000001,"15min":0.84899999999999998},"min":{"1min":0.41899999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.68500000000000005,"5min":22.154,"15min":22.154},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:46:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":1.2809999999999999,"15min":0.81699999999999995},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":19.253,"15min":19.253},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":1.238,"15min":0.77700000000000002},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77900000000000003,"5min":27.001000000000001,"15min":27.001000000000001},"last":0.38700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":7854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1536000,"data_stored":1518217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1536000,"data_stored":1511105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50331648,"data_stored":50331648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37748736,"data_stored":37748736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:47:13.765 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-08-25T04:47:13.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.920+0000 7f607ee09700 1 Processor -- start 2023-08-25T04:47:13.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.920+0000 7f607ee09700 1 -- start start 2023-08-25T04:47:13.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.921+0000 7f607ee09700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f607815b360 0x7f60780b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.921+0000 7f607ee09700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60780ae9d0 0x7f6078065fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.921+0000 7f607ee09700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60780b1010 con 0x7f607806a340 2023-08-25T04:47:13.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.921+0000 7f607ee09700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60780cff60 con 0x7f607815b360 2023-08-25T04:47:13.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.921+0000 7f607ee09700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607815b740 con 0x7f60780ae9d0 2023-08-25T04:47:13.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.921+0000 7f607d3a6700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f607806a340 0x7f60780cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41040/0 (socket says 172.21.15.16:41040) 2023-08-25T04:47:13.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.921+0000 7f607d3a6700 1 -- 172.21.15.16:0/517129868 learned_addr learned my addr 172.21.15.16:0/517129868 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:47:13.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.921+0000 7f607cba5700 1 --2- 172.21.15.16:0/517129868 >> v2:172.21.15.117:3300/0 conn(0x7f607815b360 0x7f60780b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.921+0000 7f60777fe700 1 -- 172.21.15.16:0/517129868 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955487778 0 0) 0x7f60780b1010 con 0x7f607806a340 2023-08-25T04:47:13.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.921+0000 7f6077fff700 1 --2- 172.21.15.16:0/517129868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60780ae9d0 0x7f6078065fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.921+0000 7f60777fe700 1 -- 172.21.15.16:0/517129868 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60680035b0 con 0x7f607806a340 2023-08-25T04:47:13.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 -- 172.21.15.16:0/517129868 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1865590218 0 0) 0x7f60680035b0 con 0x7f607806a340 2023-08-25T04:47:13.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 -- 172.21.15.16:0/517129868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60780ae9d0 msgr2=0x7f6078065fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:13.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 --2- 172.21.15.16:0/517129868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60780ae9d0 0x7f6078065fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 -- 172.21.15.16:0/517129868 >> v2:172.21.15.117:3300/0 conn(0x7f607815b360 msgr2=0x7f60780b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:13.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 --2- 172.21.15.16:0/517129868 >> v2:172.21.15.117:3300/0 conn(0x7f607815b360 0x7f60780b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 -- 172.21.15.16:0/517129868 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60780b1280 con 0x7f607806a340 2023-08-25T04:47:13.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 -- 172.21.15.16:0/517129868 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f60700019f0 con 0x7f607806a340 2023-08-25T04:47:13.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 -- 172.21.15.16:0/517129868 >> v1:172.21.15.16:6789/0 conn(0x7f607806a340 legacy=0x7f60780cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:13.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 --2- 172.21.15.16:0/517129868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6068003a00 0x7f6068003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 --2- 172.21.15.16:0/517129868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60780ae9d0 0x7f6068004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 --2- 172.21.15.16:0/517129868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6068004d90 0x7f6068005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 -- 172.21.15.16:0/517129868 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60780cff60 con 0x7f6068004d90 2023-08-25T04:47:13.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 -- 172.21.15.16:0/517129868 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607815b740 con 0x7f6068003a00 2023-08-25T04:47:13.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 -- 172.21.15.16:0/517129868 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606800ba10 con 0x7f60780ae9d0 2023-08-25T04:47:13.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f607d3a6700 1 --2- 172.21.15.16:0/517129868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6068004d90 0x7f6068005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f607cba5700 1 --2- 172.21.15.16:0/517129868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6068003a00 0x7f6068003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f6077fff700 1 --2- 172.21.15.16:0/517129868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60780ae9d0 0x7f6068004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f607d3a6700 1 -- 172.21.15.16:0/517129868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60780ae9d0 msgr2=0x7f6068004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:13.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f607d3a6700 1 --2- 172.21.15.16:0/517129868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60780ae9d0 0x7f6068004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f607d3a6700 1 -- 172.21.15.16:0/517129868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6068003a00 msgr2=0x7f6068003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:13.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f607d3a6700 1 --2- 172.21.15.16:0/517129868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6068003a00 0x7f6068003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f607d3a6700 1 -- 172.21.15.16:0/517129868 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60680035b0 con 0x7f6068004d90 2023-08-25T04:47:13.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f607d3a6700 1 --2- 172.21.15.16:0/517129868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6068004d90 0x7f6068005210 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f607000a8d0 tx=0x7f6068005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b4189976a801aa server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:13.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.922+0000 7f60777fe700 1 -- 172.21.15.16:0/517129868 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000a340 con 0x7f6068004d90 2023-08-25T04:47:13.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.923+0000 7f60777fe700 1 -- 172.21.15.16:0/517129868 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6070012600 con 0x7f6068004d90 2023-08-25T04:47:13.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.923+0000 7f60777fe700 1 -- 172.21.15.16:0/517129868 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700129b0 con 0x7f6068004d90 2023-08-25T04:47:13.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.923+0000 7f607ee09700 1 -- 172.21.15.16:0/517129868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6068004d90 msgr2=0x7f6068005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:13.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.923+0000 7f607ee09700 1 --2- 172.21.15.16:0/517129868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6068004d90 0x7f6068005210 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f607000a8d0 tx=0x7f6068005880 comp rx=0 tx=0).stop 2023-08-25T04:47:13.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.923+0000 7f607d3a6700 1 -- 172.21.15.16:0/517129868 reap_dead start 2023-08-25T04:47:13.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.923+0000 7f607ee09700 1 -- 172.21.15.16:0/517129868 shutdown_connections 2023-08-25T04:47:13.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.923+0000 7f607ee09700 1 -- 172.21.15.16:0/517129868 >> 172.21.15.16:0/517129868 conn(0x7f60780b2440 msgr2=0x7f60780b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:13.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.923+0000 7f607ee09700 1 -- 172.21.15.16:0/517129868 shutdown_connections 2023-08-25T04:47:13.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.923+0000 7f607ee09700 1 -- 172.21.15.16:0/517129868 wait complete. 2023-08-25T04:47:13.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.925+0000 7f607ee09700 1 Processor -- start 2023-08-25T04:47:13.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.925+0000 7f607ee09700 1 -- start start 2023-08-25T04:47:13.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607ee09700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6078157620 0x7f60780c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607ee09700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60781597c0 0x7f607806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607ee09700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f607806dd30 0x7f60780c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607ee09700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607806d360 con 0x7f607806dd30 2023-08-25T04:47:13.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607ee09700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60780c6ba0 con 0x7f6078157620 2023-08-25T04:47:13.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607ee09700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607806ca30 con 0x7f60781597c0 2023-08-25T04:47:13.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607d3a6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f607806dd30 0x7f60780c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607d3a6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f607806dd30 0x7f60780c70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50638/0 (socket says 172.21.15.16:50638) 2023-08-25T04:47:13.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607d3a6700 1 -- 172.21.15.16:0/3659195776 learned_addr learned my addr 172.21.15.16:0/3659195776 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:47:13.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f6077fff700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60781597c0 0x7f607806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607cba5700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6078157620 0x7f60780c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607d3a6700 1 -- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60781597c0 msgr2=0x7f607806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:13.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607d3a6700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60781597c0 0x7f607806d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607d3a6700 1 -- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6078157620 msgr2=0x7f60780c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:13.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607d3a6700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6078157620 0x7f60780c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607d3a6700 1 -- 172.21.15.16:0/3659195776 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607806cd10 con 0x7f607806dd30 2023-08-25T04:47:13.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f6077fff700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60781597c0 0x7f607806d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:13.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.926+0000 7f607d3a6700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f607806dd30 0x7f60780c70f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6070012000 tx=0x7f6070001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:13.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.927+0000 7f60757fa700 1 -- 172.21.15.16:0/3659195776 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000a340 con 0x7f607806dd30 2023-08-25T04:47:13.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.927+0000 7f60757fa700 1 -- 172.21.15.16:0/3659195776 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60700019c0 con 0x7f607806dd30 2023-08-25T04:47:13.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.927+0000 7f607ee09700 1 -- 172.21.15.16:0/3659195776 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607806cff0 con 0x7f607806dd30 2023-08-25T04:47:13.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.927+0000 7f60757fa700 1 -- 172.21.15.16:0/3659195776 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070027410 con 0x7f607806dd30 2023-08-25T04:47:13.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.927+0000 7f607ee09700 1 -- 172.21.15.16:0/3659195776 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6078098d10 con 0x7f607806dd30 2023-08-25T04:47:13.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.928+0000 7f607ee09700 1 -- 172.21.15.16:0/3659195776 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607806d4d0 con 0x7f607806dd30 2023-08-25T04:47:13.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.928+0000 7f60757fa700 1 -- 172.21.15.16:0/3659195776 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6070019070 con 0x7f607806dd30 2023-08-25T04:47:13.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.929+0000 7f60757fa700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f605c06a0e0 0x7f605c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.929+0000 7f60757fa700 1 -- 172.21.15.16:0/3659195776 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f60700899d0 con 0x7f607806dd30 2023-08-25T04:47:13.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.929+0000 7f607cba5700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f605c06a0e0 0x7f605c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.929+0000 7f607cba5700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f605c06a0e0 0x7f605c06c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f606c009b80 tx=0x7f606c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:13.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:13.933+0000 7f60757fa700 1 -- 172.21.15.16:0/3659195776 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6070055110 con 0x7f607806dd30 2023-08-25T04:47:14.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.133+0000 7f607ee09700 1 -- 172.21.15.16:0/3659195776 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f607804ee70 con 0x7f607806dd30 2023-08-25T04:47:14.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.137+0000 7f60757fa700 1 -- 172.21.15.16:0/3659195776 <== mon.0 v2:172.21.15.16:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6070055110 con 0x7f607806dd30 2023-08-25T04:47:14.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.138+0000 7f60757fa700 1 -- 172.21.15.16:0/3659195776 <== mon.0 v2:172.21.15.16:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f6070058730 con 0x7f607806dd30 2023-08-25T04:47:14.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.140+0000 7f607ee09700 1 -- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f605c06a0e0 msgr2=0x7f605c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.140+0000 7f607ee09700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f605c06a0e0 0x7f605c06c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f606c009b80 tx=0x7f606c008040 comp rx=0 tx=0).stop 2023-08-25T04:47:14.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.140+0000 7f607ee09700 1 -- 172.21.15.16:0/3659195776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f607806dd30 msgr2=0x7f60780c70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.140+0000 7f607ee09700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f607806dd30 0x7f60780c70f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6070012000 tx=0x7f6070001360 comp rx=0 tx=0).stop 2023-08-25T04:47:14.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.140+0000 7f607ee09700 1 -- 172.21.15.16:0/3659195776 shutdown_connections 2023-08-25T04:47:14.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.140+0000 7f607ee09700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f605c06a0e0 0x7f605c06c5a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.140+0000 7f607ee09700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f607806dd30 0x7f60780c70f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.140+0000 7f607ee09700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6078157620 0x7f60780c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.140+0000 7f607ee09700 1 --2- 172.21.15.16:0/3659195776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60781597c0 0x7f607806d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.140+0000 7f607ee09700 1 -- 172.21.15.16:0/3659195776 >> 172.21.15.16:0/3659195776 conn(0x7f60780b2440 msgr2=0x7f607806ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:14.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.140+0000 7f607ee09700 1 -- 172.21.15.16:0/3659195776 shutdown_connections 2023-08-25T04:47:14.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.140+0000 7f607ee09700 1 -- 172.21.15.16:0/3659195776 wait complete. 2023-08-25T04:47:14.153 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T04:47:14.153 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:47:14.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.277+0000 7f2ec2fe9700 1 Processor -- start 2023-08-25T04:47:14.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.277+0000 7f2ec2fe9700 1 -- start start 2023-08-25T04:47:14.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.278+0000 7f2ec2fe9700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ebc15d2d0 0x7f2ebc0b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:14.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.278+0000 7f2ec2fe9700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ebc0b90b0 con 0x7f2ebc0ce530 2023-08-25T04:47:14.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.278+0000 7f2ec2fe9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ebc161430 con 0x7f2ebc160ec0 2023-08-25T04:47:14.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.278+0000 7f2ec2fe9700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0d2f10 con 0x7f2ebc15d2d0 2023-08-25T04:47:14.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.278+0000 7f2ec1586700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f2ebc0ce530 0x7f2ebc0d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41060/0 (socket says 172.21.15.16:41060) 2023-08-25T04:47:14.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.278+0000 7f2ec1586700 1 -- 172.21.15.16:0/1666250846 learned_addr learned my addr 172.21.15.16:0/1666250846 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:47:14.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.278+0000 7f2ec0d85700 1 --2- 172.21.15.16:0/1666250846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ebc15d2d0 0x7f2ebc0b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:14.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.278+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638412154 0 0) 0x7f2ebc0b90b0 con 0x7f2ebc0ce530 2023-08-25T04:47:14.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.278+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eac0035b0 con 0x7f2ebc0ce530 2023-08-25T04:47:14.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543330770 0 0) 0x7f2ebc161430 con 0x7f2ebc160ec0 2023-08-25T04:47:14.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ebc0b90b0 con 0x7f2ebc160ec0 2023-08-25T04:47:14.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 631569711 0 0) 0x7f2eac0035b0 con 0x7f2ebc0ce530 2023-08-25T04:47:14.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ebc15d2d0 msgr2=0x7f2ebc0b8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:14.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 --2- 172.21.15.16:0/1666250846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ebc15d2d0 0x7f2ebc0b8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 >> v1:172.21.15.117:6789/0 conn(0x7f2ebc160ec0 legacy=0x7f2ebc0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc161710 con 0x7f2ebc0ce530 2023-08-25T04:47:14.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3202436251 0 0) 0x7f2eb40019f0 con 0x7f2ebc0ce530 2023-08-25T04:47:14.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ec0d85700 1 --2- 172.21.15.16:0/1666250846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ebc15d2d0 0x7f2ebc0b8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:47:14.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 >> v1:172.21.15.16:6789/0 conn(0x7f2ebc0ce530 legacy=0x7f2ebc0d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 --2- 172.21.15.16:0/1666250846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eac003c30 0x7f2eac004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:14.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 --2- 172.21.15.16:0/1666250846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ebc15d2d0 0x7f2eac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:14.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 --2- 172.21.15.16:0/1666250846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac004d90 0x7f2eac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:14.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0d2f10 con 0x7f2eac004d90 2023-08-25T04:47:14.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac00bac0 con 0x7f2eac003c30 2023-08-25T04:47:14.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac00bc80 con 0x7f2ebc15d2d0 2023-08-25T04:47:14.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ec1586700 1 --2- 172.21.15.16:0/1666250846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac004d90 0x7f2eac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:14.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebbfff700 1 --2- 172.21.15.16:0/1666250846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ebc15d2d0 0x7f2eac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:14.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ec0d85700 1 --2- 172.21.15.16:0/1666250846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eac003c30 0x7f2eac004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:14.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ec1586700 1 -- 172.21.15.16:0/1666250846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ebc15d2d0 msgr2=0x7f2eac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:14.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ec1586700 1 --2- 172.21.15.16:0/1666250846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ebc15d2d0 0x7f2eac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ec1586700 1 -- 172.21.15.16:0/1666250846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eac003c30 msgr2=0x7f2eac004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:14.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ec1586700 1 --2- 172.21.15.16:0/1666250846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eac003c30 0x7f2eac004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ec1586700 1 -- 172.21.15.16:0/1666250846 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb00094a0 con 0x7f2eac004d90 2023-08-25T04:47:14.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ec0d85700 1 --2- 172.21.15.16:0/1666250846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eac003c30 0x7f2eac004030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:14.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ec1586700 1 --2- 172.21.15.16:0/1666250846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac004d90 0x7f2eac005210 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4002230 tx=0x7f2eac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab02302e8d4c758b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:14.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.279+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4012600 con 0x7f2eac004d90 2023-08-25T04:47:14.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.280+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2eb4012760 con 0x7f2eac004d90 2023-08-25T04:47:14.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.280+0000 7f2ebb7fe700 1 -- 172.21.15.16:0/1666250846 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4012b30 con 0x7f2eac004d90 2023-08-25T04:47:14.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.280+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1666250846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac004d90 msgr2=0x7f2eac005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.280+0000 7f2ec2fe9700 1 --2- 172.21.15.16:0/1666250846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac004d90 0x7f2eac005210 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4002230 tx=0x7f2eac005880 comp rx=0 tx=0).stop 2023-08-25T04:47:14.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.280+0000 7f2ec1586700 1 -- 172.21.15.16:0/1666250846 reap_dead start 2023-08-25T04:47:14.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.280+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1666250846 shutdown_connections 2023-08-25T04:47:14.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.280+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1666250846 >> 172.21.15.16:0/1666250846 conn(0x7f2ebc0d30e0 msgr2=0x7f2ebc0d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:14.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.280+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1666250846 shutdown_connections 2023-08-25T04:47:14.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.280+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1666250846 wait complete. 2023-08-25T04:47:14.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.282+0000 7f2ec2fe9700 1 Processor -- start 2023-08-25T04:47:14.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.282+0000 7f2ec2fe9700 1 -- start start 2023-08-25T04:47:14.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec2fe9700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2eac004d90 0x7f2ebc150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:14.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec2fe9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc150670 0x7f2ebc15e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:14.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec2fe9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ebc15ed70 0x7f2ebc15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:14.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec2fe9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc151e90 con 0x7f2ebc15ed70 2023-08-25T04:47:14.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec2fe9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc150e60 con 0x7f2ebc150670 2023-08-25T04:47:14.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec2fe9700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc151140 con 0x7f2eac004d90 2023-08-25T04:47:14.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec1586700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ebc15ed70 0x7f2ebc15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:14.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec1586700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ebc15ed70 0x7f2ebc15f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50658/0 (socket says 172.21.15.16:50658) 2023-08-25T04:47:14.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec1586700 1 -- 172.21.15.16:0/1752228028 learned_addr learned my addr 172.21.15.16:0/1752228028 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:47:14.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ebbfff700 1 --2- 172.21.15.16:0/1752228028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc150670 0x7f2ebc15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:14.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec0d85700 1 --2- 172.21.15.16:0/1752228028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2eac004d90 0x7f2ebc150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:14.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec1586700 1 -- 172.21.15.16:0/1752228028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2eac004d90 msgr2=0x7f2ebc150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec1586700 1 --2- 172.21.15.16:0/1752228028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2eac004d90 0x7f2ebc150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec1586700 1 -- 172.21.15.16:0/1752228028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc150670 msgr2=0x7f2ebc15e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec1586700 1 --2- 172.21.15.16:0/1752228028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc150670 0x7f2ebc15e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec1586700 1 -- 172.21.15.16:0/1752228028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc151420 con 0x7f2ebc15ed70 2023-08-25T04:47:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec1586700 1 --2- 172.21.15.16:0/1752228028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ebc15ed70 0x7f2ebc15f1f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4000f80 tx=0x7f2eb4001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2eb97fa700 1 -- 172.21.15.16:0/1752228028 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4012ce0 con 0x7f2ebc15ed70 2023-08-25T04:47:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2eb97fa700 1 -- 172.21.15.16:0/1752228028 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2eb4012e60 con 0x7f2ebc15ed70 2023-08-25T04:47:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1752228028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc151700 con 0x7f2ebc15ed70 2023-08-25T04:47:14.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2eb97fa700 1 -- 172.21.15.16:0/1752228028 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb401e660 con 0x7f2ebc15ed70 2023-08-25T04:47:14.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.283+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1752228028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc1f5ce0 con 0x7f2ebc15ed70 2023-08-25T04:47:14.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.284+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1752228028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc1f5ed0 con 0x7f2ebc15ed70 2023-08-25T04:47:14.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.285+0000 7f2eb97fa700 1 -- 172.21.15.16:0/1752228028 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2eb4019030 con 0x7f2ebc15ed70 2023-08-25T04:47:14.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.285+0000 7f2eb97fa700 1 --2- 172.21.15.16:0/1752228028 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f2ea006a110 0x7f2ea006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:14.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.285+0000 7f2eb97fa700 1 -- 172.21.15.16:0/1752228028 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2eb4089770 con 0x7f2ebc15ed70 2023-08-25T04:47:14.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.285+0000 7f2ec0d85700 1 --2- 172.21.15.16:0/1752228028 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f2ea006a110 0x7f2ea006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:14.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.286+0000 7f2ec0d85700 1 --2- 172.21.15.16:0/1752228028 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f2ea006a110 0x7f2ea006c5d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009470 tx=0x7f2eb0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:14.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.290+0000 7f2eb97fa700 1 -- 172.21.15.16:0/1752228028 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2eb4054f40 con 0x7f2ebc15ed70 2023-08-25T04:47:14.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.536+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1752228028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ebc0cede0 con 0x7f2ebc15ed70 2023-08-25T04:47:14.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.536+0000 7f2eb97fa700 1 -- 172.21.15.16:0/1752228028 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4863 (secure 0 0 0) 0x7f2eb4058560 con 0x7f2ebc15ed70 2023-08-25T04:47:14.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:47:14.538 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/397913125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":397913125},{"type":"v1","addr":"172.21.15.16:6834","nonce":397913125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1401503507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1401503507},{"type":"v1","addr":"172.21.15.117:6835","nonce":1401503507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/899398848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":899398848},{"type":"v1","addr":"172.21.15.16:6835","nonce":899398848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:43:42.297594+0000","modified":"2023-08-25T04:43:45.899399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/36836471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":36836471},{"type":"v1","addr":"172.21.15.117:6837","nonce":36836471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:47:14.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.538+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1752228028 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f2ea006a110 msgr2=0x7f2ea006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.538+0000 7f2ec2fe9700 1 --2- 172.21.15.16:0/1752228028 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f2ea006a110 0x7f2ea006c5d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009470 tx=0x7f2eb0008040 comp rx=0 tx=0).stop 2023-08-25T04:47:14.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.538+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1752228028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ebc15ed70 msgr2=0x7f2ebc15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.538+0000 7f2ec2fe9700 1 --2- 172.21.15.16:0/1752228028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ebc15ed70 0x7f2ebc15f1f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4000f80 tx=0x7f2eb4001d00 comp rx=0 tx=0).stop 2023-08-25T04:47:14.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.538+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1752228028 shutdown_connections 2023-08-25T04:47:14.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.538+0000 7f2ec2fe9700 1 --2- 172.21.15.16:0/1752228028 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f2ea006a110 0x7f2ea006c5d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.538+0000 7f2ec2fe9700 1 --2- 172.21.15.16:0/1752228028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ebc15ed70 0x7f2ebc15f1f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.538+0000 7f2ec2fe9700 1 --2- 172.21.15.16:0/1752228028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2eac004d90 0x7f2ebc150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.538+0000 7f2ec2fe9700 1 --2- 172.21.15.16:0/1752228028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc150670 0x7f2ebc15e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.539+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1752228028 >> 172.21.15.16:0/1752228028 conn(0x7f2ebc0d30e0 msgr2=0x7f2ebc0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:14.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.539+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1752228028 shutdown_connections 2023-08-25T04:47:14.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.539+0000 7f2ec2fe9700 1 -- 172.21.15.16:0/1752228028 wait complete. 2023-08-25T04:47:14.542 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2023-08-25T04:47:14.552 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:47:14.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.675+0000 7f6b4836c700 1 Processor -- start 2023-08-25T04:47:14.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.675+0000 7f6b4836c700 1 -- start start 2023-08-25T04:47:14.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.676+0000 7f6b4836c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6b4006a340 0x7f6b4006a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:14.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.676+0000 7f6b4836c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b400713e0 con 0x7f6b400b2d10 2023-08-25T04:47:14.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.676+0000 7f6b4836c700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4015ea50 con 0x7f6b4015e670 2023-08-25T04:47:14.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.676+0000 7f6b4836c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4006ad00 con 0x7f6b4006a340 2023-08-25T04:47:14.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.676+0000 7f6b45907700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6b4006a340 0x7f6b4006a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:14.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.676+0000 7f6b46909700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6b400b2d10 0x7f6b400b3140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41076/0 (socket says 172.21.15.16:41076) 2023-08-25T04:47:14.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.676+0000 7f6b46909700 1 -- 172.21.15.16:0/3867108039 learned_addr learned my addr 172.21.15.16:0/3867108039 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:47:14.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.676+0000 7f6b45907700 1 -- 172.21.15.16:0/3867108039 >> v1:172.21.15.117:6789/0 conn(0x7f6b4015e670 legacy=0x7f6b400ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:14.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.676+0000 7f6b45907700 1 -- 172.21.15.16:0/3867108039 >> v1:172.21.15.16:6789/0 conn(0x7f6b400b2d10 legacy=0x7f6b400b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.676+0000 7f6b45907700 1 -- 172.21.15.16:0/3867108039 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b40072030 con 0x7f6b4006a340 2023-08-25T04:47:14.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.676+0000 7f6b45106700 1 -- 172.21.15.16:0/3867108039 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934800661 0 0) 0x7f6b400713e0 con 0x7f6b400b2d10 2023-08-25T04:47:14.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.677+0000 7f6b45907700 1 --2- 172.21.15.16:0/3867108039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b4006a340 0x7f6b4006a7c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009840 tx=0x7f6b3c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f2b4852a8bfb73 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:14.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.677+0000 7f6b45106700 1 -- 172.21.15.16:0/3867108039 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c004230 con 0x7f6b4006a340 2023-08-25T04:47:14.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.677+0000 7f6b45106700 1 -- 172.21.15.16:0/3867108039 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6b3c004390 con 0x7f6b4006a340 2023-08-25T04:47:14.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.677+0000 7f6b45106700 1 -- 172.21.15.16:0/3867108039 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0036a0 con 0x7f6b4006a340 2023-08-25T04:47:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.677+0000 7f6b4836c700 1 -- 172.21.15.16:0/3867108039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b4006a340 msgr2=0x7f6b4006a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.677+0000 7f6b4836c700 1 --2- 172.21.15.16:0/3867108039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b4006a340 0x7f6b4006a7c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009840 tx=0x7f6b3c009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:14.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.677+0000 7f6b4836c700 1 -- 172.21.15.16:0/3867108039 shutdown_connections 2023-08-25T04:47:14.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.677+0000 7f6b4836c700 1 --2- 172.21.15.16:0/3867108039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b4006a340 0x7f6b4006a7c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.677+0000 7f6b4836c700 1 -- 172.21.15.16:0/3867108039 >> 172.21.15.16:0/3867108039 conn(0x7f6b400b1a10 msgr2=0x7f6b400b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:14.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.677+0000 7f6b4836c700 1 -- 172.21.15.16:0/3867108039 shutdown_connections 2023-08-25T04:47:14.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.677+0000 7f6b4836c700 1 -- 172.21.15.16:0/3867108039 wait complete. 2023-08-25T04:47:14.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.679+0000 7f6b4836c700 1 Processor -- start 2023-08-25T04:47:14.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.679+0000 7f6b4836c700 1 -- start start 2023-08-25T04:47:14.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.679+0000 7f6b4836c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4006a340 0x7f6b400c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:14.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.679+0000 7f6b4836c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b400b2d10 0x7f6b401599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:14.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.679+0000 7f6b4836c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b4015e670 0x7f6b40159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:14.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.679+0000 7f6b4836c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400c8d90 con 0x7f6b400b2d10 2023-08-25T04:47:14.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.679+0000 7f6b4836c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400c9070 con 0x7f6b4006a340 2023-08-25T04:47:14.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.679+0000 7f6b4836c700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400c9350 con 0x7f6b4015e670 2023-08-25T04:47:14.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.679+0000 7f6b45907700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b400b2d10 0x7f6b401599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:14.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.679+0000 7f6b45907700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b400b2d10 0x7f6b401599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50668/0 (socket says 172.21.15.16:50668) 2023-08-25T04:47:14.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.679+0000 7f6b45907700 1 -- 172.21.15.16:0/4258568496 learned_addr learned my addr 172.21.15.16:0/4258568496 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:47:14.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.680+0000 7f6b46108700 1 --2- 172.21.15.16:0/4258568496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4006a340 0x7f6b400c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:14.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.680+0000 7f6b46909700 1 --2- 172.21.15.16:0/4258568496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b4015e670 0x7f6b40159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:14.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.680+0000 7f6b45907700 1 -- 172.21.15.16:0/4258568496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b4015e670 msgr2=0x7f6b40159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.680+0000 7f6b45907700 1 --2- 172.21.15.16:0/4258568496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b4015e670 0x7f6b40159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.680+0000 7f6b45907700 1 -- 172.21.15.16:0/4258568496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4006a340 msgr2=0x7f6b400c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.680+0000 7f6b45907700 1 --2- 172.21.15.16:0/4258568496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4006a340 0x7f6b400c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.680+0000 7f6b45907700 1 -- 172.21.15.16:0/4258568496 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c0094a0 con 0x7f6b400b2d10 2023-08-25T04:47:14.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.680+0000 7f6b45907700 1 --2- 172.21.15.16:0/4258568496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b400b2d10 0x7f6b401599b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009b90 tx=0x7f6b3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:14.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.680+0000 7f6b36ffd700 1 -- 172.21.15.16:0/4258568496 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c011630 con 0x7f6b400b2d10 2023-08-25T04:47:14.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.680+0000 7f6b36ffd700 1 -- 172.21.15.16:0/4258568496 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6b3c01e070 con 0x7f6b400b2d10 2023-08-25T04:47:14.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.680+0000 7f6b36ffd700 1 -- 172.21.15.16:0/4258568496 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0119f0 con 0x7f6b400b2d10 2023-08-25T04:47:14.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.680+0000 7f6b4836c700 1 -- 172.21.15.16:0/4258568496 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b400c9630 con 0x7f6b400b2d10 2023-08-25T04:47:14.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.680+0000 7f6b4836c700 1 -- 172.21.15.16:0/4258568496 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b400c8940 con 0x7f6b400b2d10 2023-08-25T04:47:14.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.681+0000 7f6b4836c700 1 -- 172.21.15.16:0/4258568496 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b400c8b00 con 0x7f6b400b2d10 2023-08-25T04:47:14.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.682+0000 7f6b36ffd700 1 -- 172.21.15.16:0/4258568496 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6b3c011b50 con 0x7f6b400b2d10 2023-08-25T04:47:14.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.682+0000 7f6b36ffd700 1 --2- 172.21.15.16:0/4258568496 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6b2406a0e0 0x7f6b2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:14.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.682+0000 7f6b36ffd700 1 -- 172.21.15.16:0/4258568496 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6b3c089a20 con 0x7f6b400b2d10 2023-08-25T04:47:14.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.682+0000 7f6b46108700 1 --2- 172.21.15.16:0/4258568496 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6b2406a0e0 0x7f6b2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:14.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.683+0000 7f6b46108700 1 --2- 172.21.15.16:0/4258568496 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6b2406a0e0 0x7f6b2406c5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6b400c6db0 tx=0x7f6b30008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:14.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.686+0000 7f6b36ffd700 1 -- 172.21.15.16:0/4258568496 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6b3c055040 con 0x7f6b400b2d10 2023-08-25T04:47:14.799 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:47:14.801 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:47:14.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.935+0000 7f6b4836c700 1 -- 172.21.15.16:0/4258568496 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b4004ee70 con 0x7f6b400b2d10 2023-08-25T04:47:14.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.935+0000 7f6b36ffd700 1 -- 172.21.15.16:0/4258568496 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4863 (secure 0 0 0) 0x7f6b3c020070 con 0x7f6b400b2d10 2023-08-25T04:47:14.937 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:47:14.937 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/397913125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":397913125},{"type":"v1","addr":"172.21.15.16:6834","nonce":397913125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1401503507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1401503507},{"type":"v1","addr":"172.21.15.117:6835","nonce":1401503507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/899398848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":899398848},{"type":"v1","addr":"172.21.15.16:6835","nonce":899398848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:43:42.297594+0000","modified":"2023-08-25T04:43:45.899399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/36836471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":36836471},{"type":"v1","addr":"172.21.15.117:6837","nonce":36836471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:47:14.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.938+0000 7f6b4836c700 1 -- 172.21.15.16:0/4258568496 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6b2406a0e0 msgr2=0x7f6b2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.938+0000 7f6b4836c700 1 --2- 172.21.15.16:0/4258568496 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6b2406a0e0 0x7f6b2406c5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6b400c6db0 tx=0x7f6b30008040 comp rx=0 tx=0).stop 2023-08-25T04:47:14.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.938+0000 7f6b4836c700 1 -- 172.21.15.16:0/4258568496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b400b2d10 msgr2=0x7f6b401599b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.938+0000 7f6b4836c700 1 --2- 172.21.15.16:0/4258568496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b400b2d10 0x7f6b401599b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009b90 tx=0x7f6b3c004750 comp rx=0 tx=0).stop 2023-08-25T04:47:14.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.938+0000 7f6b4836c700 1 -- 172.21.15.16:0/4258568496 shutdown_connections 2023-08-25T04:47:14.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.938+0000 7f6b4836c700 1 --2- 172.21.15.16:0/4258568496 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6b2406a0e0 0x7f6b2406c5a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.938+0000 7f6b4836c700 1 --2- 172.21.15.16:0/4258568496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b4015e670 0x7f6b40159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.938+0000 7f6b4836c700 1 --2- 172.21.15.16:0/4258568496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4006a340 0x7f6b400c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.938+0000 7f6b4836c700 1 --2- 172.21.15.16:0/4258568496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b400b2d10 0x7f6b401599b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.938+0000 7f6b4836c700 1 -- 172.21.15.16:0/4258568496 >> 172.21.15.16:0/4258568496 conn(0x7f6b400b1a10 msgr2=0x7f6b400cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:14.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.938+0000 7f6b4836c700 1 -- 172.21.15.16:0/4258568496 shutdown_connections 2023-08-25T04:47:14.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:14.938+0000 7f6b4836c700 1 -- 172.21.15.16:0/4258568496 wait complete. 2023-08-25T04:47:14.942 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2023-08-25T04:47:14.951 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:47:15.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.075+0000 7f11c43bb700 1 Processor -- start 2023-08-25T04:47:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.075+0000 7f11c43bb700 1 -- start start 2023-08-25T04:47:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.076+0000 7f11c43bb700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11bc06bf80 0x7f11bc06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.076+0000 7f11c43bb700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11bc065fe0 con 0x7f11bc15a240 2023-08-25T04:47:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.076+0000 7f11c43bb700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11bc0662c0 con 0x7f11bc06aa50 2023-08-25T04:47:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.076+0000 7f11c43bb700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc06c5a0 con 0x7f11bc06bf80 2023-08-25T04:47:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.076+0000 7f11c2157700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f11bc15a240 0x7f11bc06a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41088/0 (socket says 172.21.15.16:41088) 2023-08-25T04:47:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.076+0000 7f11c2157700 1 -- 172.21.15.16:0/2472302145 learned_addr learned my addr 172.21.15.16:0/2472302145 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:47:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.076+0000 7f11c2958700 1 --2- 172.21.15.16:0/2472302145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11bc06bf80 0x7f11bc06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.076+0000 7f11c1155700 1 -- 172.21.15.16:0/2472302145 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204484935 0 0) 0x7f11bc065fe0 con 0x7f11bc15a240 2023-08-25T04:47:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.076+0000 7f11c1155700 1 -- 172.21.15.16:0/2472302145 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11a80035b0 con 0x7f11bc15a240 2023-08-25T04:47:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.077+0000 7f11c1155700 1 -- 172.21.15.16:0/2472302145 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014591242 0 0) 0x7f11bc0662c0 con 0x7f11bc06aa50 2023-08-25T04:47:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.077+0000 7f11c1155700 1 -- 172.21.15.16:0/2472302145 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11bc065fe0 con 0x7f11bc06aa50 2023-08-25T04:47:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.077+0000 7f11c2958700 1 -- 172.21.15.16:0/2472302145 >> v1:172.21.15.117:6789/0 conn(0x7f11bc06aa50 legacy=0x7f11bc0cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.077+0000 7f11c2958700 1 -- 172.21.15.16:0/2472302145 >> v1:172.21.15.16:6789/0 conn(0x7f11bc15a240 legacy=0x7f11bc06a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.077+0000 7f11c2958700 1 -- 172.21.15.16:0/2472302145 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc06b840 con 0x7f11bc06bf80 2023-08-25T04:47:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.077+0000 7f11c2958700 1 --2- 172.21.15.16:0/2472302145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11bc06bf80 0x7f11bc06d9e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009dc0 tx=0x7f11b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=771ab0929613c443 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.077+0000 7f11c1155700 1 -- 172.21.15.16:0/2472302145 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b400e070 con 0x7f11bc06bf80 2023-08-25T04:47:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.077+0000 7f11c1155700 1 -- 172.21.15.16:0/2472302145 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f11b400bb20 con 0x7f11bc06bf80 2023-08-25T04:47:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.077+0000 7f11c1155700 1 -- 172.21.15.16:0/2472302145 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b400be90 con 0x7f11bc06bf80 2023-08-25T04:47:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.078+0000 7f11c43bb700 1 -- 172.21.15.16:0/2472302145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11bc06bf80 msgr2=0x7f11bc06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.078+0000 7f11c43bb700 1 --2- 172.21.15.16:0/2472302145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11bc06bf80 0x7f11bc06d9e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009dc0 tx=0x7f11b400b330 comp rx=0 tx=0).stop 2023-08-25T04:47:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.078+0000 7f11c43bb700 1 -- 172.21.15.16:0/2472302145 shutdown_connections 2023-08-25T04:47:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.078+0000 7f11c43bb700 1 --2- 172.21.15.16:0/2472302145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11bc06bf80 0x7f11bc06d9e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.078+0000 7f11c43bb700 1 -- 172.21.15.16:0/2472302145 >> 172.21.15.16:0/2472302145 conn(0x7f11bc0b2480 msgr2=0x7f11bc0b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.078+0000 7f11c43bb700 1 -- 172.21.15.16:0/2472302145 shutdown_connections 2023-08-25T04:47:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.078+0000 7f11c43bb700 1 -- 172.21.15.16:0/2472302145 wait complete. 2023-08-25T04:47:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.079+0000 7f11c43bb700 1 Processor -- start 2023-08-25T04:47:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.079+0000 7f11c43bb700 1 -- start start 2023-08-25T04:47:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.080+0000 7f11c43bb700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11bc06aa50 0x7f11bc0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.080+0000 7f11c43bb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11bc06bf80 0x7f11bc1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.080+0000 7f11c43bb700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11bc15a240 0x7f11bc0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.080+0000 7f11c43bb700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc158080 con 0x7f11bc06aa50 2023-08-25T04:47:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.080+0000 7f11c43bb700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc155c10 con 0x7f11bc06bf80 2023-08-25T04:47:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.080+0000 7f11c43bb700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc0cb4f0 con 0x7f11bc15a240 2023-08-25T04:47:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.080+0000 7f11c2157700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11bc06aa50 0x7f11bc0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.080+0000 7f11c2157700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11bc06aa50 0x7f11bc0b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50680/0 (socket says 172.21.15.16:50680) 2023-08-25T04:47:15.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.080+0000 7f11c2157700 1 -- 172.21.15.16:0/697902362 learned_addr learned my addr 172.21.15.16:0/697902362 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:47:15.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.081+0000 7f11c1956700 1 --2- 172.21.15.16:0/697902362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11bc06bf80 0x7f11bc1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.081+0000 7f11c2958700 1 --2- 172.21.15.16:0/697902362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11bc15a240 0x7f11bc0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.081+0000 7f11c2157700 1 -- 172.21.15.16:0/697902362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11bc15a240 msgr2=0x7f11bc0af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.081+0000 7f11c2157700 1 --2- 172.21.15.16:0/697902362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11bc15a240 0x7f11bc0af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.081+0000 7f11c2157700 1 -- 172.21.15.16:0/697902362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11bc06bf80 msgr2=0x7f11bc1556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.081+0000 7f11c2157700 1 --2- 172.21.15.16:0/697902362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11bc06bf80 0x7f11bc1556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.081+0000 7f11c2157700 1 -- 172.21.15.16:0/697902362 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b4009a70 con 0x7f11bc06aa50 2023-08-25T04:47:15.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.081+0000 7f11c2157700 1 --2- 172.21.15.16:0/697902362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11bc06aa50 0x7f11bc0b18e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00c500 tx=0x7f11ac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:15.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.081+0000 7f11b2ffd700 1 -- 172.21.15.16:0/697902362 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac0074e0 con 0x7f11bc06aa50 2023-08-25T04:47:15.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.081+0000 7f11b2ffd700 1 -- 172.21.15.16:0/697902362 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f11ac007640 con 0x7f11bc06aa50 2023-08-25T04:47:15.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.081+0000 7f11b2ffd700 1 -- 172.21.15.16:0/697902362 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac005a30 con 0x7f11bc06aa50 2023-08-25T04:47:15.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.081+0000 7f11c43bb700 1 -- 172.21.15.16:0/697902362 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc0cc350 con 0x7f11bc06aa50 2023-08-25T04:47:15.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.081+0000 7f11c43bb700 1 -- 172.21.15.16:0/697902362 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11bc0cba20 con 0x7f11bc06aa50 2023-08-25T04:47:15.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.082+0000 7f11c43bb700 1 -- 172.21.15.16:0/697902362 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11bc04ee70 con 0x7f11bc06aa50 2023-08-25T04:47:15.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.083+0000 7f11b2ffd700 1 -- 172.21.15.16:0/697902362 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f11ac005b90 con 0x7f11bc06aa50 2023-08-25T04:47:15.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.084+0000 7f11b2ffd700 1 --2- 172.21.15.16:0/697902362 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f11a006a0e0 0x7f11a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.084+0000 7f11b2ffd700 1 -- 172.21.15.16:0/697902362 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f11ac087e80 con 0x7f11bc06aa50 2023-08-25T04:47:15.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.084+0000 7f11c1956700 1 --2- 172.21.15.16:0/697902362 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f11a006a0e0 0x7f11a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.085+0000 7f11c1956700 1 --2- 172.21.15.16:0/697902362 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f11a006a0e0 0x7f11a006c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0b3930 tx=0x7f11b8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:15.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.087+0000 7f11b2ffd700 1 -- 172.21.15.16:0/697902362 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f11ac0535c0 con 0x7f11bc06aa50 2023-08-25T04:47:15.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.287+0000 7f11c43bb700 1 -- 172.21.15.16:0/697902362 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11bc159a60 con 0x7f11bc06aa50 2023-08-25T04:47:15.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.289+0000 7f11b2ffd700 1 -- 172.21.15.16:0/697902362 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18329 (secure 0 0 0) 0x7f11ac017090 con 0x7f11bc06aa50 2023-08-25T04:47:15.290 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-08-25T04:47:15.290 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"fsid":"53372d9f-1238-45a2-a21f-2a854d90c0cf","created":"2023-08-25T04:43:23.604996+0000","modified":"2023-08-25T04:44:30.464568+0000","last_up_change":"2023-08-25T04:43:33.764200+0000","last_in_change":"2023-08-25T04:43:26.098941+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:43:34.951742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:43:35.360236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:43:40.197381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:43:41.268759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de96cd71-dbd5-4d4d-b1c8-868e6f5fd54f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6810","nonce":1681052994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6814","nonce":1681052994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6822","nonce":1681052994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1681052994},{"type":"v1","addr":"172.21.15.16:6818","nonce":1681052994}]},"public_addr":"172.21.15.16:6810/1681052994","cluster_addr":"172.21.15.16:6814/1681052994","heartbeat_back_addr":"172.21.15.16:6822/1681052994","heartbeat_front_addr":"172.21.15.16:6818/1681052994","state":["exists","up"]},{"osd":1,"uuid":"2464520d-6804-474e-bcfd-11dcccc3f96e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6801","nonce":3011235108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6803","nonce":3011235108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6807","nonce":3011235108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3011235108},{"type":"v1","addr":"172.21.15.16:6805","nonce":3011235108}]},"public_addr":"172.21.15.16:6801/3011235108","cluster_addr":"172.21.15.16:6803/3011235108","heartbeat_back_addr":"172.21.15.16:6807/3011235108","heartbeat_front_addr":"172.21.15.16:6805/3011235108","state":["exists","up"]},{"osd":2,"uuid":"422719d9-1cb0-4099-8601-162d26fc1fe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6825","nonce":2473914366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6827","nonce":2473914366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6831","nonce":2473914366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2473914366},{"type":"v1","addr":"172.21.15.16:6829","nonce":2473914366}]},"public_addr":"172.21.15.16:6825/2473914366","cluster_addr":"172.21.15.16:6827/2473914366","heartbeat_back_addr":"172.21.15.16:6831/2473914366","heartbeat_front_addr":"172.21.15.16:6829/2473914366","state":["exists","up"]},{"osd":3,"uuid":"135d1dcf-18b7-493d-9468-9aa281436b98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6811","nonce":1569731109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6815","nonce":1569731109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6823","nonce":1569731109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1569731109},{"type":"v1","addr":"172.21.15.16:6819","nonce":1569731109}]},"public_addr":"172.21.15.16:6811/1569731109","cluster_addr":"172.21.15.16:6815/1569731109","heartbeat_back_addr":"172.21.15.16:6823/1569731109","heartbeat_front_addr":"172.21.15.16:6819/1569731109","state":["exists","up"]},{"osd":4,"uuid":"f3e91719-3f56-4364-80c3-0d0892ef3caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6817","nonce":2302216214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6819","nonce":2302216214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6823","nonce":2302216214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2302216214},{"type":"v1","addr":"172.21.15.117:6821","nonce":2302216214}]},"public_addr":"172.21.15.117:6817/2302216214","cluster_addr":"172.21.15.117:6819/2302216214","heartbeat_back_addr":"172.21.15.117:6823/2302216214","heartbeat_front_addr":"172.21.15.117:6821/2302216214","state":["exists","up"]},{"osd":5,"uuid":"8baa272c-97fe-4bb9-b946-caee44901153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6808","nonce":3890202206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6811","nonce":3890202206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6815","nonce":3890202206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3890202206},{"type":"v1","addr":"172.21.15.117:6813","nonce":3890202206}]},"public_addr":"172.21.15.117:6808/3890202206","cluster_addr":"172.21.15.117:6811/3890202206","heartbeat_back_addr":"172.21.15.117:6815/3890202206","heartbeat_front_addr":"172.21.15.117:6813/3890202206","state":["exists","up"]},{"osd":6,"uuid":"a0217dcf-afc7-4bad-8df9-e1de4dddab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6801","nonce":2380390161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6803","nonce":2380390161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6809","nonce":2380390161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2380390161},{"type":"v1","addr":"172.21.15.117:6805","nonce":2380390161}]},"public_addr":"172.21.15.117:6801/2380390161","cluster_addr":"172.21.15.117:6803/2380390161","heartbeat_back_addr":"172.21.15.117:6809/2380390161","heartbeat_front_addr":"172.21.15.117:6805/2380390161","state":["exists","up"]},{"osd":7,"uuid":"8729cb4b-5082-43ab-a73f-41df6aa7d84f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6825","nonce":3606866589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6827","nonce":3606866589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6831","nonce":3606866589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3606866589},{"type":"v1","addr":"172.21.15.117:6829","nonce":3606866589}]},"public_addr":"172.21.15.117:6825/3606866589","cluster_addr":"172.21.15.117:6827/3606866589","heartbeat_back_addr":"172.21.15.117:6831/3606866589","heartbeat_front_addr":"172.21.15.117:6829/3606866589","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:32.774602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:30.998994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.341574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.233926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.344100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.336986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:31.334452+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:43:33.428239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:47:15.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.291+0000 7f11c43bb700 1 -- 172.21.15.16:0/697902362 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f11a006a0e0 msgr2=0x7f11a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.291+0000 7f11c43bb700 1 --2- 172.21.15.16:0/697902362 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f11a006a0e0 0x7f11a006c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0b3930 tx=0x7f11b8009040 comp rx=0 tx=0).stop 2023-08-25T04:47:15.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.291+0000 7f11c43bb700 1 -- 172.21.15.16:0/697902362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11bc06aa50 msgr2=0x7f11bc0b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.291+0000 7f11c43bb700 1 --2- 172.21.15.16:0/697902362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11bc06aa50 0x7f11bc0b18e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00c500 tx=0x7f11ac00c8c0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.291+0000 7f11c43bb700 1 -- 172.21.15.16:0/697902362 shutdown_connections 2023-08-25T04:47:15.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.291+0000 7f11c43bb700 1 --2- 172.21.15.16:0/697902362 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f11a006a0e0 0x7f11a006c5a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.291+0000 7f11c43bb700 1 --2- 172.21.15.16:0/697902362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11bc15a240 0x7f11bc0af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.291+0000 7f11c43bb700 1 --2- 172.21.15.16:0/697902362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11bc06aa50 0x7f11bc0b18e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.291+0000 7f11c43bb700 1 --2- 172.21.15.16:0/697902362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11bc06bf80 0x7f11bc1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.291+0000 7f11c43bb700 1 -- 172.21.15.16:0/697902362 >> 172.21.15.16:0/697902362 conn(0x7f11bc0b2480 msgr2=0x7f11bc0cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:15.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.291+0000 7f11c43bb700 1 -- 172.21.15.16:0/697902362 shutdown_connections 2023-08-25T04:47:15.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.291+0000 7f11c43bb700 1 -- 172.21.15.16:0/697902362 wait complete. 2023-08-25T04:47:15.305 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T04:47:15.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.430+0000 7f776b7d2700 1 Processor -- start 2023-08-25T04:47:15.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.430+0000 7f776b7d2700 1 -- start start 2023-08-25T04:47:15.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f776b7d2700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f77640cc830 0x7f77640ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f776b7d2700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77640caf10 0x7f776406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f776b7d2700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77640cbfe0 con 0x7f7764070eb0 2023-08-25T04:47:15.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f776b7d2700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77640cd150 con 0x7f77640cc830 2023-08-25T04:47:15.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f776b7d2700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77640cb3d0 con 0x7f77640caf10 2023-08-25T04:47:15.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f776956e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f77640cc830 0x7f77640ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f7769d6f700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7764070eb0 0x7f776406d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41104/0 (socket says 172.21.15.16:41104) 2023-08-25T04:47:15.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f7769d6f700 1 -- 172.21.15.16:0/634084998 learned_addr learned my addr 172.21.15.16:0/634084998 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:47:15.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f7768d6d700 1 --2- 172.21.15.16:0/634084998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77640caf10 0x7f776406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f776956e700 1 -- 172.21.15.16:0/634084998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77640caf10 msgr2=0x7f776406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:15.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f776956e700 1 --2- 172.21.15.16:0/634084998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77640caf10 0x7f776406ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f776956e700 1 -- 172.21.15.16:0/634084998 >> v1:172.21.15.16:6789/0 conn(0x7f7764070eb0 legacy=0x7f776406d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f776956e700 1 -- 172.21.15.16:0/634084998 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77640cb6b0 con 0x7f77640cc830 2023-08-25T04:47:15.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f7757fff700 1 -- 172.21.15.16:0/634084998 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143601160 0 0) 0x7f77640cbfe0 con 0x7f7764070eb0 2023-08-25T04:47:15.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f776956e700 1 --2- 172.21.15.16:0/634084998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77640cc830 0x7f77640ccc10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7758009840 tx=0x7f7758009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514c678f19157653 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:15.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f7757fff700 1 -- 172.21.15.16:0/634084998 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7758011830 con 0x7f77640cc830 2023-08-25T04:47:15.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f7757fff700 1 -- 172.21.15.16:0/634084998 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7758011990 con 0x7f77640cc830 2023-08-25T04:47:15.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.431+0000 7f7757fff700 1 -- 172.21.15.16:0/634084998 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7758011d40 con 0x7f77640cc830 2023-08-25T04:47:15.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.432+0000 7f776b7d2700 1 -- 172.21.15.16:0/634084998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77640cc830 msgr2=0x7f77640ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.432+0000 7f776b7d2700 1 --2- 172.21.15.16:0/634084998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77640cc830 0x7f77640ccc10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7758009840 tx=0x7f7758009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:15.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.432+0000 7f776b7d2700 1 -- 172.21.15.16:0/634084998 shutdown_connections 2023-08-25T04:47:15.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.432+0000 7f776b7d2700 1 --2- 172.21.15.16:0/634084998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77640cc830 0x7f77640ccc10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.432+0000 7f776b7d2700 1 --2- 172.21.15.16:0/634084998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77640caf10 0x7f776406ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.432+0000 7f776b7d2700 1 -- 172.21.15.16:0/634084998 >> 172.21.15.16:0/634084998 conn(0x7f77640b1a10 msgr2=0x7f77640b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:15.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.432+0000 7f776b7d2700 1 -- 172.21.15.16:0/634084998 shutdown_connections 2023-08-25T04:47:15.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.432+0000 7f776b7d2700 1 -- 172.21.15.16:0/634084998 wait complete. 2023-08-25T04:47:15.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.433+0000 7f776b7d2700 1 Processor -- start 2023-08-25T04:47:15.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.433+0000 7f776b7d2700 1 -- start start 2023-08-25T04:47:15.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f776b7d2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7764070eb0 0x7f77640c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f776b7d2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77640caf10 0x7f77640b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f776b7d2700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77640cc830 0x7f77640c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f776b7d2700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77640c9ed0 con 0x7f77640caf10 2023-08-25T04:47:15.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f776b7d2700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77640c75a0 con 0x7f7764070eb0 2023-08-25T04:47:15.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f776b7d2700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77640c7880 con 0x7f77640cc830 2023-08-25T04:47:15.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f7768d6d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77640caf10 0x7f77640b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f7768d6d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77640caf10 0x7f77640b0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50694/0 (socket says 172.21.15.16:50694) 2023-08-25T04:47:15.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f7768d6d700 1 -- 172.21.15.16:0/732911418 learned_addr learned my addr 172.21.15.16:0/732911418 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:47:15.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f7768d6d700 1 -- 172.21.15.16:0/732911418 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77640cc830 msgr2=0x7f77640c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f7768d6d700 1 --2- 172.21.15.16:0/732911418 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77640cc830 0x7f77640c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f7768d6d700 1 -- 172.21.15.16:0/732911418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7764070eb0 msgr2=0x7f77640c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f7768d6d700 1 --2- 172.21.15.16:0/732911418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7764070eb0 0x7f77640c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f7768d6d700 1 -- 172.21.15.16:0/732911418 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77580094a0 con 0x7f77640caf10 2023-08-25T04:47:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.434+0000 7f7768d6d700 1 --2- 172.21.15.16:0/732911418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77640caf10 0x7f77640b0d70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f776000d800 tx=0x7f776000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.435+0000 7f7755ffb700 1 -- 172.21.15.16:0/732911418 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77600125f0 con 0x7f77640caf10 2023-08-25T04:47:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.435+0000 7f7755ffb700 1 -- 172.21.15.16:0/732911418 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7760012750 con 0x7f77640caf10 2023-08-25T04:47:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.435+0000 7f776b7d2700 1 -- 172.21.15.16:0/732911418 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77640c7b60 con 0x7f77640caf10 2023-08-25T04:47:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.435+0000 7f7755ffb700 1 -- 172.21.15.16:0/732911418 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760012b20 con 0x7f77640caf10 2023-08-25T04:47:15.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.435+0000 7f776b7d2700 1 -- 172.21.15.16:0/732911418 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77640c8120 con 0x7f77640caf10 2023-08-25T04:47:15.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.436+0000 7f776b7d2700 1 -- 172.21.15.16:0/732911418 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77640c82e0 con 0x7f77640caf10 2023-08-25T04:47:15.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.436+0000 7f7755ffb700 1 -- 172.21.15.16:0/732911418 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7760012c80 con 0x7f77640caf10 2023-08-25T04:47:15.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.437+0000 7f7755ffb700 1 --2- 172.21.15.16:0/732911418 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f774806a0e0 0x7f774806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.437+0000 7f7755ffb700 1 -- 172.21.15.16:0/732911418 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7760088a50 con 0x7f77640caf10 2023-08-25T04:47:15.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.437+0000 7f776956e700 1 --2- 172.21.15.16:0/732911418 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f774806a0e0 0x7f774806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.438+0000 7f776956e700 1 --2- 172.21.15.16:0/732911418 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f774806a0e0 0x7f774806c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f77580090b0 tx=0x7f7758010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:15.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.441+0000 7f7755ffb700 1 -- 172.21.15.16:0/732911418 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7760053fd0 con 0x7f77640caf10 2023-08-25T04:47:15.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.687+0000 7f776b7d2700 1 -- 172.21.15.16:0/732911418 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f776404ee70 con 0x7f77640caf10 2023-08-25T04:47:15.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.691+0000 7f7755ffb700 1 -- 172.21.15.16:0/732911418 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f77600575f0 con 0x7f77640caf10 2023-08-25T04:47:15.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.694+0000 7f776b7d2700 1 -- 172.21.15.16:0/732911418 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f774806a0e0 msgr2=0x7f774806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.694+0000 7f776b7d2700 1 --2- 172.21.15.16:0/732911418 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f774806a0e0 0x7f774806c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f77580090b0 tx=0x7f7758010000 comp rx=0 tx=0).stop 2023-08-25T04:47:15.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.694+0000 7f776b7d2700 1 -- 172.21.15.16:0/732911418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77640caf10 msgr2=0x7f77640b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.694+0000 7f776b7d2700 1 --2- 172.21.15.16:0/732911418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77640caf10 0x7f77640b0d70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f776000d800 tx=0x7f776000dbc0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.694+0000 7f776b7d2700 1 -- 172.21.15.16:0/732911418 shutdown_connections 2023-08-25T04:47:15.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.694+0000 7f776b7d2700 1 --2- 172.21.15.16:0/732911418 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f774806a0e0 0x7f774806c5a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.694+0000 7f776b7d2700 1 --2- 172.21.15.16:0/732911418 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77640cc830 0x7f77640c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.694+0000 7f776b7d2700 1 --2- 172.21.15.16:0/732911418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7764070eb0 0x7f77640c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.694+0000 7f776b7d2700 1 --2- 172.21.15.16:0/732911418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77640caf10 0x7f77640b0d70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.694+0000 7f776b7d2700 1 -- 172.21.15.16:0/732911418 >> 172.21.15.16:0/732911418 conn(0x7f77640b1a10 msgr2=0x7f77640cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:15.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.694+0000 7f776b7d2700 1 -- 172.21.15.16:0/732911418 shutdown_connections 2023-08-25T04:47:15.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.694+0000 7f776b7d2700 1 -- 172.21.15.16:0/732911418 wait complete. 2023-08-25T04:47:15.697 INFO:teuthology.orchestra.run.smithi016.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T04:47:15.708 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T04:47:15.737 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-08-25T04:47:15.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.835+0000 7f1138292700 1 Processor -- start 2023-08-25T04:47:15.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.835+0000 7f1138292700 1 -- start start 2023-08-25T04:47:15.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.836+0000 7f1138292700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1130146560 0x7f11300d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.836+0000 7f1138292700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1130146aa0 0x7f113006a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.836+0000 7f1138292700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1130161810 con 0x7f113006a880 2023-08-25T04:47:15.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.836+0000 7f1138292700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1130146940 con 0x7f1130146560 2023-08-25T04:47:15.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.836+0000 7f1138292700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113006ad00 con 0x7f1130146aa0 2023-08-25T04:47:15.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.836+0000 7f113602e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1130146560 0x7f11300d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.836+0000 7f113602e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1130146560 0x7f11300d0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50700/0 (socket says 172.21.15.16:50700) 2023-08-25T04:47:15.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.836+0000 7f113602e700 1 -- 172.21.15.16:0/50592699 learned_addr learned my addr 172.21.15.16:0/50592699 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:47:15.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.836+0000 7f113602e700 1 -- 172.21.15.16:0/50592699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1130146aa0 msgr2=0x7f113006a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:15.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.836+0000 7f113582d700 1 --2- 172.21.15.16:0/50592699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1130146aa0 0x7f113006a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.836+0000 7f113602e700 1 --2- 172.21.15.16:0/50592699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1130146aa0 0x7f113006a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.836+0000 7f113602e700 1 -- 172.21.15.16:0/50592699 >> v1:172.21.15.117:6789/0 conn(0x7f113006a880 legacy=0x7f1130070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:15.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.836+0000 7f113602e700 1 -- 172.21.15.16:0/50592699 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113006e210 con 0x7f1130146560 2023-08-25T04:47:15.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.836+0000 7f113602e700 1 --2- 172.21.15.16:0/50592699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1130146560 0x7f11300d0920 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f112c0098f0 tx=0x7f112c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4387406fbb12fa98 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:15.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.837+0000 7f113502c700 1 -- 172.21.15.16:0/50592699 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c004230 con 0x7f1130146560 2023-08-25T04:47:15.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.837+0000 7f113502c700 1 -- 172.21.15.16:0/50592699 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f112c004390 con 0x7f1130146560 2023-08-25T04:47:15.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.837+0000 7f113502c700 1 -- 172.21.15.16:0/50592699 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c0036a0 con 0x7f1130146560 2023-08-25T04:47:15.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.837+0000 7f1138292700 1 -- 172.21.15.16:0/50592699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1130146560 msgr2=0x7f11300d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.837+0000 7f1138292700 1 --2- 172.21.15.16:0/50592699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1130146560 0x7f11300d0920 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f112c0098f0 tx=0x7f112c009c00 comp rx=0 tx=0).stop 2023-08-25T04:47:15.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.837+0000 7f1138292700 1 -- 172.21.15.16:0/50592699 shutdown_connections 2023-08-25T04:47:15.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.837+0000 7f1138292700 1 --2- 172.21.15.16:0/50592699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1130146560 0x7f11300d0920 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.837+0000 7f1138292700 1 --2- 172.21.15.16:0/50592699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1130146aa0 0x7f113006a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.837+0000 7f1138292700 1 -- 172.21.15.16:0/50592699 >> 172.21.15.16:0/50592699 conn(0x7f11300cfe00 msgr2=0x7f11300d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:15.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.837+0000 7f1138292700 1 -- 172.21.15.16:0/50592699 shutdown_connections 2023-08-25T04:47:15.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.837+0000 7f1138292700 1 -- 172.21.15.16:0/50592699 wait complete. 2023-08-25T04:47:15.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.838+0000 7f1138292700 1 Processor -- start 2023-08-25T04:47:15.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.838+0000 7f1138292700 1 -- start start 2023-08-25T04:47:15.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.839+0000 7f1138292700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f113006a880 0x7f11301418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.839+0000 7f1138292700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1130146560 0x7f11301f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.839+0000 7f1138292700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1130146aa0 0x7f113015e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.839+0000 7f1138292700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11300ad5f0 con 0x7f1130146560 2023-08-25T04:47:15.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.839+0000 7f1138292700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1130141df0 con 0x7f113006a880 2023-08-25T04:47:15.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.839+0000 7f1138292700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11300ac9e0 con 0x7f1130146aa0 2023-08-25T04:47:15.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.839+0000 7f113582d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1130146560 0x7f11301f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.839+0000 7f113582d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1130146560 0x7f11301f3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50708/0 (socket says 172.21.15.16:50708) 2023-08-25T04:47:15.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.839+0000 7f113582d700 1 -- 172.21.15.16:0/107668022 learned_addr learned my addr 172.21.15.16:0/107668022 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:47:15.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.839+0000 7f113602e700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f113006a880 0x7f11301418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.839+0000 7f113682f700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1130146aa0 0x7f113015e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.840+0000 7f113582d700 1 -- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1130146aa0 msgr2=0x7f113015e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.840+0000 7f113582d700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1130146aa0 0x7f113015e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.840+0000 7f113582d700 1 -- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f113006a880 msgr2=0x7f11301418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.840+0000 7f113582d700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f113006a880 0x7f11301418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.840+0000 7f113582d700 1 -- 172.21.15.16:0/107668022 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c009550 con 0x7f1130146560 2023-08-25T04:47:15.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.840+0000 7f113682f700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1130146aa0 0x7f113015e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:15.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.840+0000 7f113582d700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1130146560 0x7f11301f3fa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f112000c7f0 tx=0x7f112000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:15.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.840+0000 7f1126ffd700 1 -- 172.21.15.16:0/107668022 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120004230 con 0x7f1130146560 2023-08-25T04:47:15.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.840+0000 7f1126ffd700 1 -- 172.21.15.16:0/107668022 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1120004390 con 0x7f1130146560 2023-08-25T04:47:15.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.840+0000 7f1138292700 1 -- 172.21.15.16:0/107668022 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11300accc0 con 0x7f1130146560 2023-08-25T04:47:15.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.840+0000 7f1126ffd700 1 -- 172.21.15.16:0/107668022 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11200036a0 con 0x7f1130146560 2023-08-25T04:47:15.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.840+0000 7f1138292700 1 -- 172.21.15.16:0/107668022 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11300ad280 con 0x7f1130146560 2023-08-25T04:47:15.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.841+0000 7f1138292700 1 -- 172.21.15.16:0/107668022 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113006edf0 con 0x7f1130146560 2023-08-25T04:47:15.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.841+0000 7f1126ffd700 1 -- 172.21.15.16:0/107668022 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1120003820 con 0x7f1130146560 2023-08-25T04:47:15.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.842+0000 7f1126ffd700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f111406a0e0 0x7f111406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.842+0000 7f1126ffd700 1 -- 172.21.15.16:0/107668022 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f1120088410 con 0x7f1130146560 2023-08-25T04:47:15.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.842+0000 7f113602e700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f111406a0e0 0x7f111406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.843+0000 7f113602e700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f111406a0e0 0x7f111406c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f112c009130 tx=0x7f112c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:15.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:15.846+0000 7f1126ffd700 1 -- 172.21.15.16:0/107668022 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1120057480 con 0x7f1130146560 2023-08-25T04:47:16.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.094+0000 7f1138292700 1 -- 172.21.15.16:0/107668022 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f113004ee70 con 0x7f1130146560 2023-08-25T04:47:16.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.711+0000 7f1126ffd700 1 -- 172.21.15.16:0/107668022 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1120057010 con 0x7f1130146560 2023-08-25T04:47:16.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.714+0000 7f1138292700 1 -- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f111406a0e0 msgr2=0x7f111406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:16.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.714+0000 7f1138292700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f111406a0e0 0x7f111406c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f112c009130 tx=0x7f112c008030 comp rx=0 tx=0).stop 2023-08-25T04:47:16.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.714+0000 7f1138292700 1 -- 172.21.15.16:0/107668022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1130146560 msgr2=0x7f11301f3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:16.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.714+0000 7f1138292700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1130146560 0x7f11301f3fa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f112000c7f0 tx=0x7f112000cb00 comp rx=0 tx=0).stop 2023-08-25T04:47:16.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.714+0000 7f1138292700 1 -- 172.21.15.16:0/107668022 shutdown_connections 2023-08-25T04:47:16.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.714+0000 7f1138292700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f111406a0e0 0x7f111406c5a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.714+0000 7f1138292700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1130146aa0 0x7f113015e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.714+0000 7f1138292700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f113006a880 0x7f11301418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.714+0000 7f1138292700 1 --2- 172.21.15.16:0/107668022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1130146560 0x7f11301f3fa0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.714+0000 7f1138292700 1 -- 172.21.15.16:0/107668022 >> 172.21.15.16:0/107668022 conn(0x7f11300cfe00 msgr2=0x7f11300af980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:16.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.714+0000 7f1138292700 1 -- 172.21.15.16:0/107668022 shutdown_connections 2023-08-25T04:47:16.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.714+0000 7f1138292700 1 -- 172.21.15.16:0/107668022 wait complete. 2023-08-25T04:47:16.730 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T04:47:16.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.865+0000 7f6f98301700 1 Processor -- start 2023-08-25T04:47:16.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.865+0000 7f6f98301700 1 -- start start 2023-08-25T04:47:16.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.866+0000 7f6f98301700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6f9015b010 0x7f6f90071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:16.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.866+0000 7f6f98301700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f900ce8e0 con 0x7f6f900b27a0 2023-08-25T04:47:16.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.866+0000 7f6f98301700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f90072640 con 0x7f6f9015daf0 2023-08-25T04:47:16.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.866+0000 7f6f98301700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f900ce040 con 0x7f6f9015b010 2023-08-25T04:47:16.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.866+0000 7f6f9609d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6f9015b010 0x7f6f90071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:16.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.866+0000 7f6f9589c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6f900b27a0 0x7f6f90161780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41128/0 (socket says 172.21.15.16:41128) 2023-08-25T04:47:16.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.866+0000 7f6f9589c700 1 -- 172.21.15.16:0/1557055287 learned_addr learned my addr 172.21.15.16:0/1557055287 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-08-25T04:47:16.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.867+0000 7f6f9609d700 1 -- 172.21.15.16:0/1557055287 >> v1:172.21.15.117:6789/0 conn(0x7f6f9015daf0 legacy=0x7f6f9006a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:16.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.867+0000 7f6f9609d700 1 -- 172.21.15.16:0/1557055287 >> v1:172.21.15.16:6789/0 conn(0x7f6f900b27a0 legacy=0x7f6f90161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:16.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.867+0000 7f6f9609d700 1 -- 172.21.15.16:0/1557055287 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f900ce320 con 0x7f6f9015b010 2023-08-25T04:47:16.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.867+0000 7f6f9509b700 1 -- 172.21.15.16:0/1557055287 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798433946 0 0) 0x7f6f900ce8e0 con 0x7f6f900b27a0 2023-08-25T04:47:16.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.867+0000 7f6f9609d700 1 --2- 172.21.15.16:0/1557055287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f9015b010 0x7f6f90071a70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009840 tx=0x7f6f80009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bbb8e0f5e15eb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:16.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.867+0000 7f6f9509b700 1 -- 172.21.15.16:0/1557055287 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80011830 con 0x7f6f9015b010 2023-08-25T04:47:16.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.867+0000 7f6f9509b700 1 -- 172.21.15.16:0/1557055287 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6f80011990 con 0x7f6f9015b010 2023-08-25T04:47:16.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.867+0000 7f6f9509b700 1 -- 172.21.15.16:0/1557055287 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80011d40 con 0x7f6f9015b010 2023-08-25T04:47:16.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.868+0000 7f6f98301700 1 -- 172.21.15.16:0/1557055287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f9015b010 msgr2=0x7f6f90071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:16.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.868+0000 7f6f98301700 1 --2- 172.21.15.16:0/1557055287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f9015b010 0x7f6f90071a70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009840 tx=0x7f6f80009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:16.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.868+0000 7f6f98301700 1 -- 172.21.15.16:0/1557055287 shutdown_connections 2023-08-25T04:47:16.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.868+0000 7f6f98301700 1 --2- 172.21.15.16:0/1557055287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f9015b010 0x7f6f90071a70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.868+0000 7f6f98301700 1 -- 172.21.15.16:0/1557055287 >> 172.21.15.16:0/1557055287 conn(0x7f6f900b1cb0 msgr2=0x7f6f900b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:16.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.868+0000 7f6f98301700 1 -- 172.21.15.16:0/1557055287 shutdown_connections 2023-08-25T04:47:16.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.868+0000 7f6f98301700 1 -- 172.21.15.16:0/1557055287 wait complete. 2023-08-25T04:47:16.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.869+0000 7f6f98301700 1 Processor -- start 2023-08-25T04:47:16.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.869+0000 7f6f98301700 1 -- start start 2023-08-25T04:47:16.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.870+0000 7f6f98301700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f900b27a0 0x7f6f90150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:16.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.870+0000 7f6f98301700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015b010 0x7f6f90159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:16.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.870+0000 7f6f98301700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f9015daf0 0x7f6f9015a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:16.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.870+0000 7f6f98301700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900add10 con 0x7f6f9015daf0 2023-08-25T04:47:16.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.870+0000 7f6f98301700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900adf80 con 0x7f6f900b27a0 2023-08-25T04:47:16.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.870+0000 7f6f98301700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900ae260 con 0x7f6f9015b010 2023-08-25T04:47:16.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.870+0000 7f6f9689e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f9015daf0 0x7f6f9015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:16.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f9689e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f9015daf0 0x7f6f9015a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50722/0 (socket says 172.21.15.16:50722) 2023-08-25T04:47:16.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f9689e700 1 -- 172.21.15.16:0/3167613764 learned_addr learned my addr 172.21.15.16:0/3167613764 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:47:16.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f9609d700 1 --2- 172.21.15.16:0/3167613764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f900b27a0 0x7f6f90150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:16.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f9589c700 1 --2- 172.21.15.16:0/3167613764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015b010 0x7f6f90159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:16.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f9689e700 1 -- 172.21.15.16:0/3167613764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015b010 msgr2=0x7f6f90159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:16.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f9689e700 1 --2- 172.21.15.16:0/3167613764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015b010 0x7f6f90159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f9689e700 1 -- 172.21.15.16:0/3167613764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f900b27a0 msgr2=0x7f6f90150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:16.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f9689e700 1 --2- 172.21.15.16:0/3167613764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f900b27a0 0x7f6f90150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f9689e700 1 -- 172.21.15.16:0/3167613764 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f800094a0 con 0x7f6f9015daf0 2023-08-25T04:47:16.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f9689e700 1 --2- 172.21.15.16:0/3167613764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f9015daf0 0x7f6f9015a460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800cb50 tx=0x7f6f8800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:16.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f86ffd700 1 -- 172.21.15.16:0/3167613764 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88003c00 con 0x7f6f9015daf0 2023-08-25T04:47:16.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f86ffd700 1 -- 172.21.15.16:0/3167613764 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6f88003d60 con 0x7f6f9015daf0 2023-08-25T04:47:16.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f98301700 1 -- 172.21.15.16:0/3167613764 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f900ae540 con 0x7f6f9015daf0 2023-08-25T04:47:16.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f86ffd700 1 -- 172.21.15.16:0/3167613764 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800aa40 con 0x7f6f9015daf0 2023-08-25T04:47:16.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.871+0000 7f6f98301700 1 -- 172.21.15.16:0/3167613764 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f900ad7b0 con 0x7f6f9015daf0 2023-08-25T04:47:16.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.872+0000 7f6f98301700 1 -- 172.21.15.16:0/3167613764 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f90068550 con 0x7f6f9015daf0 2023-08-25T04:47:16.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.873+0000 7f6f86ffd700 1 -- 172.21.15.16:0/3167613764 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6f8800aba0 con 0x7f6f9015daf0 2023-08-25T04:47:16.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.873+0000 7f6f86ffd700 1 --2- 172.21.15.16:0/3167613764 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6f7406a0e0 0x7f6f7406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:16.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.873+0000 7f6f86ffd700 1 -- 172.21.15.16:0/3167613764 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f6f880886b0 con 0x7f6f9015daf0 2023-08-25T04:47:16.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.873+0000 7f6f9609d700 1 --2- 172.21.15.16:0/3167613764 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6f7406a0e0 0x7f6f7406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:16.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.874+0000 7f6f9609d700 1 --2- 172.21.15.16:0/3167613764 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6f7406a0e0 0x7f6f7406c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6f800090b0 tx=0x7f6f8001c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:16.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:16.877+0000 7f6f86ffd700 1 -- 172.21.15.16:0/3167613764 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6f88053c80 con 0x7f6f9015daf0 2023-08-25T04:47:17.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.077+0000 7f6f98301700 1 -- 172.21.15.16:0/3167613764 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6f900746c0 con 0x7f6f9015daf0 2023-08-25T04:47:17.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.720+0000 7f6f86ffd700 1 -- 172.21.15.16:0/3167613764 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6f880572a0 con 0x7f6f9015daf0 2023-08-25T04:47:17.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.723+0000 7f6f98301700 1 -- 172.21.15.16:0/3167613764 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6f7406a0e0 msgr2=0x7f6f7406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:17.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.723+0000 7f6f98301700 1 --2- 172.21.15.16:0/3167613764 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6f7406a0e0 0x7f6f7406c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6f800090b0 tx=0x7f6f8001c040 comp rx=0 tx=0).stop 2023-08-25T04:47:17.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.723+0000 7f6f98301700 1 -- 172.21.15.16:0/3167613764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f9015daf0 msgr2=0x7f6f9015a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:17.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.723+0000 7f6f98301700 1 --2- 172.21.15.16:0/3167613764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f9015daf0 0x7f6f9015a460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800cb50 tx=0x7f6f8800ce60 comp rx=0 tx=0).stop 2023-08-25T04:47:17.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.723+0000 7f6f98301700 1 -- 172.21.15.16:0/3167613764 shutdown_connections 2023-08-25T04:47:17.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.723+0000 7f6f98301700 1 --2- 172.21.15.16:0/3167613764 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f6f7406a0e0 0x7f6f7406c5a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:17.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.723+0000 7f6f98301700 1 --2- 172.21.15.16:0/3167613764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f9015daf0 0x7f6f9015a460 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:17.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.723+0000 7f6f98301700 1 --2- 172.21.15.16:0/3167613764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f900b27a0 0x7f6f90150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:17.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.723+0000 7f6f98301700 1 --2- 172.21.15.16:0/3167613764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9015b010 0x7f6f90159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:17.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.723+0000 7f6f98301700 1 -- 172.21.15.16:0/3167613764 >> 172.21.15.16:0/3167613764 conn(0x7f6f900b1cb0 msgr2=0x7f6f900b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:17.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.724+0000 7f6f98301700 1 -- 172.21.15.16:0/3167613764 shutdown_connections 2023-08-25T04:47:17.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.724+0000 7f6f98301700 1 -- 172.21.15.16:0/3167613764 wait complete. 2023-08-25T04:47:17.727 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' removed 2023-08-25T04:47:17.740 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T04:47:17.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.874+0000 7f601e463700 1 Processor -- start 2023-08-25T04:47:17.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.875+0000 7f601e463700 1 -- start start 2023-08-25T04:47:17.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.875+0000 7f601e463700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f601815d6a0 0x7f601815e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:17.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.875+0000 7f601e463700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f60180ceb80 0x7f60180ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:17.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.875+0000 7f601e463700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60180c7ed0 con 0x7f60180d0bb0 2023-08-25T04:47:17.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.875+0000 7f601e463700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601815eba0 con 0x7f60180ceb80 2023-08-25T04:47:17.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.875+0000 7f601e463700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60180cf530 con 0x7f601815d6a0 2023-08-25T04:47:17.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.876+0000 7f601ca00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f60180ceb80 0x7f60180ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:17.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.876+0000 7f6017fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f601815d6a0 0x7f601815e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:17.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.876+0000 7f60177fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f60180d0bb0 0x7f601806b920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.16:49236/0 (socket says 172.21.15.16:49236) 2023-08-25T04:47:17.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.876+0000 7f601ca00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f60180ceb80 0x7f60180ceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.16:38058/0 (socket says 172.21.15.16:38058) 2023-08-25T04:47:17.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.876+0000 7f6017fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f601815d6a0 0x7f601815e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.16:51268/0 (socket says 172.21.15.16:51268) 2023-08-25T04:47:17.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.876+0000 7f601ca00700 1 -- 172.21.15.16:0/1372296389 learned_addr learned my addr 172.21.15.16:0/1372296389 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:47:17.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.876+0000 7f6017fff700 1 -- 172.21.15.16:0/1372296389 >> v2:172.21.15.117:3300/0 conn(0x7f60180ceb80 msgr2=0x7f60180ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:17.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.876+0000 7f6017fff700 1 --2- 172.21.15.16:0/1372296389 >> v2:172.21.15.117:3300/0 conn(0x7f60180ceb80 0x7f60180ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:17.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.876+0000 7f6017fff700 1 -- 172.21.15.16:0/1372296389 >> v1:172.21.15.117:6789/0 conn(0x7f60180d0bb0 legacy=0x7f601806b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:17.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.876+0000 7f6017fff700 1 -- 172.21.15.16:0/1372296389 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60180cd9c0 con 0x7f601815d6a0 2023-08-25T04:47:17.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.876+0000 7f601ca00700 1 --2- 172.21.15.16:0/1372296389 >> v2:172.21.15.117:3300/0 conn(0x7f60180ceb80 0x7f60180ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:47:17.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.876+0000 7f6017fff700 1 --2- 172.21.15.16:0/1372296389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f601815d6a0 0x7f601815e660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f600c009840 tx=0x7f600c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e43ad4b013e2b6f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:17.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.876+0000 7f6016ffd700 1 -- 172.21.15.16:0/1372296389 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c011830 con 0x7f601815d6a0 2023-08-25T04:47:17.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.877+0000 7f6016ffd700 1 -- 172.21.15.16:0/1372296389 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f600c011990 con 0x7f601815d6a0 2023-08-25T04:47:17.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.877+0000 7f6016ffd700 1 -- 172.21.15.16:0/1372296389 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c011d40 con 0x7f601815d6a0 2023-08-25T04:47:17.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.877+0000 7f601e463700 1 -- 172.21.15.16:0/1372296389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f601815d6a0 msgr2=0x7f601815e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:17.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.877+0000 7f601e463700 1 --2- 172.21.15.16:0/1372296389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f601815d6a0 0x7f601815e660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f600c009840 tx=0x7f600c009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:17.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.877+0000 7f601e463700 1 -- 172.21.15.16:0/1372296389 shutdown_connections 2023-08-25T04:47:17.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.877+0000 7f601e463700 1 --2- 172.21.15.16:0/1372296389 >> v2:172.21.15.117:3300/0 conn(0x7f60180ceb80 0x7f60180ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:17.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.877+0000 7f601e463700 1 --2- 172.21.15.16:0/1372296389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f601815d6a0 0x7f601815e660 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:17.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.877+0000 7f601e463700 1 -- 172.21.15.16:0/1372296389 >> 172.21.15.16:0/1372296389 conn(0x7f60180d0fb0 msgr2=0x7f60180d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:17.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.877+0000 7f601e463700 1 -- 172.21.15.16:0/1372296389 shutdown_connections 2023-08-25T04:47:17.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.877+0000 7f601e463700 1 -- 172.21.15.16:0/1372296389 wait complete. 2023-08-25T04:47:17.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.878+0000 7f601e463700 1 Processor -- start 2023-08-25T04:47:17.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.879+0000 7f601e463700 1 -- start start 2023-08-25T04:47:17.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.879+0000 7f601e463700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60180ceb80 0x7f60181f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:17.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.879+0000 7f601e463700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60180d0bb0 0x7f6018144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:17.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.879+0000 7f601e463700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f601815d6a0 0x7f60181453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:17.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.879+0000 7f601e463700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6018155410 con 0x7f60180ceb80 2023-08-25T04:47:17.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.879+0000 7f601e463700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60180b6380 con 0x7f60180d0bb0 2023-08-25T04:47:17.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.879+0000 7f601e463700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6018154dc0 con 0x7f601815d6a0 2023-08-25T04:47:17.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.879+0000 7f6017fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60180ceb80 0x7f60181f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:17.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.879+0000 7f6017fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60180ceb80 0x7f60181f2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50730/0 (socket says 172.21.15.16:50730) 2023-08-25T04:47:17.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.879+0000 7f6017fff700 1 -- 172.21.15.16:0/1291437472 learned_addr learned my addr 172.21.15.16:0/1291437472 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-08-25T04:47:17.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.880+0000 7f60177fe700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60180d0bb0 0x7f6018144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:17.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.880+0000 7f601ca00700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f601815d6a0 0x7f60181453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:17.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.880+0000 7f6017fff700 1 -- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f601815d6a0 msgr2=0x7f60181453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:17.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.880+0000 7f6017fff700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f601815d6a0 0x7f60181453f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:17.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.880+0000 7f6017fff700 1 -- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60180d0bb0 msgr2=0x7f6018144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:17.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.880+0000 7f6017fff700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60180d0bb0 0x7f6018144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:17.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.880+0000 7f6017fff700 1 -- 172.21.15.16:0/1291437472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6010009b30 con 0x7f60180ceb80 2023-08-25T04:47:17.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.880+0000 7f601ca00700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f601815d6a0 0x7f60181453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:17.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.880+0000 7f6017fff700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60180ceb80 0x7f60181f2a20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f600c009b90 tx=0x7f600c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:17.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.880+0000 7f6014ff9700 1 -- 172.21.15.16:0/1291437472 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c0036a0 con 0x7f60180ceb80 2023-08-25T04:47:17.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.880+0000 7f6014ff9700 1 -- 172.21.15.16:0/1291437472 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f600c01e070 con 0x7f60180ceb80 2023-08-25T04:47:17.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.880+0000 7f601e463700 1 -- 172.21.15.16:0/1291437472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600c0094a0 con 0x7f60180ceb80 2023-08-25T04:47:17.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.880+0000 7f6014ff9700 1 -- 172.21.15.16:0/1291437472 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c003a80 con 0x7f60180ceb80 2023-08-25T04:47:17.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.880+0000 7f601e463700 1 -- 172.21.15.16:0/1291437472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60181f2f60 con 0x7f60180ceb80 2023-08-25T04:47:17.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.881+0000 7f601e463700 1 -- 172.21.15.16:0/1291437472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60180746c0 con 0x7f60180ceb80 2023-08-25T04:47:17.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.882+0000 7f6014ff9700 1 -- 172.21.15.16:0/1291437472 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f600c003be0 con 0x7f60180ceb80 2023-08-25T04:47:17.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.882+0000 7f6014ff9700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f600406a0e0 0x7f600406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:17.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.882+0000 7f6014ff9700 1 -- 172.21.15.16:0/1291437472 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f600c089470 con 0x7f60180ceb80 2023-08-25T04:47:17.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.882+0000 7f60177fe700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f600406a0e0 0x7f600406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:17.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.883+0000 7f60177fe700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f600406a0e0 0x7f600406c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f60180c4a20 tx=0x7f6008007ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:17.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:17.886+0000 7f6014ff9700 1 -- 172.21.15.16:0/1291437472 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f600c054c00 con 0x7f60180ceb80 2023-08-25T04:47:18.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:18.087+0000 7f601e463700 1 -- 172.21.15.16:0/1291437472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f601806b710 con 0x7f60180ceb80 2023-08-25T04:47:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:18.727+0000 7f6014ff9700 1 -- 172.21.15.16:0/1291437472 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f600c058220 con 0x7f60180ceb80 2023-08-25T04:47:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:18.733+0000 7f601e463700 1 -- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f600406a0e0 msgr2=0x7f600406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:18.733+0000 7f601e463700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f600406a0e0 0x7f600406c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f60180c4a20 tx=0x7f6008007ed0 comp rx=0 tx=0).stop 2023-08-25T04:47:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:18.733+0000 7f601e463700 1 -- 172.21.15.16:0/1291437472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60180ceb80 msgr2=0x7f60181f2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:18.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:18.733+0000 7f601e463700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60180ceb80 0x7f60181f2a20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f600c009b90 tx=0x7f600c004750 comp rx=0 tx=0).stop 2023-08-25T04:47:18.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:18.733+0000 7f601e463700 1 -- 172.21.15.16:0/1291437472 shutdown_connections 2023-08-25T04:47:18.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:18.733+0000 7f601e463700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:6832/3170738628,v1:172.21.15.117:6833/3170738628] conn(0x7f600406a0e0 0x7f600406c5a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:18.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:18.733+0000 7f601e463700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f601815d6a0 0x7f60181453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:18.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:18.733+0000 7f601e463700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60180ceb80 0x7f60181f2a20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:18.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:18.733+0000 7f601e463700 1 --2- 172.21.15.16:0/1291437472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60180d0bb0 0x7f6018144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:18.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:18.733+0000 7f601e463700 1 -- 172.21.15.16:0/1291437472 >> 172.21.15.16:0/1291437472 conn(0x7f60180d0fb0 msgr2=0x7f60180b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:18.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:18.734+0000 7f601e463700 1 -- 172.21.15.16:0/1291437472 shutdown_connections 2023-08-25T04:47:18.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-08-25T04:47:18.734+0000 7f601e463700 1 -- 172.21.15.16:0/1291437472 wait complete. 2023-08-25T04:47:18.738 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' removed 2023-08-25T04:47:18.756 INFO:teuthology.misc:Shutting down mds daemons... 2023-08-25T04:47:18.757 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T04:47:18.757 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:18.766 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T04:47:18.767 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T04:47:18.767 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:18.817 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T04:47:18.817 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T04:47:18.817 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:18.829 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T04:47:18.829 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-25T04:47:18.829 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:18.879 INFO:tasks.ceph.mds.d:Stopped 2023-08-25T04:47:18.880 INFO:teuthology.misc:Shutting down osd daemons... 2023-08-25T04:47:18.880 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-08-25T04:47:18.881 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:18.925 INFO:tasks.ceph.osd.0:Stopped 2023-08-25T04:47:18.925 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-08-25T04:47:18.926 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:18.968 INFO:tasks.ceph.osd.1:Stopped 2023-08-25T04:47:18.968 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-08-25T04:47:18.968 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:19.000 INFO:tasks.ceph.osd.2:Stopped 2023-08-25T04:47:19.000 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-08-25T04:47:19.000 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:19.072 INFO:tasks.ceph.osd.3:Stopped 2023-08-25T04:47:19.073 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-08-25T04:47:19.073 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:19.108 INFO:tasks.ceph.osd.4:Stopped 2023-08-25T04:47:19.108 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-08-25T04:47:19.109 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:19.194 INFO:tasks.ceph.osd.5:Stopped 2023-08-25T04:47:19.195 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-08-25T04:47:19.195 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:19.244 INFO:tasks.ceph.osd.6:Stopped 2023-08-25T04:47:19.244 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-08-25T04:47:19.245 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:19.285 INFO:tasks.ceph.osd.7:Stopped 2023-08-25T04:47:19.285 INFO:teuthology.misc:Shutting down mgr daemons... 2023-08-25T04:47:19.286 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-25T04:47:19.286 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:19.311 INFO:tasks.ceph.mgr.y:Stopped 2023-08-25T04:47:19.312 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-08-25T04:47:19.312 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:19.338 INFO:tasks.ceph.mgr.x:Stopped 2023-08-25T04:47:19.338 INFO:teuthology.misc:Shutting down mon daemons... 2023-08-25T04:47:19.338 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-08-25T04:47:19.339 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:19.364 INFO:tasks.ceph.mon.a:Stopped 2023-08-25T04:47:19.365 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-08-25T04:47:19.365 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:19.390 INFO:tasks.ceph.mon.b:Stopped 2023-08-25T04:47:19.390 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-08-25T04:47:19.391 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:19.442 INFO:tasks.ceph.mon.c:Stopped 2023-08-25T04:47:19.443 INFO:tasks.ceph:Checking cluster log for badness... 2023-08-25T04:47:19.443 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-25T04:47:19.481 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi016.front.sepia.ceph.com 2023-08-25T04:47:19.481 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-08-25T04:47:19.779 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi016.front.sepia.ceph.com 2023-08-25T04:47:19.779 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-08-25T04:47:19.906 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi016.front.sepia.ceph.com 2023-08-25T04:47:19.906 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-08-25T04:47:19.983 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi016.front.sepia.ceph.com 2023-08-25T04:47:19.984 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-08-25T04:47:20.062 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-25T04:47:20.062 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-08-25T04:47:20.328 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-25T04:47:20.329 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-08-25T04:47:20.417 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-25T04:47:20.417 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-08-25T04:47:20.503 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi117.front.sepia.ceph.com 2023-08-25T04:47:20.503 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-08-25T04:47:20.589 INFO:tasks.ceph:Archiving mon data... 2023-08-25T04:47:20.590 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081/data/mon.a.tgz 2023-08-25T04:47:20.591 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2023-08-25T04:47:20.610 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.wUYacepvUE 2023-08-25T04:47:20.611 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.wUYacepvUE 2023-08-25T04:47:20.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.wUYacepvUE 2023-08-25T04:47:20.838 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.wUYacepvUE is 284KB 2023-08-25T04:47:20.904 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.wUYacepvUE 2023-08-25T04:47:20.921 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081/data/mon.b.tgz 2023-08-25T04:47:20.922 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2023-08-25T04:47:20.939 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.RlhUhDXHhw 2023-08-25T04:47:20.940 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.RlhUhDXHhw 2023-08-25T04:47:21.112 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.RlhUhDXHhw 2023-08-25T04:47:21.196 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.RlhUhDXHhw is 382KB 2023-08-25T04:47:21.263 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.RlhUhDXHhw 2023-08-25T04:47:21.279 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081/data/mon.c.tgz 2023-08-25T04:47:21.279 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2023-08-25T04:47:21.334 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.QcRdyxxKEZ 2023-08-25T04:47:21.335 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.QcRdyxxKEZ 2023-08-25T04:47:21.468 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.QcRdyxxKEZ 2023-08-25T04:47:21.552 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.QcRdyxxKEZ is 382KB 2023-08-25T04:47:21.619 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.QcRdyxxKEZ 2023-08-25T04:47:21.635 INFO:tasks.ceph:Cleaning ceph cluster... 2023-08-25T04:47:21.635 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-25T04:47:21.638 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-25T04:47:21.700 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-08-25T04:47:21.700 DEBUG:teuthology.orchestra.run.smithi016:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-25T04:47:21.711 DEBUG:teuthology.orchestra.run.smithi117:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-25T04:47:21.750 INFO:teuthology.orchestra.run.smithi016.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-25T04:47:21.774 INFO:teuthology.orchestra.run.smithi117.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-25T04:47:21.779 INFO:tasks.ceph:Archiving crash dumps... 2023-08-25T04:47:21.781 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081/remote/smithi016/crash 2023-08-25T04:47:21.782 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-25T04:47:21.827 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081/remote/smithi117/crash 2023-08-25T04:47:21.828 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-25T04:47:21.854 INFO:tasks.ceph:Shutting down logrotate 2023-08-25T04:47:21.854 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:47:21.872 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:47:21.957 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-25T04:47:21.985 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-25T04:47:22.011 INFO:tasks.ceph:Compressing logs... 2023-08-25T04:47:22.011 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-25T04:47:22.028 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-25T04:47:22.054 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110649.log 2023-08-25T04:47:22.055 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116754.log 2023-08-25T04:47:22.055 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109497.log 2023-08-25T04:47:22.056 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109403.log 2023-08-25T04:47:22.056 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110649.log.gz 2023-08-25T04:47:22.056 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109497.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.116754.log.gz-5 2023-08-25T04:47:22.056 INFO:teuthology.orchestra.run.smithi016.stderr:--verbose -- /var/log/ceph/ceph-client.admin.116662.log 2023-08-25T04:47:22.060 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109403.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109497.log.gz 2023-08-25T04:47:22.060 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117501.log 2023-08-25T04:47:22.060 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.109403.log.gz 2023-08-25T04:47:22.060 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114963.log 2023-08-25T04:47:22.061 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.117501.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.116662.log.gz 2023-08-25T04:47:22.061 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103023.log 2023-08-25T04:47:22.061 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.114963.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117501.log.gz 2023-08-25T04:47:22.061 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117030.log 2023-08-25T04:47:22.061 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114963.log.gz 2023-08-25T04:47:22.062 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116340.log 2023-08-25T04:47:22.062 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.103023.log: /var/log/ceph/ceph-client.admin.117030.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-08-25T04:47:22.062 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117614.log 2023-08-25T04:47:22.062 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117030.log.gz 2023-08-25T04:47:22.062 INFO:teuthology.orchestra.run.smithi016.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.103023.log.gz 2023-08-25T04:47:22.062 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.2.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116340.log.gz 2023-08-25T04:47:22.063 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114815.log 2023-08-25T04:47:22.063 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.117614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109890.log 2023-08-25T04:47:22.063 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117614.log.gz 2023-08-25T04:47:22.064 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.114815.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-25T04:47:22.064 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112650.log 2023-08-25T04:47:22.064 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114815.log.gz/var/log/ceph/ceph-client.admin.109890.log: 2023-08-25T04:47:22.064 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109890.log.gz 2023-08-25T04:47:22.064 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109357.log 2023-08-25T04:47:22.065 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.112650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.113315.log 2023-08-25T04:47:22.065 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112650.log.gz 2023-08-25T04:47:22.065 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111968.log 2023-08-25T04:47:22.065 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.2.113315.log: 88.8% 85.1% -- replaced with /var/log/ceph/ceph-client.admin.109357.log.gz -- replaced with /var/log/ceph/ceph.log.gz 2023-08-25T04:47:22.065 INFO:teuthology.orchestra.run.smithi016.stderr: 2023-08-25T04:47:22.066 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.2.113315.log.gz--verbose 2023-08-25T04:47:22.066 INFO:teuthology.orchestra.run.smithi016.stderr:-- /var/log/ceph/ceph-client.admin.103331.log 2023-08-25T04:47:22.072 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.111968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115359.log 2023-08-25T04:47:22.072 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111968.log.gz 2023-08-25T04:47:22.072 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.103331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116892.log 2023-08-25T04:47:22.072 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103331.log.gz 2023-08-25T04:47:22.073 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115045.log 2023-08-25T04:47:22.073 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115359.log.gz 2023-08-25T04:47:22.073 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109637.log 2023-08-25T04:47:22.073 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115045.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116892.log.gz 2023-08-25T04:47:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-08-25T04:47:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109637.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115045.log.gz 2023-08-25T04:47:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116524.log 2023-08-25T04:47:22.074 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109637.log.gz 2023-08-25T04:47:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111500.log 2023-08-25T04:47:22.075 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110856.log 2023-08-25T04:47:22.075 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116524.log: /var/log/ceph/ceph-client.admin.111500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115907.log 2023-08-25T04:47:22.075 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116524.log.gz 2023-08-25T04:47:22.075 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111500.log.gz 2023-08-25T04:47:22.075 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111730.log 2023-08-25T04:47:22.076 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110856.log.gz 2023-08-25T04:47:22.076 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110273.log 2023-08-25T04:47:22.076 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115907.log: /var/log/ceph/ceph-client.admin.111730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115999.log 2023-08-25T04:47:22.076 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115907.log.gz 2023-08-25T04:47:22.076 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110273.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111730.log.gz 2023-08-25T04:47:22.077 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-08-25T04:47:22.077 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116938.log 2023-08-25T04:47:22.077 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115999.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110273.log.gz 2023-08-25T04:47:22.077 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mds.a.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.115999.log.gz 2023-08-25T04:47:22.077 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109311.log 2023-08-25T04:47:22.078 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111270.log 2023-08-25T04:47:22.078 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109311.log: gzip -5 --verbose -- 89.1%/var/log/ceph/ceph.tmp-client.admin.96731.log 2023-08-25T04:47:22.078 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.116938.log.gz 2023-08-25T04:47:22.078 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109311.log.gz 2023-08-25T04:47:22.078 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.111270.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-08-25T04:47:22.079 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111270.log.gz 2023-08-25T04:47:22.079 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117547.log 2023-08-25T04:47:22.079 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.tmp-client.admin.96731.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.96731.log.gz 2023-08-25T04:47:22.079 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117411.log 2023-08-25T04:47:22.079 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.117547.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-08-25T04:47:22.080 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.117411.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117547.log.gz 2023-08-25T04:47:22.080 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117223.log 2023-08-25T04:47:22.080 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117411.log.gz 2023-08-25T04:47:22.080 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111876.log 2023-08-25T04:47:22.080 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.117223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116386.log 2023-08-25T04:47:22.081 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.111876.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117223.log.gz 2023-08-25T04:47:22.081 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117168.log 2023-08-25T04:47:22.081 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6%/var/log/ceph/ceph-client.admin.116386.log: -- replaced with /var/log/ceph/ceph-client.admin.111876.log.gz 2023-08-25T04:47:22.081 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.117168.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116386.log.gz 2023-08-25T04:47:22.081 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117798.log 2023-08-25T04:47:22.081 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117168.log.gz 2023-08-25T04:47:22.082 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110074.log 2023-08-25T04:47:22.082 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.117798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116432.log 2023-08-25T04:47:22.082 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117798.log.gz 2023-08-25T04:47:22.082 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110074.log: /var/log/ceph/ceph-client.admin.116432.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110074.log.gz 2023-08-25T04:47:22.082 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116432.log.gz 2023-08-25T04:47:22.083 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110989.log 2023-08-25T04:47:22.083 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111922.log 2023-08-25T04:47:22.083 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.113311.log 2023-08-25T04:47:22.083 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7%/var/log/ceph/ceph-client.admin.111922.log: -- replaced with /var/log/ceph/ceph-client.admin.110989.log.gz 2023-08-25T04:47:22.083 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-08-25T04:47:22.084 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111922.log.gz 2023-08-25T04:47:22.084 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.2.113311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.113311.log.gz 2023-08-25T04:47:22.091 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110066.log 2023-08-25T04:47:22.091 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103426.log 2023-08-25T04:47:22.092 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.110066.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-08-25T04:47:22.092 INFO:teuthology.orchestra.run.smithi117.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110066.log.gz 2023-08-25T04:47:22.092 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.103426.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-25T04:47:22.092 INFO:teuthology.orchestra.run.smithi117.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103426.log.gz/var/log/ceph/ceph-osd.5.log: 2023-08-25T04:47:22.092 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103479.log 2023-08-25T04:47:22.093 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103244.log 2023-08-25T04:47:22.093 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.103479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103381.log 2023-08-25T04:47:22.093 INFO:teuthology.orchestra.run.smithi117.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103479.log.gz 2023-08-25T04:47:22.093 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.103244.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-08-25T04:47:22.093 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103291.log 2023-08-25T04:47:22.094 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.103381.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103244.log.gz 2023-08-25T04:47:22.094 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103336.log 2023-08-25T04:47:22.094 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-25T04:47:22.094 INFO:teuthology.orchestra.run.smithi117.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103381.log.gz 2023-08-25T04:47:22.095 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.103291.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-08-25T04:47:22.095 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-25T04:47:22.095 INFO:teuthology.orchestra.run.smithi117.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.103291.log.gz/var/log/ceph/ceph-client.admin.103336.log: 2023-08-25T04:47:22.095 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110074.log 2023-08-25T04:47:22.095 INFO:teuthology.orchestra.run.smithi117.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103336.log.gz 2023-08-25T04:47:22.096 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-08-25T04:47:22.096 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.110074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110074.log.gz 2023-08-25T04:47:22.096 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103153.log 2023-08-25T04:47:22.096 INFO:teuthology.orchestra.run.smithi117.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-25T04:47:22.096 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-08-25T04:47:22.097 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.103153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.110681.log 2023-08-25T04:47:22.097 INFO:teuthology.orchestra.run.smithi117.stderr: 87.5%/var/log/ceph/ceph-mgr.x.log: -- replaced with /var/log/ceph/ceph-client.admin.103153.log.gz 2023-08-25T04:47:22.097 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.3.110681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.110681.log.gz 2023-08-25T04:47:22.097 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-08-25T04:47:22.097 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-08-25T04:47:22.099 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.110685.log 2023-08-25T04:47:22.100 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.3.110685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.110685.log.gz 2023-08-25T04:47:22.100 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-08-25T04:47:22.105 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-08-25T04:47:22.107 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111224.log 2023-08-25T04:47:22.107 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110638.log 2023-08-25T04:47:22.107 INFO:teuthology.orchestra.run.smithi016.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-08-25T04:47:22.107 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.111224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109107.log 2023-08-25T04:47:22.108 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111224.log.gz 2023-08-25T04:47:22.108 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110638.log: /var/log/ceph/ceph-client.admin.109107.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110638.log.gz 2023-08-25T04:47:22.108 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109107.log.gz 2023-08-25T04:47:22.108 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116045.log 2023-08-25T04:47:22.108 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116248.log 2023-08-25T04:47:22.109 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115405.log 2023-08-25T04:47:22.109 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116045.log.gz 2023-08-25T04:47:22.109 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110028.log 2023-08-25T04:47:22.109 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8%/var/log/ceph/ceph-client.admin.115405.log: -- replaced with /var/log/ceph/ceph-client.admin.116248.log.gz 2023-08-25T04:47:22.110 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116616.log 2023-08-25T04:47:22.110 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110028.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115405.log.gz 2023-08-25T04:47:22.110 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116616.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110028.log.gz 2023-08-25T04:47:22.110 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116616.log.gz 2023-08-25T04:47:22.110 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110275.log 2023-08-25T04:47:22.111 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115451.log 2023-08-25T04:47:22.111 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103465.log 2023-08-25T04:47:22.111 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115451.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110275.log.gz 2023-08-25T04:47:22.111 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111592.log 2023-08-25T04:47:22.111 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115451.log.gz 2023-08-25T04:47:22.112 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.103465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116570.log 2023-08-25T04:47:22.112 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103465.log.gz 2023-08-25T04:47:22.112 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.111592.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-25T04:47:22.112 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111592.log.gz 2023-08-25T04:47:22.112 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109844.log 2023-08-25T04:47:22.113 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4%/var/log/ceph/ceph.audit.log: -- replaced with /var/log/ceph/ceph-client.admin.116570.log.gz 2023-08-25T04:47:22.113 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110636.log 2023-08-25T04:47:22.113 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111454.log 2023-08-25T04:47:22.113 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109844.log.gz 2023-08-25T04:47:22.113 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110636.log: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-25T04:47:22.114 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110636.log.gz 2023-08-25T04:47:22.114 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.111454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109265.log 2023-08-25T04:47:22.114 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111454.log.gz 2023-08-25T04:47:22.114 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115815.log 2023-08-25T04:47:22.114 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110277.log 2023-08-25T04:47:22.114 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115815.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109265.log.gz 2023-08-25T04:47:22.115 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110277.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115815.log.gz 2023-08-25T04:47:22.115 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110277.log.gz 2023-08-25T04:47:22.115 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117122.log 2023-08-25T04:47:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110646.log 2023-08-25T04:47:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.117122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116846.log 2023-08-25T04:47:22.116 INFO:teuthology.orchestra.run.smithi016.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.117122.log.gz 2023-08-25T04:47:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116800.log 2023-08-25T04:47:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110644.log 2023-08-25T04:47:22.117 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116846.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110646.log.gz 2023-08-25T04:47:22.117 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116800.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116846.log.gz 2023-08-25T04:47:22.117 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110644.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116800.log.gz 2023-08-25T04:47:22.117 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110644.log.gz 2023-08-25T04:47:22.117 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108800.log 2023-08-25T04:47:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114645.log 2023-08-25T04:47:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.108800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115313.log 2023-08-25T04:47:22.118 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108800.log.gz 2023-08-25T04:47:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.114645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112658.log 2023-08-25T04:47:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115769.log 2023-08-25T04:47:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115313.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114645.log.gz 2023-08-25T04:47:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.112658.log: 0.0% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115313.log.gz -- replaced with /var/log/ceph/ceph-client.0.112658.log.gz 2023-08-25T04:47:22.119 INFO:teuthology.orchestra.run.smithi016.stderr: 2023-08-25T04:47:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115769.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115769.log.gz 2023-08-25T04:47:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111316.log 2023-08-25T04:47:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117357.log 2023-08-25T04:47:22.120 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.111316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111546.log 2023-08-25T04:47:22.120 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111316.log.gz 2023-08-25T04:47:22.120 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.117357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110278.log 2023-08-25T04:47:22.120 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111822.log 2023-08-25T04:47:22.121 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.111546.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117357.log.gz 2023-08-25T04:47:22.121 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109219.log 2023-08-25T04:47:22.121 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111546.log.gz 2023-08-25T04:47:22.121 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.111822.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110278.log.gz 2023-08-25T04:47:22.121 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111822.log.gz 2023-08-25T04:47:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109219.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109219.log.gz 2023-08-25T04:47:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117706.log 2023-08-25T04:47:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111408.log 2023-08-25T04:47:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.117706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115267.log 2023-08-25T04:47:22.122 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7%/var/log/ceph/ceph-client.admin.111408.log: -- replaced with /var/log/ceph/ceph-client.admin.117706.log.gz 2023-08-25T04:47:22.122 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111408.log.gz 2023-08-25T04:47:22.123 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115267.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115267.log.gz 2023-08-25T04:47:22.123 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109936.log 2023-08-25T04:47:22.123 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-08-25T04:47:22.123 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110274.log 2023-08-25T04:47:22.123 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.1.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109936.log.gz 2023-08-25T04:47:22.124 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110274.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110274.log.gz 2023-08-25T04:47:22.124 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110280.log 2023-08-25T04:47:22.124 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108863.log 2023-08-25T04:47:22.124 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110280.log: /var/log/ceph/ceph-client.admin.108863.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110280.log.gz 2023-08-25T04:47:22.124 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108863.log.gz 2023-08-25T04:47:22.125 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115953.log 2023-08-25T04:47:22.125 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111684.log 2023-08-25T04:47:22.125 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117752.log 2023-08-25T04:47:22.125 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.111684.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115953.log.gz 2023-08-25T04:47:22.126 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.117752.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111684.log.gz 2023-08-25T04:47:22.126 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.117752.log.gz 2023-08-25T04:47:22.126 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110647.log 2023-08-25T04:47:22.126 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117455.log 2023-08-25T04:47:22.126 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110647.log: /var/log/ceph/ceph-client.admin.117455.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110647.log.gz 2023-08-25T04:47:22.127 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117455.log.gz 2023-08-25T04:47:22.127 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116294.log 2023-08-25T04:47:22.127 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111017.log 2023-08-25T04:47:22.127 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110987.log 2023-08-25T04:47:22.127 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.111017.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116294.log.gz 2023-08-25T04:47:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110987.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111017.log.gz 2023-08-25T04:47:22.128 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110987.log.gz 2023-08-25T04:47:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111362.log 2023-08-25T04:47:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109001.log 2023-08-25T04:47:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111362.log: /var/log/ceph/ceph-client.admin.117076.log 2023-08-25T04:47:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109001.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111362.log.gz 2023-08-25T04:47:22.129 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9%/var/log/ceph/ceph-client.admin.117076.log: -- replaced with /var/log/ceph/ceph-client.admin.109001.log.gz 2023-08-25T04:47:22.129 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117076.log.gz 2023-08-25T04:47:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117290.log 2023-08-25T04:47:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112168.log 2023-08-25T04:47:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.117290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110997.log 2023-08-25T04:47:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.112168.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117290.log.gz 2023-08-25T04:47:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110997.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112168.log.gz 2023-08-25T04:47:22.130 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110997.log.gz 2023-08-25T04:47:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110992.log 2023-08-25T04:47:22.131 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114719.log 2023-08-25T04:47:22.131 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110992.log: /var/log/ceph/ceph-client.admin.114719.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110992.log.gz 2023-08-25T04:47:22.131 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114719.log.gz 2023-08-25T04:47:22.131 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115677.log 2023-08-25T04:47:22.131 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115723.log 2023-08-25T04:47:22.131 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112014.log 2023-08-25T04:47:22.132 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115723.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115677.log.gz 2023-08-25T04:47:22.132 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115723.log.gz 2023-08-25T04:47:22.132 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.112014.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.112014.log.gz 2023-08-25T04:47:22.133 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mds.b.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-08-25T04:47:22.133 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103199.log 2023-08-25T04:47:22.133 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-08-25T04:47:22.134 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.103199.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.103199.log.gz 2023-08-25T04:47:22.139 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111776.log 2023-08-25T04:47:22.140 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110279.log 2023-08-25T04:47:22.140 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.111776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115221.log 2023-08-25T04:47:22.140 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110279.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111776.log.gz 2023-08-25T04:47:22.140 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7%/var/log/ceph/ceph-client.admin.115221.log: -- replaced with /var/log/ceph/ceph-client.admin.110279.log.gz 2023-08-25T04:47:22.141 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116708.log 2023-08-25T04:47:22.141 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115221.log.gz 2023-08-25T04:47:22.141 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109591.log 2023-08-25T04:47:22.141 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116708.log: /var/log/ceph/ceph-client.admin.109591.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116708.log.gz 2023-08-25T04:47:22.141 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.109591.log.gz 2023-08-25T04:47:22.142 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116984.log 2023-08-25T04:47:22.142 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113537.log 2023-08-25T04:47:22.142 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109797.log 2023-08-25T04:47:22.142 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.113537.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.116984.log.gz 2023-08-25T04:47:22.142 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113537.log.gz 2023-08-25T04:47:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109797.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109797.log.gz 2023-08-25T04:47:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115585.log 2023-08-25T04:47:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109545.log 2023-08-25T04:47:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116478.log 2023-08-25T04:47:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109545.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115585.log.gz 2023-08-25T04:47:22.144 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116478.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109545.log.gz 2023-08-25T04:47:22.144 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116478.log.gz 2023-08-25T04:47:22.144 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110645.log 2023-08-25T04:47:22.144 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111638.log 2023-08-25T04:47:22.144 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110994.log 2023-08-25T04:47:22.145 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.111638.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110645.log.gz 2023-08-25T04:47:22.145 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110999.log 2023-08-25T04:47:22.145 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111638.log.gz 2023-08-25T04:47:22.145 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110994.log: /var/log/ceph/ceph-client.admin.110999.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110994.log.gz 2023-08-25T04:47:22.145 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112880.log 2023-08-25T04:47:22.146 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110999.log.gz 2023-08-25T04:47:22.146 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110637.log 2023-08-25T04:47:22.146 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.112880.log: /var/log/ceph/ceph-client.admin.110637.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112880.log.gz 2023-08-25T04:47:22.146 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110637.log.gz 2023-08-25T04:47:22.147 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113583.log 2023-08-25T04:47:22.147 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109982.log 2023-08-25T04:47:22.147 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.113583.log: /var/log/ceph/ceph-client.admin.109982.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113583.log.gz 2023-08-25T04:47:22.147 INFO:teuthology.orchestra.run.smithi016.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.109982.log.gz 2023-08-25T04:47:22.147 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110281.log 2023-08-25T04:47:22.148 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109750.log 2023-08-25T04:47:22.148 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110281.log: /var/log/ceph/ceph-client.admin.109750.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110281.log.gz 2023-08-25T04:47:22.148 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.109750.log.gz 2023-08-25T04:47:22.148 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117660.log 2023-08-25T04:47:22.148 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115539.log 2023-08-25T04:47:22.149 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.117660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115861.log 2023-08-25T04:47:22.149 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115539.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117660.log.gz 2023-08-25T04:47:22.149 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115861.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115539.log.gz 2023-08-25T04:47:22.149 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115861.log.gz 2023-08-25T04:47:22.149 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-08-25T04:47:22.150 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115631.log 2023-08-25T04:47:22.150 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109704.log 2023-08-25T04:47:22.150 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115631.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115631.log.gz 2023-08-25T04:47:22.150 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109704.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109704.log.gz 2023-08-25T04:47:22.150 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-08-25T04:47:22.151 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109164.log 2023-08-25T04:47:22.151 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.109164.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109164.log.gz 2023-08-25T04:47:22.151 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109449.log 2023-08-25T04:47:22.151 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109449.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109449.log.gz 2023-08-25T04:47:22.151 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108911.log 2023-08-25T04:47:22.151 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.108911.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108911.log.gz 2023-08-25T04:47:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114889.log 2023-08-25T04:47:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.114889.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114889.log.gz 2023-08-25T04:47:22.152 INFO:teuthology.orchestra.run.smithi016.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-08-25T04:47:22.193 INFO:teuthology.orchestra.run.smithi117.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-08-25T04:47:22.198 INFO:teuthology.orchestra.run.smithi117.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-08-25T04:47:22.391 INFO:teuthology.orchestra.run.smithi016.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-08-25T04:47:22.583 INFO:teuthology.orchestra.run.smithi117.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-08-25T04:47:22.624 INFO:teuthology.orchestra.run.smithi117.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-08-25T04:47:22.640 INFO:teuthology.orchestra.run.smithi117.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-08-25T04:47:22.656 INFO:teuthology.orchestra.run.smithi016.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-08-25T04:47:22.781 INFO:teuthology.orchestra.run.smithi016.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-08-25T04:47:22.788 INFO:teuthology.orchestra.run.smithi117.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-08-25T04:47:22.862 INFO:teuthology.orchestra.run.smithi016.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-08-25T04:47:22.909 INFO:teuthology.orchestra.run.smithi016.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-08-25T04:47:22.911 INFO:teuthology.orchestra.run.smithi016.stderr: 2023-08-25T04:47:22.911 INFO:teuthology.orchestra.run.smithi016.stderr:real 0m0.868s 2023-08-25T04:47:22.911 INFO:teuthology.orchestra.run.smithi016.stderr:user 0m3.159s 2023-08-25T04:47:22.911 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m0.213s 2023-08-25T04:47:23.257 INFO:teuthology.orchestra.run.smithi117.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-08-25T04:47:23.259 INFO:teuthology.orchestra.run.smithi117.stderr: 2023-08-25T04:47:23.259 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m1.191s 2023-08-25T04:47:23.259 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m3.622s 2023-08-25T04:47:23.259 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m0.150s 2023-08-25T04:47:23.260 INFO:tasks.ceph:Archiving logs... 2023-08-25T04:47:23.260 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081/remote/smithi016/log 2023-08-25T04:47:23.261 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-25T04:47:23.710 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081/remote/smithi117/log 2023-08-25T04:47:23.711 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-25T04:47:24.113 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-25T04:47:24.123 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-25T04:47:24.123 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-25T04:47:24.126 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-25T04:47:24.219 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-25T04:47:24.228 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-25T04:47:24.229 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-25T04:47:24.231 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-25T04:47:24.247 INFO:teuthology.orchestra.run.smithi117.stderr:bash: ntpq: command not found 2023-08-25T04:47:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:bash: ntpq: command not found 2023-08-25T04:47:24.252 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-25T04:47:24.252 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2023-08-25T04:47:24.252 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 25 +2147us[+2147us] +/- 72ms 2023-08-25T04:47:24.253 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv02.front.sepia.ceph.com 3 6 377 25 -1888us[-1885us] +/- 58ms 2023-08-25T04:47:24.253 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +415us[ +418us] +/- 77ms 2023-08-25T04:47:24.253 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:47:24.254 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-25T04:47:24.254 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2023-08-25T04:47:24.254 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 25 +2162us[+2162us] +/- 72ms 2023-08-25T04:47:24.254 INFO:teuthology.orchestra.run.smithi016.stdout:^* hv02.front.sepia.ceph.com 3 6 377 25 -1893us[-1896us] +/- 58ms 2023-08-25T04:47:24.255 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +424us[ +421us] +/- 77ms 2023-08-25T04:47:24.255 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:47:24.256 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-25T04:47:24.264 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-25T04:47:24.265 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-25T04:47:24.275 DEBUG:teuthology.orchestra.run.smithi016:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-25T04:47:24.401 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-25T04:47:24.492 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-25T04:47:24.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:47:24.527 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-25T04:47:24.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:47:24.559 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-25T04:47:24.568 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-25T04:47:24.577 INFO:teuthology.task.internal:Duration was 1044.549813 seconds 2023-08-25T04:47:24.578 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-25T04:47:24.587 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-25T04:47:24.587 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-25T04:47:24.590 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-25T04:47:24.638 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-25T04:47:24.645 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-25T04:47:24.963 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-25T04:47:24.963 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2023-08-25T04:47:24.963 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-25T04:47:24.987 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2023-08-25T04:47:24.987 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-25T04:47:25.008 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-25T04:47:25.009 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-25T04:47:25.029 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-25T04:47:25.090 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-25T04:47:25.090 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-25T04:47:25.113 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-25T04:47:25.204 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-25T04:47:25.214 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-25T04:47:25.214 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-25T04:47:25.241 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-25T04:47:25.268 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-25T04:47:25.278 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-25T04:47:25.284 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-25T04:47:25.308 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2023-08-25T04:47:25.334 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2023-08-25T04:47:25.348 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-25T04:47:25.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:47:25.379 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-25T04:47:25.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:47:25.403 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-25T04:47:25.414 INFO:teuthology.task.internal:Transferring archived files... 2023-08-25T04:47:25.414 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081/remote/smithi016 2023-08-25T04:47:25.415 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-25T04:47:25.455 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081/remote/smithi117 2023-08-25T04:47:25.456 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-25T04:47:25.491 INFO:teuthology.task.internal:Removing archive directory... 2023-08-25T04:47:25.491 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-25T04:47:25.494 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-25T04:47:25.541 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-25T04:47:25.552 INFO:teuthology.task.internal:Not uploading archives. 2023-08-25T04:47:25.552 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-25T04:47:25.562 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-25T04:47:25.562 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-25T04:47:25.565 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-25T04:47:25.579 INFO:teuthology.orchestra.run.smithi016.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 25 04:47 /home/ubuntu/cephtest 2023-08-25T04:47:25.597 INFO:teuthology.orchestra.run.smithi117.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 25 04:47 /home/ubuntu/cephtest 2023-08-25T04:47:25.598 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-25T04:47:25.609 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-25T04:47:25.628 INFO:teuthology.nuke:Checking targets against current locks 2023-08-25T04:47:25.654 DEBUG:teuthology.nuke:shortname: smithi016 2023-08-25T04:47:25.654 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T04:47:25.676 DEBUG:teuthology.nuke:shortname: smithi117 2023-08-25T04:47:25.676 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T04:47:25.679 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 04:24:40.249494', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-25T04:47:25.699 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379081', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 04:24:40.248130', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-25T04:47:25.729 INFO:teuthology.orchestra.console.smithi016:Power off 2023-08-25T04:47:25.730 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T04:47:25.753 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2023-08-25T04:47:25.754 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:47:25.773 INFO:teuthology.orchestra.console.smithi117:Power off 2023-08-25T04:47:25.774 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T04:47:25.786 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2023-08-25T04:47:25.796 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off 2023-08-25T04:47:25.797 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:47:25.820 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2023-08-25T04:47:29.788 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:47:29.822 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:47:29.899 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2023-08-25T04:47:29.933 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2023-08-25T04:47:33.903 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:47:33.933 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:47:34.017 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-08-25T04:47:34.049 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2023-08-25T04:47:34.118 INFO:teuthology.orchestra.console.smithi016:Power off completed 2023-08-25T04:47:34.150 INFO:teuthology.orchestra.console.smithi117:Power off completed 2023-08-25T04:47:34.256 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} duration: 1044.5498130321503 failure_reason: 'Command failed (workunit test fs/quota/quota.sh) on smithi117 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ba6b39e4f4f77fb95c747099b53db0467d435f56 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh''' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=e4ac280c680d4db6b9976dac468c2879 status: fail success: false 2023-08-25T04:47:34.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T04:47:34.345 INFO:teuthology.run:FAIL